WebmasterWorld Recent Post List

Displaying Topics 1 - 50 Sorted by: Forum, Direction: forward Unanswered Messages
#Subjectsort orderForumMSGsDate
1: .htaccess file to protect wp-admin
Need to create wildcards for IPV6
Apache Web Server 85:39 pm Sep 29, 2025
2: Problem accessing my local website - localhost
when I put my website on my HOME data partition
Apache Web Server 147:38 am Jan 30, 2026
3: iPhone Safari 26.4.1 errors: IPv4 & Host Apple Safari 73:36 am Apr 24, 2026
4: 'goo Portal' to end service in November 2025
In Japan, before Google, there was Goo. Now it is announcing its shutdown.
Asia and Pacific Region 510:34 am Nov 10, 2025
5: Japan now requires search engine choice on mobile platforms Asia and Pacific Region 44:09 pm Dec 9, 2025
6: How Google Took Japan in 2001 Asia and Pacific Region 12:28 am Apr 13, 2026
7: Bing's AI generated snippets contain errors
Just annoying or defamation?
Bing Search and SEO 210:48 pm Oct 18, 2025
8: How do I Get A Thumbnail Picture Appearing in Bing Searches Bing Search and SEO 59:23 pm Jan 21, 2026
9: My Website Is Not Indexing on Bing — Using an Expired Domain Bing Search and SEO 108:27 am May 29, 2026
10: Observations on Bing Search Behavior and SEO Differences vs Google
Observations on Bing Search Behavior and SEO Differences vs Google
Bing Search and SEO 49:32 am Jun 4, 2026
11: How can a small website get listed on Google News?
Google News in 2026
Blogging SEO Blog Administration 45:50 am Mar 19, 2026
12: How to handle aggressive bot scanning on landing pages? Cloaking 311:30 am Feb 26, 2026
13: Trying to export posts from an old MovableType blog Content Management 26:45 am May 14, 2026
14: Joomla JCE exploit
If you run Joomla you need to make sure you secured
Content Management 14:57 pm Jun 24, 2026
15: Stolen content: can we learn from the music industry?
Debate the problem, ideas and possible solutions or alternatives
Content, Writing and Copyright 29:22 am Nov 15, 2025
16: What about you? as content creators, let's share bits of our stories
Are you a one man band? or your projects are managed by a team?
Content, Writing and Copyright 312:47 am Jan 6, 2026
17: Do you get tired of others copying your content? [3] ( 1 2 3 )
How this affects your motivation to create content?
Content, Writing and Copyright 823:18 pm Aug 29, 2026
18: Web hit from Residential ISP or international VPN? Crawler, Spider, and User Agent ID 84:46 pm Oct 1, 2025
19: ChatGPT-User
Does it indicate bot or user (human) engagement?
Crawler, Spider, and User Agent ID 45:00 pm Oct 4, 2025
20: msnbot / bingbot interacting with my site's search script
started recently
Crawler, Spider, and User Agent ID 26:18 am Oct 8, 2025
21: Found some bad actors from this ISP
cheapy.host LLC 196.251.81.0
Crawler, Spider, and User Agent ID 42:18 am Oct 12, 2025
22: ACEVILLEPTELTD Singapore Scraper Farm Crawler, Spider, and User Agent ID 811:11 pm Oct 12, 2025
23: Why does ClaudeBot / Anthropic do this?
Repeatedly ask for robots and sitemap
Crawler, Spider, and User Agent ID 26:10 am Oct 13, 2025
24: TikTokSpider Crawler, Spider, and User Agent ID 75:52 pm Oct 14, 2025
25: xAI / grok likely getting web search from Microsoft Crawler, Spider, and User Agent ID 11:48 pm Oct 15, 2025
26: Web host not seen before - AI hosting Crawler, Spider, and User Agent ID 55:10 pm Oct 16, 2025
27: blocking amazon networks Crawler, Spider, and User Agent ID 2410:04 pm Oct 20, 2025
28: Archive.org now sometimes using generic user-agent? Crawler, Spider, and User Agent ID 35:28 pm Oct 28, 2025
29: Evolving and Cloaking Your Robots.txt into an Active Bot Gatekeeper Crawler, Spider, and User Agent ID 95:37 pm Nov 9, 2025
30: the robots ye will always have with you Crawler, Spider, and User Agent ID 65:50 pm Nov 9, 2025
31: Bad actors from 140.235.0.0/22
140.235.0.0/22
Crawler, Spider, and User Agent ID 23:46 pm Nov 11, 2025
32: ShapBot Crawler, Spider, and User Agent ID 33:27 am Nov 14, 2025
33: Complete mess all over 43.0.0.0/8
Concidering nuking the whole /8 for US/Canada sites
Crawler, Spider, and User Agent ID 155:34 am Dec 5, 2025
34: Where is grok bot / xAI?
Does grok use anonymous VPNs to crawl sites?
Crawler, Spider, and User Agent ID 189:03 pm Dec 9, 2025
35: Is anyone getting hits from 121.99.4.0/24 ? Crawler, Spider, and User Agent ID 153:28 am Dec 16, 2025
36: FBI Seeks To Unmask Anonymous Web Archiving Service Owner
Archive.today
Crawler, Spider, and User Agent ID 411:46 pm Dec 17, 2025
37: Softblocking 35.0.0.0/8 Crawler, Spider, and User Agent ID 2211:26 pm Dec 21, 2025
38: A useful resource for bot / proxy detectives Crawler, Spider, and User Agent ID 27:26 pm Jan 6, 2026
39: Procter & Gamble bot-running
(not just soap 'n' stuff)
Crawler, Spider, and User Agent ID 911:57 pm Feb 19, 2026
40: Server Farms 2026
Continuing discussion of hosting and data center IP ranges
Crawler, Spider, and User Agent ID 63:27 pm Feb 21, 2026
41: FeedFetcher-Google running amok Crawler, Spider, and User Agent ID 75:12 pm Mar 9, 2026
42: Youbot (new crawler?)
and google-inspection tool
Crawler, Spider, and User Agent ID 111:50 pm Mar 13, 2026
43: PerplexityBot
What's the verdict?
Crawler, Spider, and User Agent ID 312:16 am Mar 30, 2026
44: "traceparent" header
...part of OpenTelemetry SDK
Crawler, Spider, and User Agent ID 18:07 pm Apr 1, 2026
45: SleepBot Crawler, Spider, and User Agent ID 63:59 pm Apr 7, 2026
46: Fixed Line ISP- gtt.net
Are they Hu-men, AS3257?
Crawler, Spider, and User Agent ID 133:25 am Apr 9, 2026
47: My website was vacuumed up by OpenAI Crawler, Spider, and User Agent ID 36:27 pm Apr 13, 2026
48: what do they want? [3] ( 1 2 3 ) Crawler, Spider, and User Agent ID 889:40 pm Apr 29, 2026
49: reverse() -- ColdFusion(or your language)/SQL + JavaScript
Antiscrape Trick - What is stopping me from doing it this way?
Crawler, Spider, and User Agent ID 35:19 pm May 11, 2026
50: Bad actor claiming to be OpenAi
74.7.242.63
Crawler, Spider, and User Agent ID 22:16 am May 14, 2026