Toggle navigation
Dashboard
Dashboard Tracker
Add / Edit My Forums
System Announcements
Discussion
Active Thread Feed
Top Threads Today
Top Threads This Week
Top Threads Library
Go!
View All
View All
Login
Logout
Home
Forums Index
General SEO Issues
/
Crawler, Spider, and User Agent ID
12:21 am Jun 20, 2026
This page requires javascript.
Forum Moderators:
open
Message Too Old, No Replies
heads up! ghost.directhit.com
littleman
Msg#:408834
10:05 pm on Aug 15, 2000
(gmt 0)
64.14.66.100 ghost.directhit.com Mozilla/2.0 (compatible; EZResult -- Internet Search Engine acurtis@directhit.com
mark roach
Msg#:408835
8:10 am on Oct 11, 2000
(gmt 0)
This one just grabbed my robots.txt yesterday and nothing more. Any idea what its purpose is ?
Air
Msg#:408836
1:49 pm on Oct 11, 2000
(gmt 0)
Thanx littleman, always appreciate those heads up.
shri
Msg#:408837
5:28 am on Oct 20, 2000
(gmt 0)
same here. Got robots.txt and nothing else.
Join The Conversation
Register
For Free! -
Become a
Pro Member
!
See forum categories
-
Enter the Forum
Moderators and Top Contributors
Moderator List
| Top Contributors:
This Week
,
This Month
,
May
,
Apr
,
Archive
,
Top 100 All Time
,
Top Voted Members
Hot Threads This Week
June 2026 Google Search Observations
Quite quiet in here, anyone know why?
Most people don't read anymore
AdSense Earnings and Observations - June 2026
2025 Link Building Trends and Insights
How has AI changed your work?
Big websites now dead (due to company decisions)
Home
Forums Index
General SEO Issues
/
Crawler, Spider, and User Agent ID
12:21 am Jun 20, 2026