homepage Welcome to WebmasterWorld Guest from 54.237.125.89
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Sidewinder is slithering (Go/Infoseek)
littleman




msg:406835
 8:30 pm on Oct 9, 2000 (gmt 0)

I saw the early requests last night. Right now it is in full on indexing mode.

 

Brett_Tabke




msg:406836
 9:32 pm on Oct 9, 2000 (gmt 0)

When did you submit them? Or are these respiderings?

littleman




msg:406837
 10:36 pm on Oct 9, 2000 (gmt 0)

New sites and respidering. I submit every day. It looks like nothing from June on is being crawled, which has been their pattern for the last few cycles.

Air




msg:406838
 2:47 am on Oct 10, 2000 (gmt 0)

I submitted a bunch of pages starting about four weeks ago, and have been seeing lot's of action from Sidewinder the last two days.

PeteU




msg:406839
 4:01 am on Oct 10, 2000 (gmt 0)

I did NOT submit anything to Infoseek for at least 2 month and I see a lot of action from Sidewinder last two days as well.

Brett_Tabke




msg:406840
 7:20 am on Oct 10, 2000 (gmt 0)

I'm just wondering if it would do any good to start submitting now.

I have found sidewinder quite a bit the last month, but I think all of those are on sites that are already in the go directory.

littleman




msg:406841
 7:58 am on Oct 10, 2000 (gmt 0)

Brett, I don't know if this is god new or bad news for you, but many of the sites I am tracking do not have a listing in the Go directory. They are basically doorway domains.

pete




msg:406842
 12:07 pm on Oct 10, 2000 (gmt 0)

Sidewinder hit the default page yesterday for a site that I started submitting on the 8th september.

Air




msg:406843
 12:47 pm on Oct 10, 2000 (gmt 0)

Just to continue the information sharing -

My sites were new ones, so I am pretty sure the spiderings are a result of the submission, or I just got lucky and hit a spidering cycle that was taking place anyway.

drbill




msg:406844
 12:56 pm on Oct 10, 2000 (gmt 0)

Sidewinder going crazy here as well. Some of the sites are old submissions and some are new(within 2 weeks) 3 days and counting


mark roach




msg:406845
 4:55 pm on Oct 10, 2000 (gmt 0)

Sidewinder is hitting a few of my sites. I don't think that I have ever submitted any of these sites, but they are linked to by another site that is already in the index.

Blockhead




msg:406846
 7:22 pm on Oct 12, 2000 (gmt 0)

I am also seing Sidewinder requesting my pages as well. Only requesting a single page each visit, but has come several times over the last few days.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved