Webcrawler Indexing New Sites

[seth_wilde]

Webcrawler actually indexed one of my new sites. I haven't seen this happen since September of 99, anyone else having any luck?

[Brett_Tabke]

I don't understand. I've gotten plenty of new pages to show up in WC the last six months, but it has been sporadic. WC is just on the 'slow trickle' submission list and I forget about it. Occasionally a new page that I submitted pops up.

The big problem for me is now that the ice is beginning to thaw over there, I'm losing some killer rankings. Since last fall, I'd had three pages that were pulling 1-1.5k referrals out of wc a day. That has now dried up with the slow updating they are doing.

[seth_wilde]

I thought webcrawler was dead, I haven't submitted to them in the last three months just because I thought it was a waste of my time. I wonder if they're actually going to start actively indexing or if this is just part of their "slow trickle" that you described. I guess we'll just have to wait and see.

[Brett_Tabke]

The thaw continues. We very slowly dropped off the radar screen at WC. Excite we are doing ok, but WC has buried us top to bottom (client sites). We did have choice listings there that generated stable quality traffic (about 5k referrals aday across 80 main domains).

The big problem is losing rankings there, is that you also lose them on the meta se's too. That go2net/metacrawler could really put the icing on the cake of top rankings.

Anyone getting new stuff indexed on WC?

[RealSpices]

Not a wiggle.. I have the same #1 ranking there I've had for the past two years.. Excite used to be the same way but about a month ago I got dropped to #16..

In the same time period I've gotten about 10 hits a month from WC but (when I was placed #1) with Excite I was getting about 300/month..

Looks like EX has binged on 404 and freebie sites and needs to purge. :)

[seoboy]

brett,

i have a dozens and dozens of new sites - all from this year - that i've been fairly regularly submitting to Excite.

not a peep out of them - not a single spider visit. no evidence of one either. no familiar ips no familiar (or newly familiar :)) useragents, no nothin. and more importantly, no excite referrers. so its not like something has snuck in the database.

seth, are you saying that you've had new sites FIRST SUBMITTED THIS YEAR spidered by WC? do you submit to both excite and WC, or just excite? i've just been doing excite for over a year, given that they've been populating both databases. but i dont know what to think anymore...

have your newly spidered sites "gone live" yet? and most importantly, if so did they go live in both WC and EX? in other words, are we still talking one database here?

seoboy

[seth_wilde]

seoboy - (sorry for the slow reply I hadn't checked this thread for a while just checked in to report some new info) webcrawler keeps a seperate database from excite, My new webcrawler listing was submitted and excepted this year, I think it was submitted directly to webcrawler.

Anyway time for the new info - In the current Market Position newsletter they printed an email received from webcrawler's tech support.

"The WebCrawler index is much smaller than the Excite index
and can not index as many sites. I have been informed that
the Webcrawler index is at capacity, and we are not taking
any more site submissions."

I guess this helps to explain things

[lennyi]

I'm in the same boat as seoboy. Submissions for a new site (since April) and no visits from either.
lennyi