Welcome to WebmasterWorld Guest from 188.8.131.52
Forum Moderators: open
I'm being hit very hard by google's freshbot at the moment, and going deep too. At first glance at what is currently going on with the little guys, I had to check and double check that the IP's were 64.... (they are).
It's behaviour, in terms of hard hitting and depth of crawl (it's going through the entire site) is more like the character of the old deepbot.
In fact, it's identical behaviour to deepbot the last time it crawled this site back in April.
I'm interested in hearing from others who are seeing the same.
I know it's already been established that Googlebot doesn't seem to "know" about the April deepcrawl, yada yada. I'm just one more confirmation.
It is frustrating, though.
But are you seeing the pages the FB grabs show up in the index? From what I'm seeing, the FB system is only funtioning properly for those pages coming from sites that were already in the Feb/March db.
On new sites, FB is crawling regularly, but those new pages aren't showing up.
Changes I make on the homepage are grabbed and in the index within 2 days.
On another site I have, created 2 months back, while fb/gb has visited it several times, still does not show up in the index. not even the homepage. while ATW has eaten up all pages.
This site first got PR4 in April, then PR evaporated during DOM. Presently keeps flipping between showing 153 pages allinurl and 98!
Have been getting traffic from new pages and not finding them listed amongst the 153...
Can anyone else confirm this?
I'm still only seeing Freshie
Maybe Google has penalized me for some obscure reason...
No Deep crawl for the last 3-4 months for me
You need more incoming links and to be sure of what that link company is doing.
Added: you might consider shortening the title somewhat, though I doubt that that is your problem.