Forum Moderators: open

Message Too Old, No Replies

Is Google spidering tomorrow?

Google spidering

         

cazgh

8:42 am on Jul 23, 2003 (gmt 0)

10+ Year Member



According to my logs, the Google Bot comes every 10 days and is due tomorrow.

Anyone agree?

Dayo_UK

1:03 pm on Jul 25, 2003 (gmt 0)



too_much_information

Sorry Mate...... Googlebot only took the robots.txt and the root after similey face.

Having a good old session today though....

nwctwx

7:46 pm on Jul 25, 2003 (gmt 0)

10+ Year Member



googlebot disappeared from my 2 month old site a few days ago after a nearly daily visit.

I wish it would come back! I now am down to only my index showing up in SERPS

:/

LukeC

8:39 pm on Jul 25, 2003 (gmt 0)

10+ Year Member



no way has a dance started....

no signs!

kamikaze Optimizer

12:14 am on Jul 26, 2003 (gmt 0)

10+ Year Member



I think the update has started, anybody else?

jargon12:

While making such statements, can you please provide supporting info that made you come to this conclusion.

Thank you,

universetoday

4:37 am on Jul 26, 2003 (gmt 0)

10+ Year Member



Google's been just great to me. It's been going through my site almost every day and indexing hundreds of pages at a time. It's allowed me to add new pages and then see if they're working almost immediately. I added a forum a week ago, and it's already accounting for 10% of my traffic from Google. Inktomi and Teoma have been busy little bees too.

anallawalla

10:56 am on Jul 26, 2003 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



While making such statements, can you please provide supporting info that made you come to this conclusion.

Without wishing to put a label on Google's behaviour, nearly all the SERPs I watch are in flux. e.g. site:domain.com -fdf for one site gives counts of: 79, 79, 84, 91, 100, 100, 84, 100, 96. For another site with first-place rankings for months, it is now way past #100. Another search term comes up in the nine centres in slightly different positions.

Call it what you wish.

- Ash

galaga

2:32 am on Jul 28, 2003 (gmt 0)

10+ Year Member



I submitted manually to Google a couple of weeks ago and showed up in first place last week (not hard, the key phrase is my name- virtually no competition). But in the last few days, sometimes I show up in third position. ie. I go to 3rd, 3rd is in 1st place and 2nd stays put. I was checking a few minutes ago and I changed from 1st to 3rd place and back again twice within a matter of minutes. I checked a dance tool which showed me in 3rd place everywhere and when I check my logs I can't find any evidence of any googlebot at all. I don't have a clue what's going on any more.

And whats more, this is for a search of my 'myfirstname mylastname'. My domain is www.myfirstnamemylastname.com so why I should get beaten to 1st place by a crappy irrelevent page with an obscure url and 'myfirstname' somewhere on the page and 'mylastname' somewhere else beats me.

But hey, whats the point of losing sleep over it!

NazaretH

3:42 am on Jul 28, 2003 (gmt 0)

10+ Year Member



My 2 cents for those watching Googlebot behavior closely: Our site grows fast and we add about 200 new, static, content-rich pages a day. All pages are pretty well linked (each page has at least 3 links from elsewhere on the site and some have outbound links). We are always ahead of Googlebot but WHAT a PLEASURE (!) to see him trying to follow our ride - Googlebot makes about 1000 hits a day on our site and adds AT LEAST 100 pages a day to index. What is interesting: Every day I am pretty sure to see at least 100 new pages indexed from our site (searching for "site:domain.com smth"), or 200, or 300, or 600, or 1000 pages, BUT I don't see , say 122, or 98, or 2435 new pages added - always several hundreds.

Now Google has 11,100 pages indexed from our site, tomorrow it will be at least 11,200. This tempo doesn't change for about 2 weeks now and we enjoy it :) We are still a few hundreds pages ahead, but when adding a page, we are pretty sure to see it Google within 3-4 days.

And... just looked at different datacenters - some have 10,800 , some 11,000, etc..... www-ab wins with 11,100

Lundorff

8:30 am on Jul 28, 2003 (gmt 0)

10+ Year Member



11,000 pages? Contect-rich? How do 1 make 11,000 relevant pages...?

d_fused

9:01 am on Jul 28, 2003 (gmt 0)

10+ Year Member



11,000 pages? Contect-rich? How do 1 make 11,000 relevant pages...?

Actually it is quite easy. All you have to do is flatten the entire web site so you don't have any session id's or other variables in the url.

A 5000 item database could easily generate 50 000 pages. And if you don't push it too far, it won't be considered spam.

my 2 cents.

d_fused

jb123

5:13 pm on Jul 28, 2003 (gmt 0)

10+ Year Member



d_fused -
Can you please explain in detail what you mean by flattening your website? What type pages are they, .asp or what? I'm trying to get my site indexed entirely so, this would be helpful.

Thank you for time and thoughts.

This 41 message thread spans 2 pages: 41