Forum Moderators: open
I'm finding google has indexed my home page but nothing else. My site has been around for a while but I decided to change the entire theme and everything. took down all old links to site (weren't many) and started over from scratch.
It used to take at least a month or so for a deep crawl and then it would be indexed - not so with the constant update?
I now have about 20-30 links incoming, and the google spider comes by every day and grabs my stuff. But it hasn't indexed any of it yet.
Any suggestions?
Hello, with the new google constant update occuring all the time, anyone know how much time it takes for the spider to come around, crawl the site, and index it?
Well most of the readers of the forum seem hell-bent on worrying themselves about Florida, I thought I'd wander round the deserted corridors and empty rooms that are the rest of the threads...
How long?
Depends on the PR of your pages, I think is the most succinct answer.
One of my sites has a home page PR5 that's visited every day. Another site of mine is brand new with just two links from outside. The home page shows PR2 and it hasn't been visited by Google in two months.
Which is what I'd expect.
But in answer to your *real* question, which is how can you get visited by Google more often, well, you need to be on the receiving end of some good links from good pages.
But if not, just bide your time...
Indeed, as most people here are wont to say - use that time to write more content - when Google comes, he'll visit more often in future then.
DerekH
For your particular situation DerekH's comments are very true
I wonder if this kind of thing will happen instead of the constant update...if Google will go back to it's old dance method.
Personally, I like the rolling update more. I guess we'll just have to stay tuned...
I don't think that will change. It just may be that every now and then for technical reasons Google still has to do a complete update. How long has it been since Esmeralda?
Well most of the readers of the forum seem hell-bent on worrying themselves about Florida, I thought I'd wander round the deserted corridors and empty rooms that are the rest of the threads...
;-)
Even with the update madness, I managed to get advice on a couple of questions in other forums. I was impressed.
Markis, hard to say, eh? Google likes to keep us baffled... it's in their best interests. I liked the regular deepcrawl that used to come after the regular dance. I get the main pages tagged most days, but new ones that are a few clicks down can take a while to get found. This might all be changing again.
One of my sites has a home page PR5 that's visited every day.This is my problem right now, since I got a PR5, I was visited by freshtagged by google 3 times a week. But suddenly it stopped, about two weeks ago(still at PR5). I don't know if putting a robots.txt file has something to do with it but I removed it again hoping that googlebot will come back. I have a posting also regarding this topic [webmasterworld.com...] And an addition to this, maybe for the moment I should contain myself on the Google's "Webmaster Info/My Site's Listing is Incorrect" on #1 [google.com...]
When you update information on your site it does not automatically update instantly in Google's index. Rather, Google's index is updated approximately once a month after our robots have crawled more than 3 billion web pages.but again, the question is when? :(
You'll have to be more specific for what you did with your robots.txt file. If your file says the following:
User-agent: Mediapartners-Google*
Disallow:
Then you should be okay. If you have anything else in your robots.txt file, delete it and revert to the above to make your site more googlebot-friendly.
I get hit by the googlebot almost everyday, but that dosen't mean my site updates at the same time. It usually takes at least a week or two from when you make changes to your site before Google will notice now (in my experience, with the new rolling update). But with all this florida update halabaloo going on I really have no idea what is happening right now. Sorry.
Also, I would suggest to you a tool located on microsoft's bcentral network that checks your site to make sure it is search engine friendly. Pages larger then 100k, pages that take too long to load, javascript redirects, popups, etc.
These would all be considered non-search engine friendly and might discourage a SE robot from entirely spidering your site.
Again, this is just stuff that helps me when I am having problems getting into Google for search terms...and I'm pretty new to optimizing myself..so someone can correct me if I'm wrong.
I hope that helps you though :)
