Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

4 month old site - not getting well crawled or indexed

         

Seattle_SEM

4:34 am on Jan 5, 2010 (gmt 0)

10+ Year Member



I've got crawlable content, and according to GWT, 55 links pointing to my domain. I've got 11,000 pages of shopping content, in a sitemap that's been submitted and accepted. I'm getting some small amount of visitors, say 50/day, from Google, for some of my pages that they have indexed.

My problem is that Google is just not crawling/indexing me that much. The "internal links" in WMT is really messed up for me, months old I think. And they say that they've only crawled about 15% of my known content.

I'm pulling my hair out.
Do you all think this is anything that I'm doing wrong, or do I just need to wait it out, perhaps until caffiene rolls out?

Thanks for your help.

tedster

5:44 am on Jan 6, 2010 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I'd say review your server logs and see what kinds of responses your server is giving to googlebot. Also check your robots.txt to be sure it isn't disallowing files you intend to have crawled.

lpiracing

6:24 am on Jan 6, 2010 (gmt 0)

10+ Year Member



Seems a lot of us are in the same boat. We had about 25,000 pages indexed and changed the URL structure in November. Google is crawling our site but only a page here and there is being added to the SERPS, and other pages are being dropped. I suspect until Google gets done with whatever they are doing there is no way to tell if you are doing something wrong, or if it's just Google. Make sure you have good Meta, there are index/follows on all the pages, and that you have unique content, especially on your categories, (no categories without some text, etc). I would build some links with Facebook, etc... and then just wait, which is really hard I know.

walkman

7:34 am on Jan 6, 2010 (gmt 0)



11K pages needs a lot of PR and maybe Google is tasting it as time goes. Also 4 months might not be enough for Google to jump in full speed.

Your content, how unique is it?
Are the pages well linked within your site structure (by category, alphabetically, related products, random products, tags) ?

Seattle_SEM

7:21 pm on Jan 6, 2010 (gmt 0)

10+ Year Member



Thank you for all the responses.
My content is not super unique - I mean it's product content. I do have some unique merchants.

I added a few links from Facebook, thanks.
I don't think this is anything I'm doing wrong, I guess. Just wait it out ;-(