How do I get Google to follow all links?

[MacBoneHead]

Hi all,

I submitted my website URL ( <snip> ) to google and it got indexed, but I'm having a problem. After doing some test Google searches, I realized Google indexed all the main pages of my site properly (home, services, contact, etc), but doesn't index the content of each "news" and "tips & tools" article. In other words, it doesn't seem to want to follow links from the "news" or "tips and tools" pages on my site, even though I have this:

<meta name="ROBOTS" content="INDEX, FOLLOW">

in the head section of each html page on my site. If anyone wants to take a look at the site and give me pointer, I'd be grateful.

Thanks!

[edited by: Brett_Tabke at 3:55 pm (utc) on Jan. 1, 2005]
[edit reason] No specific urls please - review tos...thanks [/edit]

[skipfactor]

Google will follow all, give it some more time, nothing wrong with the site. Get some more links.

[MacBoneHead]

Thanks for the reply. I should have been more specific - my website has was first indexed by google over 2 months ago, so I'm thinking it's not an issue of waiting a little longer. When you say "get some more links" do you mean links to my site from others? Will that really cause google to dig deeper into my website link hierarchy?

Anyone know if I'm wrong, or what else may be preventing it?

One thing: all my hyperlinks within my site are absolute links (http://www.mydomain.com/contacts.php), not relative (contacts.php). Does google care about that?

Thanks again...

[skipfactor]

>>it doesn't seem to want to follow links from the "news" or "tips and tools" pages on my site

Actually, if you do a site search (site:www.domain.com) you'll see that googlebot is indeed following and indexing these links.

>>When you say "get some more links" do you mean links to my site from others? Will that really cause google to dig deeper into my website link hierarchy?

Yes & yes--deeper >> faster.

& welcome to Webmaster World!

[benevolent001]

Dont worry
Google will even index those pages which are not yet created...MSN has come....so google has changed its nature....

[jdancing]

It's good to have a few sites that get blasted by googlebot several times a day linking to you. If you can get these sites to deep link to the pages you are having trouble getting in the index, all the better.

[steveb]

What skipfactor said, msg4.

<should have read that post before doing my five minutes of Sherlocking...>

[DerekH]

my website has was first indexed by google over 2 months ago, so I'm thinking it's not an issue of waiting a little longer.

Think again!
It all depends on how many good links there are to each page in your site. Sure your own links count as good if they're high PR, but speed of indexing varies greatly with how many ways Google can get to your pages.
On one of my sites, I got 80% spidered in the first 3 days of its existence, on another new site I've got 35% of it indexed, and it's been four months.
And those rates reflect almost exactly the effort I've put in to getting the two sites indexed.

But two months isn't that long for a "hard to get to" page
DerekH

[annej]

I always feature new pages for about a month on a main page that gets frequent spider visits. That way the new pages get picked up quickly. The higher the pr on the page that has linked to a new page the quicker it will get spidered.