Not indexing whole site

[bebox]

Hi Guys,
Hope someone can help...
We provide our articles for Google News (and Moreover.com), which is great and seems to be working fine, what I have a problem with is that our site articles seem to not be appearing in the normal Google directory and the Google bot is not grabbing all of our articles for the normal directory but they are being taken for the News directory.

We have daily coverage of major events in our sector with sometimes up to 3 or 4 times our competitors but when I do a search for soemthing that we are covering heavily I find we are not even in the Top 50 but other sites are and they only have a story from last year's tournament!

Now this isn't happening all the time, as two weeks ago we were number one and number three for that week's main event around the world but of course that only lasted a few days :))

I know one of the problems, which I am trying to fix, which is that our main articles page uses dropdown menus (choose category and number of articles etc) and of course the dropdown menus are no good for the Google bot.

It is very frustrating to have the best coverage in OZ and not being able to be searched for in the Google directory.

TIA
B

[edited by: heini at 3:24 pm (utc) on Jan. 18, 2003]
[edit reason] removed specifics ¦ see sticky mail ¦ thanks! [/edit]

[taxpod]

bebox, I think what you are experiencing is frustration over the "slowness" of the main Google (non-news) database. Aside from Freshbot which can occur every few days, the main database is updated monthly. So if you publish an article today, it may appear in news but there is no way it is going to appear in the main index. Freshbot is rarely ever a very large indexing so it will probably always take a month or more for your articles to show up in the main database.

Another thing is that in the main database longevity seems to matter. In other words a page that has been around longer seems to get some preference. I'm no expert in this but some of my pages that have been around longer seem to do better in the serps than other pages with similar inbound links.

[bebox]

Thanks mate..
Yep I am aware of the main indexing engine and we keep a pretty good track of when and where Google is going on the site but it just seems weird that the Freshbot isn't capturing all pages either but you may have a point about how long the links remain in place as we put up many articles and so maybe they are not stickign around long enough for Google's liking :))

The other strange thing is our Adwords ad isnt coming up for "New Zealand Open" either...two ads come up but not ours...so all in all it is a bit of a shambles :))....but that is another forum topic me thinks!

Thanks for the thoughts......
B