A part of the site isnt spidered

Forum Moderators: open

Message Too Old, No Replies

A part of the site isnt spidered

Any know knows why

snuif

9:10 am on Jan 20, 2004 (gmt 0)

A part of my site isnt spidered can some one tell me wht the reason might be
the url is [example.com...] (oppss my mistake changed it)and the scripting is

<head>

<title>Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod </title>

</head>

does anyone have a clue for this, the rest does get spidered well but this part isnt.If i have to add more info let me know wht to add im sort of new to this.:)

thks for your help in advanced :)

[edited by: Marcia at 9:56 am (utc) on Jan. 20, 2004]

tantalus

3:33 pm on Jan 20, 2004 (gmt 0)

If I remember correctly the 'naming' of the ID parameter may be a problem for google.

There are others here who can give a much more informed answer

You can also check your robots txt in case there are any in advertent mistakes. I assume you don't have noindex, nofollow meta tag included anywhere on your site.

snuif

4:34 pm on Jan 20, 2004 (gmt 0)

well i do, but nofollow etc commands, the opposite instead, on the main page but not in the directory itself

its wierd cause some parts are spidered and it does pagerank the directory but it aint displayed on google search engine, hmm need to wait for some more info then on the ID placement.

thks for your asnwer

snuif

9:10 pm on Jan 20, 2004 (gmt 0)

maybe this will give some more info
/en/news/sports HTTP/1.0" 301 310 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"
Date="19.01.2004" User-Agent="Googlebot" Path="/en/news/sports" Status code="301 Moved Permanently"

hope anyone can help me

tantalus

10:55 am on Jan 21, 2004 (gmt 0)

I'm surprised no-one has answered this.

It looks like you have inadvertently set up a a 301 permanent redirect for the page in question.

I'd suggest you do a site search for the term as there some prety authoritive threads on the subject and take it from there.

The 301 status code is telling gbot that page has been moved permanently, whether this can be rectified or not, I don't know.

Maybe someone else could help!?!

GG's usually good at this and I'm sure there are plenty of others who could too.

snuif

10:58 am on Jan 21, 2004 (gmt 0)

lol finally, i thought no one was going to answer me, but im patient enough, :) thks for the reply , i ll search the site for some more info, and i have send a email to google as well.

cheers

dirkz

12:01 pm on Jan 21, 2004 (gmt 0)

Use a server header checker to find out where you redirect to.