Forum Moderators: open

Message Too Old, No Replies

has anyone ever seen just urls appearing in google?

lots of spidered urls but no cached version?

         

jason4656

6:29 pm on Apr 21, 2003 (gmt 0)

10+ Year Member



Has anyone ever seen google spider lots of pages from a cloaked site and only the urls show up? there is no option to click on cached version and no snippet at all under the title which is simply the url there is no actual title showing. This has been going on with a site for almost 3 months now, googlebot still comes back and spiders more pages but the results in the serps are never updated, anyone any ideas why?

thanks in advance

jdMorgan

7:53 pm on Apr 21, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



jason4656,

Here's one reason [webmasterworld.com] you'll see that.

If Google finds a link to a page which is disallowed in robots.txt, they will show the URL - and only the URL - in the search results. Even a disallowed page can rank quite well if the link text of the links pointing to it is a good match for the search terms.

HTH,
Jim

jason4656

8:06 pm on Apr 21, 2003 (gmt 0)

10+ Year Member



thanks Jim, this is the tag in all pages i beleive it is correct

<META NAME="robots" CONTENT="index,follow">

Thanks for that idea but there is no robots.txt in this site, do you have any other ideas?

thanks
Jason

jdMorgan

8:15 pm on Apr 21, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



jason4656,

The other possibility is that Google has found the links, but has not yet spidered the actual pages.

You might also want to surf the site using Googlebot as your user-agent, and make sure your cloaking script isn't broken.

Jim

jason4656

8:29 pm on Apr 21, 2003 (gmt 0)

10+ Year Member



thanks again for ur replies, i use ip based and can surf the site as a spider and everything looks in order, all pages have been spidered more than once over the last 3 months but to no avail, i have never seen more than a url by searching site:www.mydomain.com keyword. First spider was around the end of january

thanks
Jason