Forum Moderators: open

Message Too Old, No Replies

spider question

         

PaRaDiGM

10:42 pm on May 16, 2003 (gmt 0)

10+ Year Member



any one know why it takes 2-3 months for spiders to come by my website, despite the fact that my revist-after tag is set for 3 days?

and, for some reason, the spider is reading alt text tags (in image links) on my site and using that as my website description instead of my description meta tag... wtf!

anyone know what up with this?

jeremy goodrich

10:56 pm on May 16, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



As far as I know, none of the major search engines pay attention to robots meta tags to determine when to respider a page.

The bit about the description coming from your alt tags is interesting though. I have yet to see that happen with one of my sites...

Perhaps you could try shortening the verbage in the alt tags for your images to a word or two? That way, the engine will be forced to use some content from another part of the page as well.

jdMorgan

10:57 pm on May 16, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



PaRaDiGM,

The <meta name="revisit-after" tag was the invention of a lone search engine operator in Canada, many years ago, IIRC. It has never had any effect on any major search engine. They spider when they want to.

Which search engines are showing your ALT text - All of them, or just Google?

Jim

PaRaDiGM

11:02 pm on May 16, 2003 (gmt 0)

10+ Year Member



hmm, well, both google and yahoo show the alt text as my description...i dunno why... i'm postive my meta tags are correct. i guess there's nothing i can do about the spider re-visiting. that sucks, cuz i update my page a lot...

jeremy goodrich

11:12 pm on May 16, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Google should spider your pages (at least) once a month.

Their descriptions in the SERP are not always the meta description tag, but sometimes.

I've heard from others that a h1 or similar with your target keyword can make it so that Google shows that tag's content as your description...

Also, a listing in the Open Directory -> will show just below the 'ransom note style description' that Google uses, so that there is at least one line that is well written describing your site in the SERP.

Though that will only show on Google.com / and not Yahoo. For Yahoo, if the site is listed in their directoy, they will use the title / description from teh Yahoo Directory for your index page in their SERPs.

So there is a way around your problem -> just takes a bit of work & money can speed the process (with Yahoo, anyway).

The subpages, though...I'm afraid you may be stuck like the rest of us.

PaRaDiGM

11:14 pm on May 16, 2003 (gmt 0)

10+ Year Member



hmm, i definetly do not get spider'd once a month it's atleast 3 months, i don't know what the deal is...

jdMorgan

11:15 pm on May 16, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



PaRaDiGM,

Yahoo is using Google's search index. Google does not use the <meta name="description" tag, because of its potential for abuse. Instead, they use a "snippet" of text from the body of your page. If you want better results in Google, you'll need to have search-keyword-relevant text in your page heading ( <h1> or <h2> ) and in - at the minimum - the first and last paragraph on your page.

As to getting spidered more often, there is a correlation between your page rank plus how often you significantly update your page, and how often Google's freshbot will visit. So get some more on-topic incoming links from high-PR sites if you want more attention from freshbot. This will also help to get your subpages well-indexed.

If your site is less than three months old, some of this may not apply - It takes awhile to get settled in Google's index.

HTH,
Jim
<added>jeremy types a lot faster</added>

jeremy goodrich

11:17 pm on May 16, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Ah, but you added some great details, Jim. :)

Follow all that - and keep coming here for questions - and trust us, you will get spidered so much you won't know what hit your server. lol.

PaRaDiGM

11:20 pm on May 16, 2003 (gmt 0)

10+ Year Member



i actually solved the alt text problem by moving those links anyways, so they are not a problem anymore... it just seems like spiders aren't reading my tags, and they take freakin' forever! hehe

PaRaDiGM

11:35 pm on May 16, 2003 (gmt 0)

10+ Year Member



hmm, but the way i've designed my site, a h1 or h2 tag would look like sheit...

jeremy goodrich

11:46 pm on May 16, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Try using an external style sheet to disguise it :) that's what Google does on their own site.

PaRaDiGM

12:45 am on May 17, 2003 (gmt 0)

10+ Year Member



what's an external style sheet? sorry i don't **** about css.. could you give me an example?