homepage Welcome to WebmasterWorld Guest from 54.198.185.156
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

This 34 message thread spans 2 pages: < < 34 ( 1 [2]     
Google Link points and Robots.txt
Google points algo and side discussion of robots.txt format
tmw




msg:1528224
 12:57 pm on Mar 3, 2001 (gmt 0)

does google have any points fixed for particular type of linking ie wheather use any points for links which affects the ranking.
thank you

 

Robert Charlton




msg:1528254
 5:46 pm on Mar 23, 2001 (gmt 0)

>>I think you are saying where you are linked from does effect ranking though<<

Not my links, but competitive rankings I've been tracking as I'm analyzing how to rank in the "widget stores" area, which is highly competitive.

I've noticed that several of the top 10 have one thing in common... they're listed in the Regional> Widget Dealers> Location> Directories category... whereas sites with more or less equal optimization (so it seems... it's very difficult to analyze someone else's site quickly) that are listed in other categories aren't doing as well.

It could also be the content of link text (something I haven't fully checked yet) as well as other links. I was fascinated that one of the very high ranking sites only had passable optimization and 4 links (as opposed to 1,200 for the site above it). One of the links was from the Yahoo 'Directories' category... and the other was from a Stanford University site, apparently a student page, that had the exact plural form phrase linking to this site.

Again, I probably haven't made enough observations to generalize about the category listing... Brett's comment prompts me to check out some of the other factors more closely.

bulldog




msg:1528255
 6:49 pm on Mar 26, 2001 (gmt 0)

Yahoo now equals 0 points for linkpop

See:
[webmasterworld.com ]
and
[dir.yahoo.com ]

BullDog

Xoc




msg:1528256
 2:33 pm on Mar 27, 2001 (gmt 0)

The problem is that there is no definitive spec for robots.txt. As far as I know, there is no W3C or RFC spec for it. So it means whatever a search engine wants it to mean. Do search engines use wildcards? Google does. Does an earlier rule override a later one? Looksmart seems to think so. But does Google? Who knows what Google really does with Looksmart's robots.txt.

The problem is not just for spiders. How do you come up with a correct robots.txt, when the spec is ambiguous?

Edited by: Xoc

Brett_Tabke




msg:1528257
 2:53 pm on Mar 27, 2001 (gmt 0)

Best I can figure, there are 8200 Looksmart [google.com] urls in google.

This 34 message thread spans 2 pages: < < 34 ( 1 [2]
Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved