Forum Moderators: open

Message Too Old, No Replies

New line added to google's robots.txt file

anyone know the meaning?

         

Slud

1:29 am on Mar 2, 2003 (gmt 0)

10+ Year Member



Google now blocks "/hws" in its robots.txt file.

Anyone know what that is?

hakre

11:43 am on Mar 2, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



hi slud,

whats google's robots.txt file?

ruserious

12:25 pm on Mar 2, 2003 (gmt 0)

10+ Year Member



:D Admitted, it's not easy to find. ;)

google.com/robots.txt

I can't see how one could read meaning into any of what is in there...

xlcus

1:25 pm on Mar 2, 2003 (gmt 0)

10+ Year Member



Google now blocks "/hws" in its robots.txt file.
Anyone know what that is?

Probably a test directory for their new Hierarchical Weighting System

hakre

1:27 pm on Mar 2, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



there is no 'test' ;), i only get a 404. maybe this is a trap?

globay

1:30 pm on Mar 2, 2003 (gmt 0)

10+ Year Member



by the way, what does /microsoft? mean? I get very different search results, when using it.

mack

1:47 pm on Mar 2, 2003 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



The microsoft version is google search but only searching the microsoft sites.

Probably a good way of letting microsoft know they have better search technology when a large number of users find their pages from google search.