Forum Moderators: goodroi

Message Too Old, No Replies

Need help with robot.txt for .php forums

robot.txt, .php, forums,

         

Freakindj

7:33 pm on Feb 28, 2005 (gmt 0)

10+ Year Member



Hello all and thank you for letting me join the forums

I have never written a robot.txt file befor so I need to know where to find a complete guide to the syntax nessesary.

The problem I am having is Google keeps repetively probeing viewtopic.php topic=0 over and over and over again. In .php the addy results in a no topic found error message. I beleive it is a needless waste of bandwidth.

Also I beleive this might be hurting my SE ranking and PR as far as Google and other search engines are concerned.

Also Google has been indexing all the photographs on the site. Not that they are any thing I need to hide, just that I don't want to waste the bandwidth.

Can some one direct me in the right direction to help me with this

Thanks

Freakindj

2:44 pm on Mar 5, 2005 (gmt 0)

10+ Year Member



This is what I came up with so far on my own but it doesn't seem to be working correctly.

#
# Hinigugma Robots Text
# [hinigugma.com...]

User-agent:*
Disallow: /images/

User-Agent: *
Disallow:/index/viewtopic.php?topic_id=0

User-agent:*
Disallow: /cgi-bin/

msnbot and googlebot are still requestiong viewtopic.php?topic_id=0 over and over again. I am affriad if I place

User-agent: *
Disallow: /index/viewtopic.php

they will stop indexing my forums altogether

any help would be appreciated