Forum Moderators: open
64.68.82.25 - - [10/Jan/2004:09:00:50 +0100] "GET /robots.txt HTTP/1.0" 200 127 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"
64.68.82.25 - - [10/Jan/2004:09:00:52 +0100] "GET / HTTP/1.0" 200 22893 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)
My site is dynamic so I've made url rewrites to make my articles look like html-pages. Also submitted these "html-pages" to Google several times. Still Google won't come see them.
My robot-file is no big deal :
User-agent: *
Disallow: /administrator/
Disallow: /classes/
Disallow: /downloads/
Disallow: /editor/
Disallow: email.php
Is there anything more I can do?
[edited by: vitaplease at 9:10 pm (utc) on Jan. 10, 2004]
[edit reason] no url droppings please [/edit]