Spider and registred access to web

[andreabg]

Hello,

I've got a website written in php (phpnuke 6.9) with articles dealing with scuba diving.
I'm using googletap to have all pages like html instead of php.
I've also the robots.txt file that allows robots to search in the news, archives, and images modules and directories.

As we decided that, in order to read all articles (free reading!), you must register to our website, I'm wondering if it could have any repercussion on spiders action?
If yes how can I modify robots.txt instructions?

Thanks
Andrea

[Dijkgraaf]

I take it this is via a login and a session cookie?
If so spiders will not be able to index your pages.
You also won't be able to fix this in your robots.txt.
Where you will need to fix it is the the code that checks to see if a person is logged in, and put some extra logic in there that checks the User Agent string is a search bot you want to allow in without loging in. This as User Agent strings are easy to set or fake you may also want to double check this against an allowable IP address range for that bot.

[andreabg]

Thanks Dijkgraaf

yes phpnuke 6.9 uses sessions and cookies for registered users.

Have you some example of what I've got to do in order to solve the problem using your suggestion?

Andrea

[Dijkgraaf]

I suggest you ask that question in the PHP Server Side Scripting forum [webmasterworld.com] they should be able to answer it there. Possibly there might allready be modules written for it that do exactly what you are after.
The sort of functions/objects you are looking for are
getenv("REMOTE_ADDR") to get the IP and $_SERVER['HTTP_USER_AGENT'] for the user agent.

[andreabg]

Thanks Dijkgraaf,

I'll post it in the forum you've suggested me

Andrea