Welcome to WebmasterWorld Guest from 54.167.155.147

Forum Moderators: coopster & jatar k

Message Too Old, No Replies

Curl in Crontab - Getting "You are not authorized to view this page."

Can't find a solution anywhere

   
1:55 am on Dec 6, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hey everyone,

I have a php script using curl to login to a website and grab data from the page.

It works fine when run in a web browser however as soon as I set it up to run as a cron job, it doesn't work.

When running it via command line in my linux server, I get an error "You are not authorized to view this page."

I get this using curl and lynx

Has anyone experienced this before? I tried searching and can't find anything. I have tried running the script via root as well.

I'm assuming it has to be an issue with the php script using curl.

Can anyone help?

Thanks in advance for your help!

Wes

6:56 am on Dec 6, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



What User-Agent are you setting when calling the script from cron job ? they might be blocking based upon that.
5:07 pm on Dec 6, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I tried with both curl and lynx.

For example typing in:

curl [mysite.com...]

Returns "You are not authorized to view this page."

Let me know if I'm missing anything or if I should be specifying another user-agent (I'm assuming that curl and lynx are user agents right?)

The browsers it works fine with are FireFox and IE.

Thanks again for your help!

Wes

5:30 pm on Dec 6, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Me again,

I did some researching and found that you can specify a useragent in curl. After doing this, it works fine :)

6:49 pm on Dec 6, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Cool, Congrats ;)