Welcome to WebmasterWorld Guest from 50.19.53.104

Forum Moderators: coopster & jatar k

Message Too Old, No Replies

Curl in Crontab - Getting "You are not authorized to view this page."

Can't find a solution anywhere

     

wfernley

1:55 am on Dec 6, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hey everyone,

I have a php script using curl to login to a website and grab data from the page.

It works fine when run in a web browser however as soon as I set it up to run as a cron job, it doesn't work.

When running it via command line in my linux server, I get an error "You are not authorized to view this page."

I get this using curl and lynx

Has anyone experienced this before? I tried searching and can't find anything. I have tried running the script via root as well.

I'm assuming it has to be an issue with the php script using curl.

Can anyone help?

Thanks in advance for your help!

Wes

Anyango

6:56 am on Dec 6, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



What User-Agent are you setting when calling the script from cron job ? they might be blocking based upon that.

wfernley

5:07 pm on Dec 6, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I tried with both curl and lynx.

For example typing in:

curl [mysite.com...]

Returns "You are not authorized to view this page."

Let me know if I'm missing anything or if I should be specifying another user-agent (I'm assuming that curl and lynx are user agents right?)

The browsers it works fine with are FireFox and IE.

Thanks again for your help!

Wes

wfernley

5:30 pm on Dec 6, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Me again,

I did some researching and found that you can specify a useragent in curl. After doing this, it works fine :)

Anyango

6:49 pm on Dec 6, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Cool, Congrats ;)
 

Featured Threads

Hot Threads This Week

Hot Threads This Month