Welcome to WebmasterWorld Guest from 50.17.117.221

Forum Moderators: coopster & jatar k

Message Too Old, No Replies

Curl in Crontab - Getting "You are not authorized to view this page."

Can't find a solution anywhere

     
1:55 am on Dec 6, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Oct 25, 2003
posts: 664
votes: 0


Hey everyone,

I have a php script using curl to login to a website and grab data from the page.

It works fine when run in a web browser however as soon as I set it up to run as a cron job, it doesn't work.

When running it via command line in my linux server, I get an error "You are not authorized to view this page."

I get this using curl and lynx

Has anyone experienced this before? I tried searching and can't find anything. I have tried running the script via root as well.

I'm assuming it has to be an issue with the php script using curl.

Can anyone help?

Thanks in advance for your help!

Wes

6:56 am on Dec 6, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Apr 24, 2005
posts:697
votes: 0


What User-Agent are you setting when calling the script from cron job ? they might be blocking based upon that.
5:07 pm on Dec 6, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Oct 25, 2003
posts: 664
votes: 0


I tried with both curl and lynx.

For example typing in:

curl [mysite.com...]

Returns "You are not authorized to view this page."

Let me know if I'm missing anything or if I should be specifying another user-agent (I'm assuming that curl and lynx are user agents right?)

The browsers it works fine with are FireFox and IE.

Thanks again for your help!

Wes

5:30 pm on Dec 6, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Oct 25, 2003
posts:664
votes: 0


Me again,

I did some researching and found that you can specify a useragent in curl. After doing this, it works fine :)

6:49 pm on Dec 6, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Apr 24, 2005
posts:697
votes: 0


Cool, Congrats ;)