Forum Moderators: coopster

Message Too Old, No Replies

Will Yahoo and Google Bots See The PHP Redirection?

Will they recognize the redirected url?

         

Noximus

7:27 am on Jul 20, 2005 (gmt 0)

10+ Year Member



Hi All,
I've some questions about Yahoo bot, Google bot and PHP redirection. Please help me, it is very important for me.

1.Will Yahoo and Google bots see the PHP redirection?
2.Will the bot follow it?
3.Will it enter the redirected site?
4.Will it recognize the redirected url?

omoutop

7:57 am on Jul 20, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Hi...

u gotta take care of ur redirection by reading the appache .htaccess files as well as mode rewrite...
Plus, u gotta create a robots.txt file in order to prevent bots from reaching the original pages (sources) in order to avoid duplicate pages...
That way, the redirected pages will be promoted as well as ranked...

Noximus

8:47 am on Jul 20, 2005 (gmt 0)

10+ Year Member



omoutop,
I know about .htacces, robot.txt and "nofollow" tag. But my purpose is to keep the bots out of redirected sites.
I tried hiding links with nofollow, I tried even converting the links into java and restricting access to them with robot.txt, but it did not help.

Will php redirection help?
I would like the bot even not to recognize or follow the links.

omoutop

9:13 am on Jul 20, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



the only way I know is by restricting these redirected sites by using robots.txt...
R U SURE it is not working that way?
If u r then there must be a way via the .htaccess file...somehow

Noximus

9:27 am on Jul 20, 2005 (gmt 0)

10+ Year Member



Yes, I'm sure. You can see below what is written in my robots.txt file:

User-agent: *
Disallow: /somth.js
Disallow: /somth.html

in somth.js is coded table with links and it is coded with java.

Do you see any mistake here?

omoutop

9:46 am on Jul 20, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



nope...I think it is fine...
make sureu did not do any mistakes such as either one othe file is in another directory...or maybe /somth.html is .htm etc....

R U SURE the spiders can see both pages?or only the redirected one?

Noximus

10:03 am on Jul 20, 2005 (gmt 0)

10+ Year Member



html file is out of yahoo index. So robots.txt works for it, but java file is accessed by the yahoo bot. It is in cache with the whole site. So if it is in the cache it is read by the bot.
if it read by the bot it is not hidden from it, is not it?

omoutop

10:14 am on Jul 20, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



It is not hidden, but can the robot understand a java file?I have no idea if it can read the content of a .js file...why dont u place all the .js file in a seperate folder and restrict the whole new folder via robots.txt...if it works u gotta change ur .htaccess but it is worth it!

Noximus

11:55 am on Jul 20, 2005 (gmt 0)

10+ Year Member



good idea, I'll try placing all .js files in one separate folder and will restrict access to it.

Thank you.