Hello, I'd like to know if the text on a page that contains the following is spidered: <?php include("./path/file.txt");?>
the file.txt would have text.
HostLead
Ryan8720
6:03 pm on Sep 20, 2003 (gmt 0)
If you have disallowed .txt files in your robots.txt, it won't be spidered.
Otherwise, it should because the txt file will be parsed into the html document.
jatar_k
6:11 pm on Sep 20, 2003 (gmt 0)
As Ryan8720 says, it will be spidered but only as part of the html document it is included in.
PHP is executed server side so the spider only sees the end product, exactly as a browser does. The spider has no idea that the actual content is from file.txt.
hostlead
9:51 pm on Sep 20, 2003 (gmt 0)
thx! I was thinking that. Just needed a confirmation.