Forum Moderators: mack

Message Too Old, No Replies

Search engines that are indexing page source

any search engines doing this?

         

strokaz

10:10 am on Jan 17, 2007 (gmt 0)

10+ Year Member



Hello,

are there any search engines that indexes websites page source, including javascripts etc.? I want to perform a search for a websites that are using some concrete javascript code, is it possible? And if yes, then how?

Thanks in advance!

jatar_k

11:49 am on Jan 17, 2007 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



this thread may give some insight

if you are looking for specific code then find something unique about the code and search on that.

may work, may not. I have had some luck in the past but not tons

strokaz

12:12 pm on Jan 17, 2007 (gmt 0)

10+ Year Member



yes I was thinking the same, but this code has nothing specific + all the code is written in HTML comments, what theorically makes even harder to find it in search engines. Currently I find only one solution - make a list of some websites that might have this code, and write a PHP script that would look for some words in the source of those pages.. Any other ideas are welcome!

jatar_k

12:17 pm on Jan 17, 2007 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



your own low level spider, as you are describing, is probably your best bet.

phranque

12:22 pm on Jan 17, 2007 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



don't forget that the javascript capability of the user agent (e.g. lwp-request) may affect the page served such that it contains no js.
you may have to spoof some request headers...

strokaz

1:28 pm on Jan 17, 2007 (gmt 0)

10+ Year Member



I will try to use PHP implemented functions to grab the file source and search for the specified text in it. Currently I don't know how will I do that, but I think that everything is possible :)