are there any search engines that indexes websites page source, including javascripts etc.? I want to perform a search for a websites that are using some concrete javascript code, is it possible? And if yes, then how?
Thanks in advance!
jatar_k
11:49 am on Jan 17, 2007 (gmt 0)
this thread may give some insight
if you are looking for specific code then find something unique about the code and search on that.
may work, may not. I have had some luck in the past but not tons
strokaz
12:12 pm on Jan 17, 2007 (gmt 0)
yes I was thinking the same, but this code has nothing specific + all the code is written in HTML comments, what theorically makes even harder to find it in search engines. Currently I find only one solution - make a list of some websites that might have this code, and write a PHP script that would look for some words in the source of those pages.. Any other ideas are welcome!
jatar_k
12:17 pm on Jan 17, 2007 (gmt 0)
your own low level spider, as you are describing, is probably your best bet.
phranque
12:22 pm on Jan 17, 2007 (gmt 0)
don't forget that the javascript capability of the user agent (e.g. lwp-request) may affect the page served such that it contains no js. you may have to spoof some request headers...
strokaz
1:28 pm on Jan 17, 2007 (gmt 0)
I will try to use PHP implemented functions to grab the file source and search for the specified text in it. Currently I don't know how will I do that, but I think that everything is possible :)