Welcome to WebmasterWorld Guest from 188.8.131.52
Forum Moderators: open
I'm quite new here,
can anyone tell me why I got log entries like this for the majority of search engines that tried to index my site:
2001-11-07 09:16:48 184.108.40.206 - W3SVC141 W1 220.127.116.11 80 GET /robots.txt - 200 0 299 183 94 HTTP/1.0 www.rooflift.com Mozilla/3.0+(Slurp/si;+email@example.com;+http://www.inktomi.com/slurp.html) - -
2001-11-07 09:16:48 18.104.22.168 - W3SVC141 W1 22.214.171.124 80 GET /Default.asp - 200 0 0 173 47 HTTP/1.0 www.rooflift.com Mozilla/3.0+(Slurp/si;+firstname.lastname@example.org;+http://www.inktomi.com/slurp.html) - -
They stop at default.asp page. And even this page is not listed in any of the search engines.
A couple of days ago Google was able to visit the default.asp page and other linked pages. I am waiting for them to appear at google.com
What can I do with the rest of the search engines?
One thin you could do is to make sure that you have a robots.txt for the robots to read.
Work on the title tag, you have no keywords in your title.
Run your pages in the simspider at [searchengineworld.com...] or the HTML validator.
Read up on some of the post in this forum
I will add some keywords to the title, but is this a criteria to get to the search engine?
I am doing searches like
or just "rooflift", "rooflift.com"
All I want is to get listed even by my domain name :)
I used tools at searchengineworld to find that my meta keywords tag was bad and the page had some html errors,
can this make a problem for spiders?
It goes like this:
<a href="CaseHistories.asp" onMouseOut="MM_swapImgRestore()" onMouseOver="MM_swapImage('i51','','images/_CaseHistories.gif',1)">