homepage Welcome to WebmasterWorld Guest from 54.204.94.228
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Marketing and Biz Dev / Deprecated - Search Engine Submission
Forum Library, Charter, Moderator: open

Deprecated - Search Engine Submission Forum

    
Cannot get into search engine listings
Trying for almost 6 months
Andrewb

10+ Year Member



 
Msg#: 278 posted 10:19 am on Nov 7, 2001 (gmt 0)

Hi Everyone,

I'm quite new here,
can anyone tell me why I got log entries like this for the majority of search engines that tried to index my site:

2001-11-07 09:16:48 216.35.116.92 - W3SVC141 W1 198.139.161.139 80 GET /robots.txt - 200 0 299 183 94 HTTP/1.0 www.rooflift.com Mozilla/3.0+(Slurp/si;+slurp@inktomi.com;+http://www.inktomi.com/slurp.html) - -
2001-11-07 09:16:48 216.35.116.92 - W3SVC141 W1 198.139.161.139 80 GET /Default.asp - 200 0 0 173 47 HTTP/1.0 www.rooflift.com Mozilla/3.0+(Slurp/si;+slurp@inktomi.com;+http://www.inktomi.com/slurp.html) - -
They stop at default.asp page. And even this page is not listed in any of the search engines.
A couple of days ago Google was able to visit the default.asp page and other linked pages. I am waiting for them to appear at google.com
What can I do with the rest of the search engines?

Thanks, Andrew

 

bufferzone

10+ Year Member



 
Msg#: 278 posted 11:52 am on Nov 7, 2001 (gmt 0)

Hi Andrewb and wolcome in the forum

One thin you could do is to make sure that you have a robots.txt for the robots to read.

Work on the title tag, you have no keywords in your title.

Run your pages in the simspider at [searchengineworld.com...] or the HTML validator.

Read up on some of the post in this forum

maccas

10+ Year Member



 
Msg#: 278 posted 11:59 am on Nov 7, 2001 (gmt 0)

Hi, is it your site in your profile? If so I don't believe the robots will follow your javascript navigation. Try adding a site map or a footer on each page without javascript navigation.

Andrewb

10+ Year Member



 
Msg#: 278 posted 12:15 pm on Nov 7, 2001 (gmt 0)

This is my robots.txt file
User-agent: *
Disallow: /html/
Disallow: /images/
Disallow: /photos/
it allows access to webroot folder.
These tree folders contain info that is not needed in the search engines.

I will add some keywords to the title, but is this a criteria to get to the search engine?

I am doing searches like
host:www.rooflift.com
host:rooflift.com
url:www.rooflift.com
url:rooflift.com
or just "rooflift", "rooflift.com"

All I want is to get listed even by my domain name :)

I used tools at searchengineworld to find that my meta keywords tag was bad and the page had some html errors,
can this make a problem for spiders?

Talking about links: I have no javascript navigation on the site.
It goes like this:
<a href="CaseHistories.asp" onMouseOut="MM_swapImgRestore()" onMouseOver="MM_swapImage('i51','','images/_CaseHistories.gif',1)">

javascript is only used to make onmouseover picture

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Marketing and Biz Dev / Deprecated - Search Engine Submission
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved