Cannot get to search engines. Funny or stupid

None of the search engines goes further default.asp page

[Andrewb]

Hi Everyone,

I'm quite new here,
can anyone tell me why I got log entries like this for the majority of search engines that tried to index my site:

2001-11-07 09:16:48 216.35.116.92 - W3SVC141 W1 198.139.161.139 80 GET /robots.txt - 200 0 299 183 94 HTTP/1.0 www.domain.com Mozilla/3.0+(Slurp/si;[e-mail];+http://www.inktomi.com/slurp.html) - -
2001-11-07 09:16:48 216.35.116.92 - W3SVC141 W1 198.139.161.139 80 GET /Default.asp - 200 0 0 173 47 HTTP/1.0 www.domain.com Mozilla/3.0+(Slurp/si;[e-mail];+http://www.inktomi.com/slurp.html) - -
They stop at default.asp page. And even this page is not listed in any of the search engines.
A couple of days ago Google was able to visit the default.asp page and other linked pages. I am waiting for them to appear at google.com
What can I do with the rest of the search engines?

Thanks, Andrew

[SmallTime]

Welcome to the forums.
Inktomi stops by a couple of my sites too, I think to remind me that If I wanted to pay them, they know where I am. (they spider, but only use paid submissions, as far as I know). I would start by doing some reading here - there is a lot of great info -then look at submitting to a couple directories, etc. With the exception of google, ODP,and Fast, may want to part with some $$$ for submission.

[Andrewb]

thanks Smalltime,

I am trying to find the answer on this site.
I don't think the problem is only in Inktomi paid submitions.

The same problem is with lycos:
2001-11-05 09:18:20 206.79.171.19 - W3SVC141 W1 198.139.161.139 80 GET /robots.txt - 200 0 316 142 78 HTTP/1.0 www.domain.com Lycos_Spider_(T-Rex) - -
2001-11-05 09:18:20 206.79.171.19 - W3SVC141 W1 198.139.161.139 80 GET /default.asp - 200 0 0 143 16 HTTP/1.0 www.domain.com Lycos_Spider_(T-Rex) - -
It only accesses default.asp page.

There's something else.

Regards, Andrew

[SmallTime]

You might check your robots.txt - if you use site search above there is a tutorial and a validator. Just an off chance. Lycos is pulling from Fast - you could submit to them. Are there sites linking to you?. Also, if it is the site in the string, I would stick to no more than 4-5 keywords, have them in text on the page, and the main one in page title.

[Andrewb]

robots.txt is fine. I tried not using it, now I restrict search engines to index picture folders.
None of the sites link to me yet. It's a very small site. I don't think linking is necessary to get to the search engine. What do you think? It's propably more close to positioning/ranking.

And the other thing:
what is "if it is the site in the string" from your message?

[retro]

AndrewB

you will need inbound link(s) from (hopefully relevant) sites already listed in google, in order to get your site in there somewhere.

R

[JuniorHarris]

Andrewb, after a quick look at your site (in profile) it appears the navigation is using JavaScript redirects...this could explain why spiders may not be following the links. You might consider simply adding some text links at the bottom of the page which spiders would be more apt to follow.

[Andrewb]

I will work on it
thanks Everyone!