How to search a single file

[manomahendran]

Hi,
I am trying to index just a single file from a url.
[mycompany.com...]
how can do this?
Thanks in Advance.
m

[ukgimp]

Hello

Can you expand on this a little. Do you mean that you want to get your page into the google index or create some sort of index or something else?

Cheers

[manomahendran]

Here is what we are looking to do :)

Let google crawl this one url (index.htm) only from our domain
[mydomain.com...]

I tried adding this to the start crawling from but Google does not take the URL gets me "it does not match any of the 'follow and crawl' patterns "
thanks,
M

[jomaxx]

Read the Google FAQ section about robots.txt. I think you can do something like this:

disallow /
allow /index.html

That's probably not the exact syntax you need, though, and doing this may not work for all spiders.

Alternatively you can list every directory and every root directory page NOT to be spidered individually. Or just use the NOARCHIVE meta tag in pages not to be indexed. In this case they will get crawled, though.