Spidering of my code pages

Wrong pages being spidered and losing referals

[djfelip]

I recently took over the web operations for a rather large travel site, through my marketing tools I have noticed that a good majority of my referrals from yahoo and google are coming in on my code processing pages so the visitors are just closing the browser and moving on. I think I made the necessary edits to my robots.txt BUT is there a way that I cna test this to make sure? I would hate to have to wait for the engines to respider and find out i didnt do this correctly it is costing us alot of valuable traffic.

[Reid]

referrals from yahoo and google are coming in on my code processing pages so the visitors are just closing the browser and moving on.

Can you translate this a little. You mean intro pages, browser query type pages? What are they cgi php?
What code are they processing? What did you put in robots.txt? what are you trying to disallow?

[djfelip]

The site is an ASP site that lists vacation homes, some of my processing pages to run a property search for instance are being indexed so when someone comes in on that page they get a page cannot be displayed.

[Span]

You can use any user agent string to test your robots.txt at wannaBrowser [wannabrowser.com]

[Reid]

just disallow those pages in robots.txt This will prevent bots from listing them.
In order to remove them from google you need to validate your robots.txt and then submit it to google removal tool. any pages in the google index which are disallowed will be removed.