Spider Simulators that Pick up HTTPS

Looking for a spider sim online to do this

[xbase234]

I have a client that needs to see what a bot sees when crawling a page on a secure server (server status, text on page, etc).

I've tried running the site through SEW's Spider Sim, but the script will only run HTTP, and not HTTPs.

Any suggestions are appreciated-

{{{headline should be, "Spider Simulators that *Pick* up HTTPS"}}}

[edited by: xbase234 at 8:54 pm (utc) on Jan. 20, 2004]

[Dreamquick]

What about using a text-only browser like lynx? (assuming you aren't being too clever with CSS)

- Tony

[xbase234]

tried running the page through a "lynx-based" browser simulator to no avail.

The Lynx setup config looks very time-consuming, so I'm looking for alternatives.

thanks

[Dreamquick]

From what I remember setting up Lynx under windows was trivial and amounted to unzipping into a directory, however getting used to navigating using it might take some time but not that long...

The only way I can think of doing a fully interactive demo would be with mozilla and an alternate browser-based stylesheet that rendered the page as straight HTML with no styles. Rendering basic HTML would emphasize text content, core elements as well as placement on page before any CSS had been applied.

You'd switch between the normal stylesheet ("this is what the user sees") and the alternate stylesheet ("this is what the search engine sees") which might give a really nice effect, but it does of course assume the site you're trying to sell would look okay in Mozilla.

- Tony