SearchGPT - I'm loving it - My New Default Search

[Brett_Tabke]

So far, SearchGPT has not disappointed. So much better than Google or Bing offerings.


You tried it?

[engine]

I haven't yet managed to get access. :(

[lucy24]

Do they have a named crawler, or use someone else’s?

[engine]

OpenAI Crawlers and Bots [webmasterworld.com...]

[lucy24]

Oh, that’s the one that mysteriously asks for robots.txt about ten times for every page request. (Literally. I counted.) I’ve pored over the various files--robots.txt, htaccess and so on--and can find no reason why this would be so.

:: shrug ::

[System]

The following message was cut out to new thread by brett_tabke. New thread at: gpt/5111329.htm [webmasterworld.com]
6:49 am on Sep 5, 2024 (cst -5)