Forum Moderators: bakedjake
looks like a combined directory / search engine. the home page shows directory type categories. digging down, it has a directory type structure. but, go back to the home page and search for "store" and you see there are multiple URLs for some domains - either they've been spidering or some people have added multiple URLs. has anyone ever noticed a spider from this company?
the search is poor, but it's interesting in that directory listings are given a rating, and can be sorted according to name, last updated, and by rating, and that search results can be sorted by relevance or by date of indexing.
there are about 110,000 entries in the directory, with each site (apparently) being listed just once. many other pages on each site are included in the search index but not listed in the directory. CGI pages are included on some domains, but not noticed any PHP or ASP or other server side pages.
unfortunately, it looks like infoprom could be defunct:
- the last dates on any listings i can see are from 21st May this year
- there is only one banner ever shown
- Add URL doesn't work
- the copyright notice is dated 2001
cminblues
allows to index more than 10 documents per minute
I'm not a programmmer, but I've built several different spiders in Perl that can fetch, process, and add to a searchable database more documents than that, per minute.
Hardly revolutionary. FDSE? Perhaps, or it could be something else. Do they have a 'custom' user agent, or is it lwp-trivial? :)
Ya, I'd say defunct or close to it...their footer is different CAsiNG on some pages, too.
