Welcome to WebmasterWorld Guest from 188.8.131.52
Firstly let me introduce myself. My name is Nick Cox, and my grand title here at Mirago is "Information Retrieval Specialist". Sorry it has taken so long to reply to this post, but it has only just caught my attention.... better late than never I guess!
Yes, I can confirm that Mirago do stem. We actually refer to it as normalisation around here, but in either case it is a technology that we have been using for some years.
I must say it is a nice feeling to see the big boys play catch up with us once in a while!
I hope that answers your question.
There are several things going on at Mirago with regard to index inclusion at the moment....
Firstly, we are about to launch "Platinum Listings", which is a type of paid inclusion (NOT paid position however!). Platinum Listings will enable you to select how frequently you need our robot (Henry) to recrawl your various pages - anywhere from once a day to once a fortnight. Once you have signed up for this service, your pages will be crawled and searchable within the timeframe you have chosen. There is more information on our corporate site (http://www.mirago.com/com/platinum_listings.asp).
For those of you who have larger, database driven sites (e.g. the Dabs.com's of this world), we launched Trusted Feeds several months ago. Once you have been cleared as a Trusted Feed provider your pages will be in our index within 24hours. More on this service can be found here (http://www.mirago.com/com/trusted_feeds.asp).
As you mentioned, we also accept submissions via our website - these submissions are checked for their relevance to our index etc. and are added to our standard crawl cycles. Generally this means that we will add sites submitted in this manner approximately once every month. As ever there is always a BUT - due to the recent work for Platinum Listings, dear old Henry has not been following his standard crawl cycle. We hope to have him back in this cycle by the beginning of April, and from then you should see your submissions taking about 4-6 weeks to filter in to the index.
I hope that answers your question without sounding too much like an advert for our various services! As ever, if you have any more questions please feel free to fire away .
(nick dot cox at mirago dot com).
P.S - My intention was to answer as fully as possible, but having read that all back I am starting to think that it might look a bit too much like an advert (not my intention - honest)! If any forum admins want me to remove / change any of this please contact me directly. Cheers.
Could you also explain, how Mirago is locating domains and indexing them.
I'll give you an example..
I have a domain called widgets.co.uk (as an example), which I registered about a month ago. widgets.co.uk does nothing, it is not promoted, it is not listed anywhere. The only thing it does is, is re-directs to widgets.com.
I have not submitted widgets.co.uk to your service, so don't understand how you are picking this up.
Are you spidering the Nominet whois? Getting all domain names registered or recently registered and then indexing whatever they link to?
This is not an isolated incident as I have another domain called widgets2.co.uk which is just a re-direct to wedgets2.com. It is not promoted, never submitted to any indexes, but is a .co.uk domain and they only reference to it is via Nominet and the Nominet whois.
I'm sure others would also be interested.
I can understand your puzzlement. I am sure someone will correct me if I am wrong on this, but Nominet don't hand out domain lists anymore due to the inherent problems of email spamming etc. We did use the Nominet lists to bolster our natural discoveries some time ago, however this is a process that has not been used for quite some time. Our current approach is through natural discoveries of links, and our various PFI services.
You might find that someone has submitted the URL to us via our website, or that we have found some other page which links to the domain (perhaps linking to a site that was previously at the domain?). We have recently restarted our UK crawl so there are no logs for me to check. If you want to contact me in a few weeks with the domain in question I will be happy to track through Henry's logs for you and let you know how he found your site.
Thanks for the question,
Yes, we do have a European client base and are active in Germany. [mirago.de...]
We don't have any market share stats at the moment. In terms of our demographic data - our base is consumer-oriented - retail and general search.
If you would like me to put you in touch with our German office, please let me know.
As for the PFI (Platinum Listings) launch date, I can only apologise! Platinum listings are in the final stage of testing, and are due to go live at the start of April. I have asked our web guys to make the changes - thanks for pointing it out!