Froogle Crawl

Tracking Froogle

[deltakits]

Not sure if it's been posted already, but it looks like Froogle is using their freshbot (or at least the 64.68.86.* IP Addresses) to crawl Froogle datafeeds.

This includes the images as well...

[lazerzubb]

Yes i think you are correct, i haven't followed "Froogle bot" to carefully since yet it doesn't have the "traffic" (i know i am talking about Google :o )

Someone who've submitted and had a Datafeed might be able to help?

[deltakits]

Actually I do have a datafeed, that's how I figured it out...:)

I just thought it was interesting that they use their freshbot for images as well.

[stuntdubl]

Do you have to submit a datafeed in order to get crawled by the "frooglebot"?

[lazerzubb]

stuntdubl, nope, they do compile an index of "normal" pages to, they have to have us quoted prices though.
(not to be spidered but to be indexed)

[stuntdubl]

That's good news to me. Any idea if they crawl and index Yahoo! stores?

I haven't found an easy way to convert my product list to the proper format yet.

(Anyone know how to convert xml to excel?)

[deltakits]

Any idea if they crawl and index Yahoo! stores?

They definitely do...There are quite a few of them in there.

[WindSun]

"That's good news to me. Any idea if they crawl and index Yahoo! stores?"

If you have the data feed turned on in your store manager options, Yahoo will send the XML file directly to Froogle.

Right now it is kind of glitchy, as images do not seem to be showing up in Froogle, but otherwise it seems to be working.

We got our first order from Froogle a couple of days ago.