Welcome to WebmasterWorld Guest from 34.229.113.106

Forum Moderators: open

Message Too Old, No Replies

My images- should I allow it to crawl?

     
3:47 am on Apr 15, 2004 (gmt 0)

Preferred Member

10+ Year Member

joined:Apr 13, 2004
posts:428
votes: 0


Ok I have an images folder that is used for the images on the site (products) however many of these are our own images and so there are ownership concerns. At the moment the robots.txt is set to disallow access to that folder. My question is with Froogle going international in the future is there any reason why I should allow access to this? Does google prefer to have access to images or not?

:D

10:54 pm on Apr 15, 2004 (gmt 0)

Junior Member

10+ Year Member

joined:Feb 10, 2003
posts:157
votes: 0


While Im sure lack of images will not reduce your listed products in froogle, it might reduce your click throughs.

Listings with images surely get more clicks than those without.

12:12 am on Apr 16, 2004 (gmt 0)

Preferred Member

10+ Year Member

joined:Apr 13, 2004
posts:428
votes: 0


Ah- will Froogle still display my pictures? Although it is told not to crawl the pictures are completely accessible.
3:36 am on Apr 16, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Apr 26, 2001
posts:1422
votes: 0


From the merchant information page.

Merchants who meet Froogle's criteria and want to submit a data feed must allow Google to crawl their websites by removing any robots.txt files that disallow our Googlebot spider.

Also talked about here [webmasterworld.com].

4:10 am on Apr 16, 2004 (gmt 0)

Preferred Member

10+ Year Member

joined:Apr 13, 2004
posts:428
votes: 0


Thank You very much! This site is useful but it takes a while to get an answer sometimes.
6:41 pm on Apr 16, 2004 (gmt 0)

Full Member

10+ Year Member

joined:May 29, 2003
posts:202
votes: 0


I just submitted my first feed a few days ago and got an e-mail last night advising that I need to give googlebot a specific entry in my robots.txt file so the crawler can visit the images directory. But they want me to give googlebot *complete* access:

Agent: googlebot
Disallow:

There's a *huge* difference between allowing googlebot into a specific directory where the images are, and giving it free run over the enitre web site.

I have plenty of content that googlebot doesn't need to bother itself with, but have removed the restriction on the images folder to appease them. If that's not good enough, I guess I'll rethink whether I really need a froogle feed or not.

Why would they possibly need *complete* unrestricted access to the site anyway?

6:58 pm on Apr 16, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Apr 26, 2001
posts:1422
votes: 0


Marty, I would try and clarify that with them. I exclude googlebot from parts of my sites with robots.txt and have no image issues at all.