Welcome to WebmasterWorld Guest from 54.145.23.244

Forum Moderators: goodroi

Message Too Old, No Replies

Google Sucking My Images Up

Why Why Why?

     
12:26 pm on Jan 23, 2013 (gmt 0)

Junior Member

10+ Year Member

joined:Mar 25, 2004
posts:161
votes: 0


given the following:
[example.com...]

User-agent: *
Disallow: /download/

User-agent: *
Disallow: /*.jpg$

User-agent: *
Disallow: /public/view-players/


why the hell wouldn't google pay attention and index anyway?
if you do an image search for POL0033 it appears

[edited by: incrediBILL at 12:54 am (utc) on Jan 24, 2013]
[edit reason] removed specifics, no specifics please [/edit]

1:16 pm on Jan 23, 2013 (gmt 0)

Moderator from US 

WebmasterWorld Administrator 5+ Year Member Top Contributors Of The Month

joined:Dec 27, 2006
posts:2664
votes: 51


Is the image shown only from your site or might it have been indexed from another site?

Are you appending X-Robots-Tag: noindex to your images?

BTW, you should always use example.com here rather than your own URL.
12:15 am on Jan 24, 2013 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:Apr 9, 2011
posts:12994
votes: 287


robots.txt = don't crawl

It says nothing about indexing.

Yes, this is counter-intuitive and will drive you berserk. But that's the way it is.
8:21 pm on Jan 24, 2013 (gmt 0)

Senior Member from GB 

WebmasterWorld Senior Member dstiles is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:May 14, 2008
posts:3099
votes: 3


The robots.txt file is not checked during Web Preview hits on your site. Which is one reason I block Web Preview accesses. It will fetch anything and everything!
1:53 pm on Jan 27, 2013 (gmt 0)

Administrator

WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Aug 10, 2004
posts:10550
votes: 10


assuming apache server...

http://developers.google.com/webmasters/control-crawl-index/docs/robots_meta_tag [developers.google.com]:
You can use the X-Robots-Tag for non-HTML files like image files where the usage of robots meta tags is not possible.
Here's an example of adding a noindex X-Robots-Tag directive for images files (.png, .jpeg, .jpg, .gif) across an entire site:

<Files ~ "\.(png|jpe?g|gif)$">
Header set X-Robots-Tag "noindex"
</Files>
7:28 pm on Jan 27, 2013 (gmt 0)

Senior Member from GB 

WebmasterWorld Senior Member dstiles is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:May 14, 2008
posts:3099
votes: 3


Still doesn't apply to web preview, though: that ignores all robot directives.
10:50 pm on Jan 27, 2013 (gmt 0)

Administrator

WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Aug 10, 2004
posts:10550
votes: 10


the OP was discussing indexing for image search.
web preview is a different problem.
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members