Welcome to WebmasterWorld Guest from 54.162.240.235

Forum Moderators: goodroi

Message Too Old, No Replies

Google Sucking My Images Up

Why Why Why?

     
12:26 pm on Jan 23, 2013 (gmt 0)

10+ Year Member



given the following:
[example.com...]

User-agent: *
Disallow: /download/

User-agent: *
Disallow: /*.jpg$

User-agent: *
Disallow: /public/view-players/


why the hell wouldn't google pay attention and index anyway?
if you do an image search for POL0033 it appears

[edited by: incrediBILL at 12:54 am (utc) on Jan 24, 2013]
[edit reason] removed specifics, no specifics please [/edit]

1:16 pm on Jan 23, 2013 (gmt 0)

WebmasterWorld Administrator 5+ Year Member Top Contributors Of The Month



Is the image shown only from your site or might it have been indexed from another site?

Are you appending X-Robots-Tag: noindex to your images?

BTW, you should always use example.com here rather than your own URL.
12:15 am on Jan 24, 2013 (gmt 0)

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month



robots.txt = don't crawl

It says nothing about indexing.

Yes, this is counter-intuitive and will drive you berserk. But that's the way it is.
8:21 pm on Jan 24, 2013 (gmt 0)

WebmasterWorld Senior Member dstiles is a WebmasterWorld Top Contributor of All Time 5+ Year Member



The robots.txt file is not checked during Web Preview hits on your site. Which is one reason I block Web Preview accesses. It will fetch anything and everything!
1:53 pm on Jan 27, 2013 (gmt 0)

WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



assuming apache server...

http://developers.google.com/webmasters/control-crawl-index/docs/robots_meta_tag [developers.google.com]:
You can use the X-Robots-Tag for non-HTML files like image files where the usage of robots meta tags is not possible.
Here's an example of adding a noindex X-Robots-Tag directive for images files (.png, .jpeg, .jpg, .gif) across an entire site:

<Files ~ "\.(png|jpe?g|gif)$">
Header set X-Robots-Tag "noindex"
</Files>
7:28 pm on Jan 27, 2013 (gmt 0)

WebmasterWorld Senior Member dstiles is a WebmasterWorld Top Contributor of All Time 5+ Year Member



Still doesn't apply to web preview, though: that ignores all robot directives.
10:50 pm on Jan 27, 2013 (gmt 0)

WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



the OP was discussing indexing for image search.
web preview is a different problem.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month