Forum Moderators: open
the ability to delete your URLs from Yahoo's index
Yes! Long outclassed by Google's url removal tool, Yahoo has now given us a way to cope with those "oops!" moments.
Delete URLs: For your authenticated sites, you can now delete any URLs from the index. Simply locate the URL in Site Explorer and click on the 'Delete URL' button. The URL and all its subpaths will be deleted shortly thereafter. This is meant to work in conjunction with the robots.txt file while providing greater responsiveness.[/b]
I've got some questions on the details (deleted for how long; must the robot.txt agree; etc) but I'm sure all will be clear soon enough.
If I use Delete URL, do I also need to use Robots.txt?
Yes. Once you've used Delete URL to remove a URL from our index, we recommend using robots.txt to exclude the content from being added to out indexed again. Robots.txt excludes Yahoo!'s crawler (Slurp) from re-indexing your content. A robots.txt exclusion rule reduces the number of pages Slurp will read from your server. It also helps you save bandwidth on your website.
Note: Site Explorer Delete URL service facilitates the quick removal of your URL from our index and is helpful when a URL that you have excluded, continues to show up as a thin document, but it may not prevent our crawler from continuing to crawl the URL again. It is not an alternative to using robots.txt.
Each authenticated site owner is limited to 5 Delete URL requests per site. If there are multiple site owners, a site could show more than 5 active delete actions.
If a site owner wants to delete a url from the index, there's a likelihood that they are going to want to delete more than 5 urls eventually. I didn't think I needed to use the tool and then realised that I had about 15 urls which shouldn't really be there. I've now ammended the robots.txt file, but I can only delete 5 urls which is a shame.
I'm thinking that it's not the end of the world if the aforementioned urls are in the index, but it'd be nice if they weren't. But should I save my 5 deletes for urls which I really really do need to delete?
Strange that Yahoo don't state any timeline.
Each authenticated site owner is limited to 5 Delete URL requests per site. If there are multiple site owners, a site could show more than 5 active delete actions.
Is there going to be any increase on this, Yahoo has literally thousands of 301 redirects and 404 pages, pages blocked by robots.txt file index for a site of mine.
or could we use the feedback to have mass removals.
Vimes.