homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

Tool to check if multiple URLs are indexed?

 6:56 pm on Feb 1, 2010 (gmt 0)

Is there a way to check multiple URLs at once if they are indexed in Google? Not just the total # but the specific URLS



 2:13 pm on Feb 2, 2010 (gmt 0)

Personally I don't care too much if my pages are indexed. I care more about my pages getting traffic. So I usally pay more attention to my analytics and log files to identify which pages generate traffic and which ones need improvement.

Since you specifically mention checking the index status for Google why not log into Google Webmaster Central?


 7:13 pm on Feb 2, 2010 (gmt 0)

WMC just gives you the total #, but I'm interested in specific URLs. IMO indexing becomes more important the bigger the site is. When a page gets indexed it opens up to long tail search, even if you don't push that specific page. So if you have several million pages, opening them up to long tail searches will be significant amounts of traffic. Analytics will only tell you which pages are already getting traffic, i.e. they will show what's working to some minimum degree, but it won't show what isn't working at all.


 3:46 pm on Feb 3, 2010 (gmt 0)

Analytics will tell you pages that get traffic AND pages that dont get traffic. Simply compare the pages that have traffic according to your analytics to your master URL file. The urls with no matches are the ones that get no traffic and need some extra attention.

Based on my experience I do agree that long tail is powerful and can be extremely profitable. I also have found that sometimes it is actually better to not work towards getting 100% of the large websites indexed. Sometimes a bit of pruning will lead to significantly higher profits at least that is what I have discovered over the years.


 9:25 am on Feb 4, 2010 (gmt 0)

have you tried the inurl: operator?
a search term like this should do it:
site:example.com inurl:www.example.com/path/to/page.html

Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved