homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Marketing and Biz Dev / SEM Research Topics
Forum Library, Charter, Moderators: phranque

SEM Research Topics Forum

Google crawl errors being caused by JavaScript in our CMS?
Googlebot attempts to follow 'links' which only appear in the CMS script.

5+ Year Member

Msg#: 3542633 posted 10:09 pm on Jan 7, 2008 (gmt 0)

About 2 1/2 months ago, we started seeing crawl errors across all of our sites in Google Webmaster Tools. The phantom 'pages' all followed the same pattern:


After some investigation, we realized Google could only be pulling these strings from one location - a single line of embedded JavaScript created by our content management system. Here's an example of what the offending line looks like (this is fake code, just to help you visualize):

flmanageCM.fsrollup_mlc="/2621551/billybob/" + location.hostname + "/" + flmanageCM.fsrollup_default_pc;

In this faux example, the resulting error page would be mysite.com/2621551/billybob/. Here's where it gets weird: after about a month, all of these crawl errors started disappearing from Webmaster Tools - we thought we were off the hook. This week as the sites are being crawled, they're all coming back. So:

-Has anyone else seen a situation where Google has tried to crawl strings that look like 'folders' or 'pages' in JavaScript?
-Anyone observed recent changes in Google's protocol in handling JavaScript?

Thanks for any thoughts or observations!



WebmasterWorld Administrator phranque us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

Msg#: 3542633 posted 7:53 am on Jan 8, 2008 (gmt 0)

i think this has been common behavior for quite some time.

you can obfuscate your links in the javascript by url-encoding all reserved characters.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Marketing and Biz Dev / SEM Research Topics
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved