homepage Welcome to WebmasterWorld Guest from 54.204.94.228
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Alternative Search Engines
Forum Library, Charter, Moderators: bakedjake

Alternative Search Engines Forum

    
Alexa robot getting same page over and over
That's "ia_archiver" to your log files....
brycen




msg:3137012
 3:01 pm on Oct 27, 2006 (gmt 0)

"ia_archiver" seems to be getting the same static pages of my site over and over again, each with a unique JSESSIONID. What's going on here? The site is buit with struts, but nothing fancy. Apache is the front-end to Tomcat 5.

Any clues?

I'm happy that Alexa is showing so much interest in the site, but there have to be limits. Here is a small sample from the Apache logs:

4.208.172.177 - - [27/Oct/2006:07:38:58 -0700] "GET /carsandlocations.do;jsessionid=81619AFEF389B666B9834F0F648B4F16 HTTP/1.0" 200 15902 "-" "ia_archiver"
64.208.172.177 - - [27/Oct/2006:07:39:10 -0700] "GET /carsandlocations.do;jsessionid=846E4866D47EBF4AE81B864412C9C4F1 HTTP/1.0" 200 15902 "-" "ia_archiver"
64.208.172.177 - - [27/Oct/2006:07:39:22 -0700] "GET /carsandlocations.do;jsessionid=874DCE1412F5544583A6DCB5C9312691 HTTP/1.0" 200 15902 "-" "ia_archiver"
64.208.172.177 - - [27/Oct/2006:07:39:34 -0700] "GET /carsandlocations.do;jsessionid=8A9DC4031091D9171F7A59C4CD891856 HTTP/1.0" 200 15902 "-" "ia_archiver"
64.208.172.177 - - [27/Oct/2006:07:39:46 -0700] "GET /carsandlocations.do;jsessionid=95C64CE8753BD35A07AC09F03F388DE4 HTTP/1.0" 200 15902 "-" "ia_archiver"
64.208.172.177 - - [27/Oct/2006:07:39:58 -0700] "GET /press.do HTTP/1.0" 200 23290 "-" "ia_archiver"
64.208.172.177 - - [27/Oct/2006:07:40:10 -0700] "GET /carsandlocations.do;jsessionid=987A08D8687802F5D728376BCC571B1D HTTP/1.0" 200 15902 "-" "ia_archiver"
64.208.172.177 - - [27/Oct/2006:07:40:22 -0700] "GET /carsandlocations.do;jsessionid=9B62C8958BB345A9C58CE876BD055B45 HTTP/1.0" 200 15902 "-" "ia_archiver"
64.208.172.177 - - [27/Oct/2006:07:40:34 -0700] "GET /carsandlocations.do;jsessionid=AA0605C0C070A53C125FFC8C95FBCE23 HTTP/1.0" 200 15902 "-" "ia_archiver"
64.208.172.177 - - [27/Oct/2006:07:40:46 -0700] "GET /carsandlocations.do;jsessionid=ADE37C7AFBB131D7EB9580989439B4D1 HTTP/1.0" 200 15902 "-" "ia_archiver"
64.208.172.177 - - [27/Oct/2006:07:40:58 -0700] "GET /login.do%3Bjsessionid%3DCA263F5662574952264DB58801786231 HTTP/1.0" 200 28391 "-" "ia_archiver"
64.208.172.177 - - [27/Oct/2006:07:41:10 -0700] "GET /carsandlocations.do;jsessionid=B0EC8385EE2BB5A7C1D732BEF3689A7D HTTP/1.0" 200 15902 "-" "ia_archiver"
64.208.172.177 - - [27/Oct/2006:07:41:22 -0700] "GET /carsandlocations.do;jsessionid=BC4372DE890DB0EB13A7A32E19188D1D HTTP/1.0" 200 15902 "-" "ia_archiver"
64.208.172.177 - - [27/Oct/2006:07:41:34 -0700] "GET /carsandlocations.do;jsessionid=CDCD54D49841860B9A6126B6DAD34981 HTTP/1.0" 200 15902 "-" "ia_archiver"
64.208.172.177 - - [27/Oct/2006:07:41:46 -0700] "GET /carsandlocations.do;jsessionid=D55431C1B9D1C78D3C7186A7209C2B41 HTTP/1.0" 200 15902 "-" "ia_archiver"
64.208.172.177 - - [27/Oct/2006:07:41:58 -0700] "GET /carsandlocations.do;jsessionid=DA66DB0B00550183EE3D9B2C335E430A HTTP/1.0" 200 15902 "-" "ia_archiver"
64.208.172.177 - - [27/Oct/2006:07:42:10 -0700] "GET /carsandlocations.do;jsessionid=EDB64ADA4D697C824E556A3F94545C3D HTTP/1.0" 200 15902 "-" "ia_archiver"
64.208.172.177 - - [27/Oct/2006:07:42:22 -0700] "GET /carsandlocations.do;jsessionid=F74833963DBCB57E8E681715A53C1857 HTTP/1.0" 200 15902 "-" "ia_archiver"

 

brycen




msg:3137027
 3:07 pm on Oct 27, 2006 (gmt 0)

See also [webmasterworld.com...]
In this case I am the programmer also, and I agree -- I havae no idea how control this aspect of Tomcat.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Alternative Search Engines
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved