Google can enter my members area?

also did the july update begin?

[cyberwave]

i have a message board behind a members area

i found that the counter jumped from msg # 10000 to 13000 skipping in between 2 days ago, the only explanation was a crawler crawled into the members area (which is password protected so i am surprised), and hit every reply to message button causin the counter to move +1

thanks for the explanation

also did the july dance begin ?!! :)

[Brett_Tabke]

You mean they just followed links right? They didn't actually get any content other than the login page?

[edited by: Brett_Tabke at 5:15 pm (utc) on July 15, 2002]

[zeus]

A search engine spider can not give in a password so maybe someone is linking to that side and the crawl has not started, but it has also not stoped completly from the last a little wierd this time you can still see some different results on www2,www3 sometimes.

zeus

[cyberwave]

yeah that's what happened brett but in order to follow the links they should go into

www.mydomain.com/members/messageboard.php

then go into each msg id by adding ?msdid=#### and then hit inside every post the "reply to msg button"

so they just followed links but links behind the members area :)

[Key_Master]

Were they robots.txt prohibited links?

[amoore]

Were you protecting it with "HTTP Basic Authentication"? Someone may have a link somewhere with their username/password in it. (They may be able to do that even if you're not using basic authentication). A link like [user:[e-mail]...] or [example.com...] may have gotten you.

That makes me wonder if google will follow links like the first one, ones with the username and password in the beginning of the URL. Anyone have any empiracle evidence of this? I may make one and see what happens.

-Andy