Forum Moderators: phranque

Message Too Old, No Replies

How to Place A temporary ban on IP address with notice in robots.txt

         

ChoiceStalker

7:12 pm on Mar 20, 2008 (gmt 0)

10+ Year Member



Hey guys,

so i was browsing around on < c certainsite > and boy do they have a LOT of good information so i decided that i wanted to print it out and read it while away from my computer cant remember what i did first but i know i wanted to copy and paste the text in to a notepad so i could cut out all the other unnessary stuff like ads and colors and just get down to the meat of things... when i tried to highlight the text i was unable to do it... so i just thought maybe i'll look at the source code and this is what is in the source code

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<meta name="robots" content="noarchive">
<title>The Page Title's Text</title>
<meta name="description" content="here is some description text...">
<link rel="stylesheet" type="text/css" media="screen" href="http://www.example.com/lib/031025s.css" />
<link rel="stylesheet" type="text/css" media="print" href="http://www.example.com/lib/031025p.css" />
</head>
<!-- ********************** End ************************ -->
<!--

Copyright 1999-2007 example.com. All rights reserved.
This web site is operated by .....

The articles on this website are copyrighted material and may not be reproduced,
stored on a computer disk, republished on another website, or distributed in any
form without the prior express written permission of example.com.

-->

so i think hmmmm that's weird... so i go to download the page/pages i want and i get an error and i look at the robots.txt file and this is what i see

Special Notice

Our site watchdog has detected an attempt to save one of our pages onto your local computer.

Such action is prohibited by the Example.com User Agreement. As a security measure, a temporary ban has been placed on your IP address.

For more information, please see the Example.com User Agreement. If you have any questions, please contact us via the site contact form.

Long story short... i think this is a very cool security feature and i need to know how its done...

can someone walk me through it please?

[edited by: tedster at 8:11 pm (utc) on Mar. 20, 2008]
[edit reason] switch to example.com [/edit]

tedster

8:25 pm on Mar 20, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The first part of your report sounds like an old trick. I'll bet there's just lots of white space after that last comment.you can just scroll further down the source code and then you'll see the rest of the page's code.

I'm not sure how the second effect was accomplished, but I'd bet it is also a trick. No one can even SEE a web page on their screen without first downloading it from the server to their computer -- and that saves a copy in the computer's local browser cache.

ChoiceStalker

8:51 pm on Mar 20, 2008 (gmt 0)

10+ Year Member



yeah you're right about all the white space that's weird...

how are they able to turn off the "select text" feature... you cannot highlight any of the text on their site...

also it looks like their site is protected from website rippers... how did they do that i wonder?

londrum

8:55 pm on Mar 20, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



you can do that with javascript. if you turn off javascript in your browser then you can probably highlight it okay.