Forum Moderators: open

Message Too Old, No Replies

How long does it last robots.txt

         

JoeyBall

9:20 pm on Sep 25, 2003 (gmt 0)

10+ Year Member



hi,

Just wondering if you place a robots.txt file on your sever how long will it be taken off google

pendanticist

6:47 pm on Sep 26, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



JoeyBall, Welcome to WebmasterWorld! :)

Could you clarify your question a bit?

Are you asking that if you put a robots.txt [webmasterworld.com] file on your server - "How long will it take for Google to remove you from their listings?" Such to say, you DO NOT wish to be listed by them (et. al.,)?

Additional reading on posts dealing with htaccess [google.com] and robots.txt [google.com].

Pendanticist.

JoeyBall

7:26 pm on Sep 26, 2003 (gmt 0)

10+ Year Member



Hi,

someone hacked into my site and placed a robots.txt file around june 15th.

just wondering how long till the site will come back on google. the sites still have a rank of 6 and 5.

thanks

JuniorOptimizer

7:39 pm on Sep 26, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Joey, a robots.txt isn't a bad thing.

JoeyBall

7:41 pm on Sep 26, 2003 (gmt 0)

10+ Year Member



Hi junior,

It is for me my main source of revenue was from google and now hardly anything.

JuniorOptimizer

7:47 pm on Sep 26, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



What you described shouldn't be an issue. If the robots.txt was blocking indexing and you removed it, the pages should get back in pretty quick. As long as you still have inbound links there shouldn't be a problem.

JoeyBall

7:48 pm on Sep 26, 2003 (gmt 0)

10+ Year Member



could you perhaps have a look a the site for me.

Gus_R

7:50 pm on Sep 26, 2003 (gmt 0)

10+ Year Member



If you fixed wrong robots.txt and have regular googlebot visits, site will appear in index around a week after crawl.

JuniorOptimizer

7:50 pm on Sep 26, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Sure thing. Sticky me the address.

JoeyBall

7:53 pm on Sep 26, 2003 (gmt 0)

10+ Year Member



Hi gus,

no, some hacker place a robots.txt onto my server. disallow agent something like that. ever since then its been blocked well over 3 months now.

John_Caius

7:54 pm on Sep 26, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Have you removed it or corrected it to allow googlebot to crawl?

JoeyBall

7:56 pm on Sep 26, 2003 (gmt 0)

10+ Year Member



Hi john,

i removed it the day i noticed that the sites are off google. the hacker also put no index no follow on the homepage but later i changed that.

thats 3 months ago now

JoeyBall

8:01 pm on Sep 26, 2003 (gmt 0)

10+ Year Member



also

do google still update on a montly basis

JuniorOptimizer

8:08 pm on Sep 26, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



He has the robots.txt removed now. Shouldn't Googlebot follow in an incoming link and re-index the whole site now?

pageoneresults

8:08 pm on Sep 26, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



The hacker also put no index no follow on the homepage but later i changed that.

Hmmm, you have other issues you should be addressing such as security. If they were able to get in and upload a robots.txt and also drop in the Robots META Tag, then you should seriously close those security holes first.

By the way, we do not perform site reviews here at WebmasterWorld. You are welcome to post a snippet of your robots.txt file for review and we'll be happy to let you know what it is doing. If it looks like this...

User-agent: *
Disallow: /

Then that is telling the robots to not index the entire site. It sure sounds like you upset someone somewhere along the way. I can't recall ever seeing someone posting that they got hacked and a robots.txt file was put in place.

Is there someone else who has access to the site?

JoeyBall

8:14 pm on Sep 26, 2003 (gmt 0)

10+ Year Member



Thats what it looks like, the robots.txt,

the person hacked in to my email address at yahoo were most of my passwords were kept (not any more though).

all i want is for my sites to put on google again.

i read somewhere that after 3 months the sites come back on google but its been over 3 months now.

thanks