Forum Moderators: goodroi

Message Too Old, No Replies

Gap - how many days

         

successlieswithme

8:46 pm on Nov 21, 2005 (gmt 0)

10+ Year Member



Hello,
i heared that, we need to add atleast one page everyday.

actually now iam adding lots of pages( upto50) everyday to my site,
and i also heared tht, we can control of SEs visiting to site by ediitng robots.txt

now i want to addd robots.txt to my site with this restiction:
SEs should visit once for every 3 days...

and i need your suggestion:
whether i should put 3days or 1day?
my site has a forum and myself adding lots of content to the site everyday, so please give me better suggestion
thank you

Dijkgraaf

6:00 am on Nov 22, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



No, you can't control how often your site is spidered via robots.txt
Some spiders do accept a crawl delay instruction, but that just tells it not to make request more often then every X seconds.
Just add your contents and then spiders finding new contents will probably start visiting more often.

ogletree

6:18 am on Nov 22, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Yeah don't mess with that or the meta tags that say the same thing that is a waste of time. There is nothing wrong with adding several pages a day. Even if you did put up 1 page a day the spider has no idea when you added them because they don't deep crawl every day. If you looked at your logs and only put up new content after the spider found your new page you would be lucky to get 4 new pages a month up. The one page a day is a min not a max. If you are writing good quality articles put up as many as you can. I'm sure there is some max but it is not set number. Don't stick up 1000 pages a day. Whatever you can actualy get out in quality pages is what you should put out.

successlieswithme

9:39 am on Nov 22, 2005 (gmt 0)

10+ Year Member



thank you for reply,

actually iam planning to add 50 pages everyday for next 1 week,
with that 1 part of my site will be completed.

then i will add lotsof scripts, forum to site so people will make posts there,

and upto 1more month i will add minimum 10 pages everyday, but iam not sure after that 1month

so shall i proceed adding 50 pages everyday or shall i add some pages everyday and for a long time.

iam planning to complete asap, because when these pages were completed, i may get new ideas.

please tell me which is good method.
thank you