Forum Moderators: open

Message Too Old, No Replies

Baidu slow in crawling new site

it is slowed down recently

         

leunga

9:39 am on Nov 20, 2006 (gmt 0)

10+ Year Member



In the past, I used to get Baidu's bot to crawl within 2 days after submitting a new URL and get related SERP visible within a few days. However, it recently appeared to me that the time for the bot to first visit a new site was delayed. I have submitted a few URLs for 1 week now, but still cannot see any Baidu bot visiting. Any help?

bill

9:48 am on Nov 20, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



The standard SEO advice for several years now has been not to submit your URL to any search engine. The best practice is to get links to the new website and let the search engine spiders find you on their own.

It is possible that Baidu has found people abusing this submission service and that they are no longer taking action as quickly. Submitting your site multiple times could target you as an abuser of their service.

Matt Probert

12:01 pm on Nov 20, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The standard SEO advice for several years now has been not to submit your URL to any search engine. The best practice is to get links to the new website and let the search engine spiders find you on their own.

This is however, at complete odds with Google's own advice which is that you SHOULD submit URLs to Google for indexing - ideally through regularly updated site maps!

Perhaps Baidu has a similar approach?

Matt

leunga

9:02 am on Nov 21, 2006 (gmt 0)

10+ Year Member



Agree with you, Bill, that links are important. However, before, I solicit links, I think URL sumbit to SE is the first step. The point I like to share is that it appears a long delay before the bot first visits. This was not true a few month's ago.

leunga

bill

12:23 am on Nov 22, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I don't know how Baidu approaches their submit URL system. I have not submitted a URL to an SE in years. Baidu doesn't have a full fledged XML feed system like Google does for sitemaps, but that may be something they're considering.

Submitting URLs to the SEs used to be a big game. We even had an entire forum devoted to the topic: Search Engine Submission [webmasterworld.com], but that was deprecated in 2002.

If you are going to use the URL submit of any SE, just submit once and leave it alone. Multiple submissions could trip their spam filters.

leunga

5:29 am on Nov 28, 2006 (gmt 0)

10+ Year Member



I continued to do nothing after the URL submission. Yestersday, I was first aware of Baidu spider to visit. So, apparently it is a long delay. leunga