Tag: "Baidu Spider"
Will using Content Delivery Networks affect SEO
As technology advances, more and more companies distribute their website content over Content Delivery Networks (“CDN”), instead of hosting sites on a single server. This new approach may lead to some questions about SEO and issues that could be of main concern are as follows: Sites distributed over CDN might seem to be hosted on [...]
Common incidences that cause Baiduspider crawling failure
As we all know, Baiduspider is the robot which Baidu uses to crawl websites on the Internet creating an indexed database, so that Baidu users can see relevant page search results. Baidu uses different user-agents for different products as shown below. As a Baidu tech guy named Lee wrote on BaiduTieba, there are a number [...]
How the Baidu spider reacts to common HTTP status codes
There is a semi-official group on Baidu Tieba where Baidu tech staff Lee answers SEO questions from webmaster representatives. According to a recent post from Lee, he reveals how the Baidu spider treats different HTTP status codes and provides some suggestions when using those status codes. 404 Not Found If the URL returns the status [...]
