Baidu spider anyone know much about this?
-
Hi Guys,
It seems I get a lot of visits from Baidu spider does anyone know much about this? I notice they visit every single page at least 5 times a day, just wondering if anyone knows anything about this?
-
1. What is Baiduspider?
Baiduspider is Baidu search engine program which is used to visit pages on the internet and build information into Baidu index. This enables users to locate your site when they perform a search.2. What is Baiduspider’s user-agent?
Baidu uses different user-agents for different products:| Name of Products | User-agent |
| PC search |Baiduspider
|
| Mobile search |Baiduspider
|
| Image search | Baiduspider-image |
| Video search | Baiduspider-video |
| News search | Baiduspider-news |
| Baidu bookmark | Baiduspider-favo |
| Union baidu | Baiduspider-cpro |
| Business search | Baiduspider-ads |
| other search | Baiduspider |3. Will Baiduspider creates additional loading to customer servers?
In order to ensure the search results cover most of your pages, Baiduspider must keep the crawling at a certain level. We have been trying our best to avoid increasing the loading to your servers, and to adjust the frequency based on combined factors, such as your server's capability, your site’s quality and the update frequency of your site. If you find any unreasonable access from Baiduspider, please inform us athttp://webmaster.baidu.com/feedback/index (arab,thai,Português)Hope this helps.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Anyone backlinks from hacked FaceBook widgets?
I was going through my backlink profile the other day and started noticing a huge number of new back links, like 100k. Digging through them, I am seeing a lot of links that are inserted in Facebook feed widgets. You will see the link at the bottom of the widget. From what I can see, a lot of these links are all in this format, all on European domains, all running WordPress. Doesn't seem to have anything do to spamminess. Had domains that were on blacklists, some not. Anyone seen anything like this before? The only thing I can think of was maybe an automated hack bot that inserted the link when it was able to get in? E0OMJfi.jpg
White Hat / Black Hat SEO | | ShockoeCommerce0 -
HELP!! We are losing search visibility fast and I don't know why?
We have recently moved from http to https - could this be a problem? https://www.thepresentfinder.co.uk As far as I'm aware we are doing everything by SEO best practice and have no manual penalties, all content is unique and we are not doing any link farming etc...
White Hat / Black Hat SEO | | The-Present-Finder0 -
A doorway-page vendor has made my SEO life a nightmare! Advice anyone!?
Hey Everyone, So I am the SEO at a mid-sized nationwide retailer and have been working there for almost a year and half. This retailer is an SEO nightmare. Imagine the worst possible SEO nightmare, and that is my unfortunate yet challenging everyday reality. In light of the new algorithm update that seems to be on the horizon from Google to further crack down on the usage of doorway pages, I am coming to the Moz community for some desperately needed help. Before I was employed here, the eCommerce director and SEM Manager connected with a vendor that told them basically that they can do a PPC version of SEO for long-tail keywords. This vendor sold them on the idea that they will never compete with our own organic content and can bring in incremental traffic and revenue due to all of this wonderful technology they have that is essentially just a scraper. So for the past three years, this vendor has been creating thousands of doorway pages that are hosted on their own server but our masked as our own pages. They do have a massive index / directory in HTML attached to our website and even upload their own XML site maps to our Google Web Master Tools. So even though they “own” the pages, they masquerade as our own organic pages. So what we have today is thousands upon thousands of product and category pages that are essentially built dynamically and regurgitated through their scraper / platform, whatever. ALL of these pages are incredibly thin in content and it’s beyond me how Panda has not exterminated them. ALL of these pages are built entirely for search engines, to the point that you would feel like the year was 1998. All of these pages are incredibly over- optimized with spam that really is equivalent to just stuffing in a ton of meta keywords. (like I said – 1998) Almost ALL of these scraped doorway pages cause an incredible amount of duplicate content issues even though the “account rep” swears up and down to the SEM Manager (who oversees all paid programs) that they do not. Many of the pages use other shady tactics such as meta refresh style bait and switching. For example: The page title in the SERP shows as: Personalized Watch Boxes When you click the SERP and land on the doorway page the title changes to: Personalized Wrist Watches. Not one actual watch box is listed. They are ALL simply the most god awful pages in terms of UX that you will ever come across BUT because of the sheer volume of this pages spammed deep within the site, they create revenue just playing the odds game. Executives LOVE revenue. Also, one of this vendor’s tactics when our budget spend is reduced for this program is to randomly pull a certain amount of their pages and return numerous 404 server errors until spend bumps back up. This causes a massive nightmare for me. I can go on and on but I think you get where I am going. I have spent a year and half campaigning to get rid of this black-hat vendor and I am finally right on the brink of making it happen. The only problem is, it will be almost impossible to not drop in revenue for quite some time when these pages are pulled. Even though I have helped create several organic pages and product categories that will pick-up the slack when these are pulled, it will still be awhile before the dust settles and stabilizes. I am going to stop here because I can write a novel and the millions of issues I have with this vendor and what they have done. I know this was a very long and open-ended essay of this problem I have presented to you guys in the Moz community and I apologize and would love to clarify anything I can. My actual questions would be: Has anyone gone through a similar situation as this or have experience dealing with a vendor that employs this type of black-hat tactic? Is there any advice at all that you can offer me or experiences that you can share that can help be as armed as I can when I eventually convince the higher-ups they need to pull the plug? How can I limit the bleeding and can I even remotely rely on Google LSI to serve my organic pages for the related terms of the pages that are now gone? Thank you guys so much in advance, -Ben
White Hat / Black Hat SEO | | VBlue1 -
Can anyone explain some below SEO questions ?
Can we do link building like directory, article, press releases, classifieds, business listing, social bookmarking etc. We need to check DA, Alexa, Page Rank, cBlock IP before publishing any kind of Link but how much Max or Min. no. should be for consider any website like DA should be min 20-30-40 etc.. How can consider a natural links? Which type anchor text should be in any kind of links may be directory etc. In website interlinking we should put Exact Links or no need to put any links For.ex.my website is abc.com.au then we can put link for Website Design keywords or Should be long tail keyword. How can we do content marketing means we should post blog in internal website or need to create External Blog like BlogSpot, WordPress. In blog we should put any keyword link OR should be post without links. We can put link on no follow website. Why more website coming on Google first page but they are doing Spammy links like exact keywords links, unnatural links etc.. Thanks, Akhilesh
White Hat / Black Hat SEO | | dotlineseo0 -
How do I know for sure if my site has been slapped?
I'm new to this SEO business - and I focus on inbound marketing. My client's site is www.SubconsciousMind.com. Just a few weeks ago it was showing in the top search results for several major keywords. Now, it has disappeared all together and there are competitors showing that have very little SEO (metatarsi not set up properly, etc.). So, I know there has to be an opportunity. Some obvious things:
White Hat / Black Hat SEO | | SoundsLikeJoy
There aren't a lot of links and the majority seem to be bad (bad linking farms)
Social media is set up by a robot
Articles are poorly written obviously ONLY for SEO My client hired a SEO company awhile back to get results, not understanding black hat / white hat and it worked for several years. Now - it is really hurting her. The sites she is linking to doesn't have any contact info to get the "unlinked." I've read I can use the disavow tool. I asked her if she got anything from Google about "being slapped". She doesn't even receive the emails to her site because she trusted someone else to set it all up. Should I rebuild from scratch? Any recommendations? We are funning adwords now as a quick fix.0 -
Can anyone recommend a Google-friendly way of utilising a large number of individual yet similar domains related to one main site?
I have a client who has one main service website, on which they have local landing pages for some of the areas in which they operate. They have since purchased 20 or so domains (although in the process of acquiring more) for which the domain names are all localised versions of the service they offer. Rather than redirecting these to the main site, they wish to operate them all separately with the goal of ranking for the specific localised terms related to each of the domains. One option would be to create microsites (hosted on individual C class IPs etc) with unique, location specific content on each of the domains. Another suggestion would be to park the domains and have them pointing at the individual local landing pages on the main site, so the domains would just be a window through which to view the pages which have already been created. The client is aware of the recent EMD update which could affect the above. Of course, we would wish to go with the most Google-friendly option, so I was wondering if anyone could offer some advice about how would be best to handle this? Many thanks in advance!
White Hat / Black Hat SEO | | AndrewAkesson0 -
I would like to know if there is a tool to know what keywords
Hi everyone, I am looking for a keywords searcher or a program that can help me to know which keywords my competitors are using. thanks!
White Hat / Black Hat SEO | | lnietob0 -
Has anyone been able to recover a site from that was slapped by panda?
I have a client that the only thing I can determine is over optimization of a couple anchor terms which the person no longer ranks for..I tried mixing up with brandname , brandname.com and a diversity of links but nothing seems to budge anyone have a similar problem?
White Hat / Black Hat SEO | | foreignhaus0