 | |
| Original author(s) | Microsoft |
|---|---|
| Type | Web crawler |
| Website | Bingbot FAQ |
Bingbot is a web-crawling robot (type ofinternet bot), deployed byMicrosoft October 2010 to supplyBing.[1] It collects documents from the web to build a searchable index for theBing (search engine). It performs the same asGoogle'sGooglebot.[2]
A typicaluser agent string for Bingbot is"Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)". This appears in theweb server logs to tell thewebmaster who is requesting a file. Each webmaster is able to use the included agent identifier, "bingbot", to disallow or allow access to their site (by default access is allowed).[3] If they don't want to grant access, they can use the Robots Exclusion Standard to block it (relying on the assumed good behaviour of bingbot), or use other server specific means (relying on the web server to do the blocking).[4]
