Cloudflare introduces a system to check the work of Verified bots
A trust band shows if a bot follows the instruction of a site.
Cloudflare introduced a system that checks if a bot on its Verified list follows the instruction of a site. The system measures how frequently a crawler follows the robots.txt file of a site. Cloudflare says that the result is a trust band, a range that shows how frequently a bot follows the instruction of the site. Cloudflare will show the scores in public on Radar.
Sources
- Continuous accountability for Verified botsblog.cloudflare.com
Posted
