ShieldSquare classifies bot traffic into 4 different categories namely,
Data Center Bots:
These are bots which are having malicious intent and operate from a Data Center.
- Bad User Agent:
These are dumb bots which are used by amateur scrapers to scrape a site. They use readily available market tools such as Scrapy etc. These have User Agent as Scrapy or curl or Wget.
- Integrity Check Failed:
These are the smartest bots which mimic a human behaviour. ShieldSquare engine does a few turing tests before they are classified under this category.
These are bots which do not have malicious intent but tend to crawl through the site. These are predominantly used for market intelligence purpose and may help in bringing traffic to your site. These are classified into 5 subcategories.