is_bot

Simple PHP function to detect search engines bots and crawlers

it compares the PHP User Agent with a list of common spiders from search engines, more than 200 bots, spiders and crawlers

use $_SERVER['HTTP_USER_AGENT'];

Using this server variable is not enough to block spambots and other kind of traffic, is just for clearly defined user agents

---

Update 2020-08-13

• acebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php)
• SpiderLing (a SPIDER for LINGustic research); +http://nlp.fi.muni.cz/projects/biwec/

Update 2020-07-28

• check_http/v2.2 (monitoring-plugins 2.2)
• Selfoss/2.18 (+https://selfoss.aditu.de)
• Mozilla/5.0 (compatible; Adsbot/3.1)

Update 2020-06-10

• Domains Project
• SerendeputyBot
• Moreover
• DuckDuckGo

Update 2020-04-01

• AHC/2.1
• eCairn-Grabber
• mediawords bot
• PHP-Curl-Class
• Scrapy
• curl/7
• Blackboard
• NetNewsWire
• node-fetch
• admantx
• metadataparser

Update 2019-12-17

• Added Seekport Crawler

Update 2019-10-21

• AwarioSmartBot
• Apache-HttpClient/5

Update 2019-06-28

• Winds: Open Source RSS & Podcast
• dlvr.it
• BehloolBot
• 7Siters

Update 2019-06-19

• DomainStatsBot
• SeznamBot/3.2
• VelenPublicWebCrawler/1.0
• WordPress.com mShots
• adscanner
• BacklinkCrawler
• netEstate NE Crawler
• Astute SRM
• GigablastOpenSource/1.0

Update 2019-06-07

• serpstatbot

Update 2019-05-21

• PocketParser
• newspaper

Update 2019-03-25

• scalaj-http
• XoviBot
• sysomos.com
• Jetslide

Update 2019-02-12

• OnalyticaBot
• Linguee Bot
• admantx-adform
• Buck/2.2
• Barkrowler

Update 2019-02-08

• ZoominfoBot
• Seokicks
• barkrowler
• DuckDuckBot (thanks RaphaelWimmer)

Update 2019-01-24

• axios/0.17.0
• semantic-visions.com crawler;
• webdatastats.com
• AnyEvent-HTTP/2.24;

Update 2018-12-31

• 360Spider
• linkfluence.com
• glutenfreepleasure.com
• Gluten Free Crawler
• YaK/1.0
• Cliqzbot
• app.hypefactors.com

Update 2018-12-27

• semantic-visions.com
• archive.org_bot
• FemtosearchBot

Update 2018-11-27

• SemrushBot
• ltx71
• commoncrawl
• istellabot
• DomainCrawler
• cs.daum.net
• StormCrawler
• GarlikCrawler
• The Knowledge AI
• getstream.io/winds
• YisouSpider
• ScooperBot
• TrendsmapResolver
• Nuzzel
• Go-http-client
• Applebot
• LivelapBot
• GroupHigh