User-Agent特征库
爬行特征库（CRAWLERS）
008
ABACHOBot
Accoona-AI-Agent
AddSugarSpiderBot
AnyApexBot
Arachmo
B-l-i-t-z-B-O-T
Baiduspider
BecomeBot
BeslistBot
BillyBobBot
Bimbot
Bingbot
BlitzBOT
boitho.com-dc
boitho.com-robot
btbot
CatchBot
Cerberian Drtrs
Charlotte
ConveraCrawler
cosmos
Covario IDS
DataparkSearch
DiamondBot
Discobot
Dotbot
EARTHCOM.info
EmeraldShield.com WebBot
envolk[ITS]spider
EsperanzaBot
Exabot
FAST Enterprise Crawler
FAST-WebCrawler
FDSE robot
FindLinks
FurlBot
FyberSpider
g2crawler
Gaisbot
GalaxyBot
genieBot
Gigabot
Girafabot
Googlebot
Googlebot-Image
GurujiBot
HappyFunBot
hl_ftien_spider
Holmes
htdig
iaskspider
ia_archiver
iCCrawler
ichiro
igdeSpyder
IRLbot
IssueCrawler
Jaxified Bot
Jyxobot
KoepaBot
L.webis
LapozzBot
Larbin
LDSpider
LexxeBot
Linguee Bot
LinkWalker
lmspider
lwp-trivial
mabontland
magpie-crawler
masscan-ng
Mediapartners-Google
MJ12bot
MLBot
Mnogosearch
mogimogi
MojeekBot
Moreoverbot
Morning Paper
msnbot
MSRBot
MVAClient
mxbot
NetResearchServer
NetSeer Crawler
NewsGator
NG-Search
nicebot
noxtrumbot
Nusearch Spider
NutchCVS
Nymesis
obot
oegp
omgilibot
OmniExplorer_Bot
OOZBOT
Orbiter
PageBitesHyperBot
Peew
polybot
Pompos
PostPost
Psbot
PycURL
Qseero
Radian6
RAMPyBot
RufusBot
SandCrawler
SBIder
ScoutJet
Scrubby
SearchSight
Seekbot
semanticdiscovery
Sensis Web Crawler
SEOChat::Bot
SeznamBot
Shim-Crawler
ShopWiki
Shoula robot
silk
Sitebot
Snappy
sogou spider
Sosospider
Speedy Spider
Sqworm
StackRambler
suggybot
SurveyBot
SynooBot
Teoma
TerrawizBot
TheSuBot
Thumbnail.CZ robot
TinEye
truwoGPS
TurnitinBot
TweetedTimes Bot
TwengaBot
updated
Urlfilebot
Vagabondo
VoilaBot
Vortex
voyager
VYU2
webcollage
Websquash.com
wf84
WoFindeIch Robot
WomlpeFactory
Xaldon_WebSpider
yacy
Yahoo! Slurp
Yahoo! Slurp China
YahooSeeker
YahooSeeker-Testing
YandexBot
YandexImages
YandexMetrika
Yasaklibot
Yeti
YodaoBot
yoogliFetchAgent
YoudaoBot
Zao
Zealbot
zspider
ZyBorg
浏览器指纹（BROWSERS）
ABrowse
Acoo Browser
America Online Browser
AmigaVoyager
AOL
Arora
Avant Browser
Beonex
BonEcho
Browzar
Camino
Charon
Cheshire
Chimera
Chrome
ChromePlus
Classilla
CometBird
Comodo_Dragon
Conkeror
Crazy Browser
Cyberdog
Deepnet Explorer
DeskBrowse
Dillo
Dooble
Edge
Element Browser
Elinks
Enigma Browser
EnigmaFox
Epiphany
Escape
Firebird
Firefox
Fireweb Navigator
Flock
Fluid
Galaxy
Galeon
GranParadiso
GreenBrowser
Hana
HotJava
IBM WebExplorer
IBrowse
iCab
Iceape
IceCat
Iceweasel
iNet Browser
Internet Explorer
iRider
Iron
K-Meleon
K-Ninja
Kapiko
Kazehakase
Kindle Browser
KKman
KMLite
Konqueror
LeechCraft
Links
Lobo
lolifox
Lorentz
Lunascape
Lynx
Madfox
Maxthon
Midori
Minefield
Mozilla
myibrow
MyIE2
Namoroka
Navscape
NCSA_Mosaic
NetNewsWire
NetPositive
Netscape
NetSurf
OmniWeb
Opera
Orca
Oregano
osb-browser
Palemoon
Phoenix
Pogo
Prism
QtWeb Internet Browser
Rekonq
retawq
RockMelt
Safari
SeaMonkey
Shiira
Shiretoko
Sleipnir
SlimBrowser
Stainless
Sundance
Sunrise
surf
Sylera
Tencent Traveler
TenFourFox
theWorld Browser
uzbl
Vimprobable
Vonkeror
w3m
WeltweitimnetzBrowser
WorldWideWeb
Wyzo
手机浏览器指纹（MOBILE BROWSERS）
Android Webkit Browser
BlackBerry
Blazer
Bolt
Browser for S60
Doris
Dorothy
Fennec
Go Browser
IE Mobile
Iris
Maemo Browser
MIB
Minimo
NetFront
Opera Mini
Opera Mobile
SEMC-Browser
Skyfire
TeaShark
Teleca-Obigo
uZard Web
控制台（CONSOLES）
Bunjalloo
Playstation 3
Playstation Portable
Wii
离线浏览器指纹（OFFLINE BROWSERS）
Offline Explorer
SuperBot
Web Downloader
WebCopier
WebZIP
Wget
邮件客户端指纹（E-MAIL CLIENTS）
Thunderbird
链接检查（LINK CHECKERS）
AbiLogicBot
Link Valet
Link Validity Check
LinkExaminer
LinksManager.com_bot
Mojoo Robot
Notifixious
online link validator
Ploetz + Zeller
Reciprocal Link System PRO
REL Link Checker Lite
SiteBar
Vivante Link Checker
W3C-checklink
Xenu Link Sleuth
邮件搜集（E-MAIL COLLECTORS）
EmailSiphon
验证器指纹（VALIDATORS）
CSE HTML Validator
CSSCheck
Cynthia
HTMLParser
P3P Validator
W3C_CSS_Validator_JFouffa
W3C_Validator
WDG_Validator
RSS阅读器指纹（FEED READERS）
Awasu
Bloglines
everyfeed-spider
FeedFetcher-Google
GreatNews
Gregarius
MagpieRSS
NFReader
UniversalFeedParser
爬虫程序代码使用的第三方库指纹（LIBRARIES）
BinGet
cURL
Java
libwww-perl
Microsoft URL Control
Peach
PHP
pxyscand
PycURL
Python-urllib
云平台指纹（CLOUD PLATFORMS）
AppEngine-Google
其他类型指纹（OTHERS）
!Susie
Amaya
Cocoal.icio.us
DomainsDB.net MetaCrawler
gPodder
GSiteCrawler
iTunes
lftp
MetaURI
MT-NewsWatcher
Nitro PDF
Snoopy
URD-MAGPIE
WebCapture
Windows-Media-Player
标签：特征,Bot,Agent,指纹,Validator,Link,User,com,Browser From： https://www.cnblogs.com/autopwn/p/17457090.html