How to: Block nuisance website traffic
How to: Block nuisance website traffic
This guide will: Explain how to enable the platform’s anti-bot feature, and which nuisance bots we currently block.
Contents:
Overview:
Bad traffic can increase server load, using resources and putting additional strain on bandwidth - which can result in downtime. We’ve made it easy to block this nuisance traffic, which will keep bots, scrapers and crawlers from accessing your websites on your server.
How to enable the feature:
-
From the server’s dashboard, select ‘Security’ and scroll down to ‘Block Nuisance Website Traffic’.
-
Toggle-on the feature, then update the config file to enable it.
Note: Please be aware that this function will not block sites like Google and Bing from accessing the sites on your server.
Blocked bots list:
Here is the known bots list that we currently block from viewing your websites:
360Spider
404checker
404enemy
80legs
Abonti
Aboundex
Aboundexbot
Acunetix
ADmantX
AfD-Verbotsverfahren
AhrefsBot
AIBOT
AiHitBot
Aipbot
Alexibot
Alligator
AllSubmitter
AlphaBot
Anarchie
Ankit
Apexoo
archive.org_bot
arquivo.pt
arquivo-web-crawler
Aspiegel
ASPSeek
Asterias
Attach
autoemailspider
AwarioRssBot
AwarioSmartBot
BackDoorBot
Backlink-Ceck
backlink-check
BacklinkCrawler
BackStreet
BackWeb
Badass
Bandit
Barkrowler
BatchFTP
BattleztarBazinga
BBBike
BDCbot
BDFetch
BetaBot
Bigfoot
Bitacle
Blackboard
BlackHole
BlackWidow
BLEXBot
Blow
BlowFish
Boardreader
Bolt
BotALot
Brandprotect
Brandwatch
Buddy
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
BuzzSumo
Calculon
CATExplorador
CazoodleBot
CCBot
Cegbfeieh
CheeseBot
CherryPicker
CheTeam
ChinaClaw
Chlooe
Claritybot
Cliqzbot
Cloudmapping
coccocbot-web
Cogentbot
cognitiveseo
Collector
com.plumanalytics
Copier
CopyRightCheck
Copyscape
Cosmos
Craftbot
crawler4j
crawler.feedback
crawl.sogou.com
CrazyWebCrawler
Crescent
CrunchBot
CSHttp
Curious
Custo
DatabaseDriverMysqli
DataCha0s
DBLBot
demandbase-bot
Demon
Deusu
Devil
Digincore
DigitalPebble
DIIbot
Dirbuster
Disco
Discobot
Discoverybot
Dispatch
DittoSpyder
DnyzBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainsProject
domainsproject.org
DomainStatsBot
Dotbot
DownloadWonder
Dragonfly
Drip
DSearch
DTSAgent
EasyDL
Ebingbong
eCatch
ECCP/1.0
Ecxi
EirGrabber
EMailSiphon
EMailWolf
EroCrawler
evc-batch
Evil
Exabot
ExpressWebPictures
ExtLinksBot
Extractor
ExtractorPro
ExtremePictureFinder
EyeNetIE
Ezooms
facebookscraper
FDM
FemtosearchBot
FHscan
Fimap
Firefox/7.0
FlashGet
Flunky
Foobot
Freeuploader
FrontPage
FyberSpider
Fyrebot
GalaxyBot
Genieo
GermCrawler
Getintent
GetRight
GetWeb
Gigablast
Gigabot
G-i-g-a-b-o-t
Go-Ahead-Got-It
Gotit
GoZilla
Go!Zilla
Grabber
GrabNet
Grafula
GrapeFX
GrapeshotCrawler
GridBot
GT::WWW
Haansoft
HaosouSpider
Harvest
Havij
HEADMasterSEO
heritrix
Hloader
HMView
HTMLparser
HTTP::Lite
HTTrack
Humanlinks
HybridBot
Iblog
IDBot
Id-search
IlseBot
ImageFetch
ImageSucker
IndeedBot
IndyLibrary
InfoNaviRobot
InfoTekies
instabid
Intelliseek
InterGET
InternetNinja
InternetSeer
internetVistamonitor
ips-agent
Iria
IRLbot
Iskanie
IstellaBot
JamesBOT
Jbrofuzz
JennyBot
JetCar
Jetty
JikeSpider
JOCWebSpider
Joomla
Jorgee
JustView
Jyxobot
KenjinSpider
KeywordDensity
Kinza
Kozmosbot
Lanshanbot
Larbin
LeechFTP
LeechGet
LexiBot
Lftp
LibWeb
Libwhisker
LieBaoFast
Lightspeedsystems
Likse
Linkdexbot
LinkextractorPro
LinkpadBot
LinkScan
LinksManager
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
LipperheySpider
Litemage_walker
Lmspider
LNSpiderguy
Ltx71
lwp-request
LWP::Simple
lwp-trivial
Magnet
Mag-Net
magpie-crawler
Mail.RU_Bot
Majestic12
Majestic-SEO
MajesticSEO
MarkMonitor
MarkWatch
Masscan
MassDownloader
MataHari
MauiBot
Mb2345Browser
meanpathbot
Mediatoolkitbot
mediawords
MegaIndex.ru
Metauri
MFC_Tear_Sample
MicroMessenger
MicrosoftDataAccess
MicrosoftURLControl
MIDowntool
MIIxpc
MisterPiX
MJ12bot
Mojeek
Mojolicious
MorfeusFuckingScanner
MQQBrowser
Mr.4x3
MSFrontPage
MSIECrawler
Msrabot
muhstik-scan
Musobot
NameIntelligence
Nameprotect
Navroad
NearSite
Needle
Nessus
NetAnts
Netcraft
netEstateNECrawler
NetLyzer
NetMechanic
NetSpider
Nettrack
NetVampire
Netvibes
NetZIP
NextGenSearchBot
Nibbler
NICErsPRO
Niki-bot
Nikto
NimbleCrawler
Nimbostratus
Ninja
Nmap
NPbot
Nutch
Octopus
OfflineExplorer
OfflineNavigator
OnCrawl
Openfind
OpenLinkProfiler
Openvas
OPPOA33
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
PageAnalyzer
PageGrabber
pagescorer
Pandalytics
Panscient
PapaFoto
Pavuk
pcBrowser
PECL::HTTP
PeoplePal
PHPCrawl
Picscout
Picsearch
PictureFinder
Pimonster
Pi-Monster
Pixray
PleaseCrawl
plumanalytics
Pockey
POE-Component-Client-HTTP
polarisversion
Probethenet
ProPowerBot
ProWebWalker
Psbot
Pump
PxBroker
PyCurl
QueryNMetasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
Rankivabot
RankurBot
RealDownload
Reaper
RebelMouse
Recorder
RedesScrapy
ReGet
RepoMonkey
Ripper
RocketCrawler
Rogerbot
RSSingBot
s1z.ru
SalesIntelligent
SBIder
ScanAlert
Scanbot
scan.lol
ScoutJet
Scrapy
Screaming
ScreenerBot
Searchestate
SearchmetricsBot
Semrush
SemrushBot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
Seomoz
SEOprofiler
seoscanners
SeoSiteCheckup
SEOstats
serpstatbot
sexsearcher
Shodan
Siphon
SISTRIX
Sitebeam
SiteExplorer
Siteimprove
SiteLockSpider
SiteSnagger
SiteSucker
Sitevigil
SlySearch
SmartDownload
SMTBot
Snake
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
sogouspider
Sogouwebspider
Sosospider
Sottopop
SpaceBison
Spammen
SpankBot
Spanner
sp_auditbot
Spbot
Spinn3r
SputnikBot
spyfu
Sqlmap
Sqlworm
Sqworm
Steeler
Stripper
Sucker
Sucuri
SuperBot
SuperHTTP
Surfbot
SurveyBot
Suzuran
Swiftbot
sysscan
Szukacz
T0PHackTeam
T8Abot
tAkeOut
Teleport
TeleportPro
Telesoft
Telesphoreo
Telesphorep
TheIntraformant
TheNomad
Thumbor
TightTwatBot
Titan
Toata
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
trendiction.com
trendiction.de
True_Robot
Turingos
Turnitin
TurnitinBot
TwengaBot
Twice
Typhoeus
UnisterBot
Upflow
URLy.Warning
URLyWarning
Vacuum
Vagabondo
VBProject
VCI
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
Voil
Voltron
Wallpapers/3.0
WallpapersHD
WASALive-Bot
WBSearchBot
Webalta
WebAuto
WebBandit
WebCollage
WebCopier
WEBDAV
WebEnhancer
WebFetch
WebFuck
WebGoIS
WebImageCollector
WebLeacher
WebmasterWorldForumBot
webmeup-crawler
WebPix
WebReaper
WebSauger
Webshag
WebsiteExtractor
WebsiteQuester
Webster
WebStripper
WebSucker
WebWhacker
WebZIP
WeSEE
Whack
Whacker
Whatweb
Who.isBot
Widow
WinHTTrack
WiseGuysRobot
WISENutbot
Wonderbot
Woobot
Wotbox
Wprecon
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
x09Mozilla
x22Mozilla
Xaldon_WebSpider
XaldonWebSpider
Xenu
xpymep1.exe
YoudaoBot
Zade
Zauba
zauba.io
Zermelo
Zeus
zgrab
Zitebot
ZmEu
ZumBot
ZyBorg
Mozlila
isitwp.com
satoristudio.net
SiteCheckerBotCrawler
sitechecker.pro
Video tutorial:
Still having issues?
Further reading:
- KB ARTICLE or
- BLOG LINK
Updated 16 days ago