|
Crawlers / Spiders / Bots
Some crawlers/spiders/bots and domains ... have been blocked from the site, if you believe this
is in error then please contact me by email at the address shown on my
"front page".
The current list includes:
Wget SERankingBacklinksBot
ChatGPT BLEXBot
GPTBot MegaIndex
Screaming DotBot
Rogerbot EyeMonIT
SemrushBot MJ12bot
PetalBot StormCrawler
MauiBot DotBot
Bytespider PetalBot
Barkrowler ZoominfoBot
AhrefsBot FriendlyCrawler
MojeekBot SeznamBot
HawaiiBot RewriteCond %{HTTP_USER_AGENT}
|
|
|