A aros Verified User Joined Jan 12, 2017 Messages 28 Apr 11, 2020 #1 Hello Everybody Is it possible to use CWAFPlugin -> userdata -> Blocked Agents for blocking bad robots? If yes, where to find bad robots list? Thanks
Hello Everybody Is it possible to use CWAFPlugin -> userdata -> Blocked Agents for blocking bad robots? If yes, where to find bad robots list? Thanks
O opsshield Verified User Joined Jul 3, 2019 Messages 14 Apr 29, 2020 #2 You can find a quick list from this URL - https://linuxadmin.io/blocking-bad-useragents-modsecurity-fail2ban/ But it is good if you can monitor your logs, identify the new bots and add them to the list
You can find a quick list from this URL - https://linuxadmin.io/blocking-bad-useragents-modsecurity-fail2ban/ But it is good if you can monitor your logs, identify the new bots and add them to the list
J johannes Verified User Joined Feb 18, 2007 Messages 911 Sep 10, 2020 #3 aros said: If yes, where to find bad robots list? Click to expand... Here few lists: http://stopbadbots.com/bots-table/ (4700<) https://pastebin.com/BPRv4TDd (from hackrepair) http://www.botreports.com/badbots/index.shtml (bad bots, crawlsers, scrapers, adverts) https://udger.com/resources/ua-list/crawlers (not only bad bots) https://www.theinternetofbots.com/list-of-bots.php (with scoring to get the most annoying) Last edited: Sep 10, 2020
aros said: If yes, where to find bad robots list? Click to expand... Here few lists: http://stopbadbots.com/bots-table/ (4700<) https://pastebin.com/BPRv4TDd (from hackrepair) http://www.botreports.com/badbots/index.shtml (bad bots, crawlsers, scrapers, adverts) https://udger.com/resources/ua-list/crawlers (not only bad bots) https://www.theinternetofbots.com/list-of-bots.php (with scoring to get the most annoying)