One of the websites gets extreme bandwidth

Vanja

Verified User
Joined
Feb 2, 2024
Messages
14
Hey guys,
I have a website that gets 100Gb of traffic but this isn't a busy website. Its a WordPress and it's completely clean and protected with totally blocking the login page (except for my IP). I have checked every single file on that website manually (images too), in hope I can find anything suspicious but nothing.
There is a firewall installed and its capturing a few blocks a day. Still the website gets a lot of bandwidth.
Is there a way in Direct Admin to see an exact file activity for the website?
 
I had something like that, and found out it were a couple of bots eating all the bandwith.
You could go into the user account and then check the website traffic with AWstats for example, look which ip's are eating the most bandwidth.
Also check the /var/log/httpd/domains/domain.com.log file to check if you see long lists with the same ip in a row.

In case of my customer it was facebook bot which for some reason eat everything, while he didn't even have a FB page.
If it's the facebook bot, don't bother using robots.txt as the FB bot decides itself if it listens to it or not, and often does not, so in that case you have to block that one in .htaccess for example.
I also had an amazon bot on my personal hobby site which did the same.
 
I had something like that, and found out it were a couple of bots eating all the bandwith.
You could go into the user account and then check the website traffic with AWstats for example, look which ip's are eating the most bandwidth.
Also check the /var/log/httpd/domains/domain.com.log file to check if you see long lists with the same ip in a row.

In case of my customer it was facebook bot which for some reason eat everything, while he didn't even have a FB page.
If it's the facebook bot, don't bother using robots.txt as the FB bot decides itself if it listens to it or not, and often does not, so in that case you have to block that one in .htaccess for example.
I also had an amazon bot on my personal hobby site which did the same.
Thanks Richard,
I did block that FB bot iP as it was indeed so active and was hitting the various files constantly.
I did some additional amazon bots IP's but there are too many of those.
Do you know when the bandwith counter resets in Direct Admin as I think its been building for maybe longer than a month.
To my understanding it should reset once a month? Or maybe I am wrong?
 
Back
Top