Ongoing problems with CPU Utilization with FreeBSD 12.2

ChiefZigZag

Verified User
Joined
Feb 17, 2020
Messages
47
I have been running directadmin for some time and today I noticed the heavy usage of the system. I checked out the processes and it was overrun by the tr command eating up 100% of the CPU.

last pid: 55997; load averages: 47.73, 49.59, 51.67 up 47+03:34:33 18:24:31
337 processes: 48 running, 238 sleeping, 51 zombie
CPU: 80.8% user, 0.0% nice, 19.2% system, 0.0% interrupt, 0.0% idle
Mem: 548M Active, 222M Inact, 341M Laundry, 8444M Wired, 356M Free
ARC: 6817M Total, 5627M MFU, 561M MRU, 1872K Anon, 42M Header, 585M Other
5534M Compressed, 7661M Uncompressed, 1.38:1 Ratio
Swap: 8192M Total, 275M Used, 7917M Free, 3% Inuse

PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND
83643 root 1 74 0 11M 1776K RUN 0 1:10 10.73% tr
84845 root 1 74 0 11M 1776K RUN 1 1:10 9.65% tr
90432 root 1 74 0 11M 1776K RUN 3 1:11 9.43% tr
87750 root 1 74 0 11M 1776K RUN 3 1:10 9.32% tr
97021 root 1 74 0 11M 1776K RUN 1 1:10 9.29% tr
86682 root 1 74 0 11M 1776K RUN 2 1:11 9.21% tr
65753 root 1 74 0 11M 1776K RUN 3 1:10 9.18% tr
74704 root 1 74 0 11M 1776K RUN 0 1:09 9.16% tr
96536 root 1 74 0 11M 1776K RUN 1 1:10 9.15% tr
63796 root 1 74 0 11M 1776K RUN 2 1:10 9.03% tr
78645 root 1 74 0 11M 1776K RUN 2 1:10 9.02% tr
4458 root 1 74 0 11M 1776K RUN 2 1:10 9.01% tr
3462 root 1 74 0 11M 1776K RUN 2 1:10 8.98% tr
26993 root 1 74 0 11M 1776K RUN 2 1:09 8.95% tr
97788 root 1 74 0 11M 1776K RUN 3 1:10 8.90% tr
75972 root 1 74 0 11M 1776K RUN 1 1:10 8.83% tr
65764 root 1 74 0 11M 1776K RUN 2 1:09 8.81% tr
96904 root 1 74 0 11M 1776K RUN 0 1:10 8.81% tr
2199 root 1 74 0 11M 1776K RUN 2 1:09 8.81% tr
95586 root 1 74 0 11M 1776K CPU3 3 1:09 8.79% tr
76193 root 1 74 0 11M 1776K RUN 1 1:10 8.75% tr
84961 root 1 74 0 11M 1776K RUN 3 1:10 8.74% tr
50066 root 1 74 0 11M 1776K RUN 2 1:11 8.73% tr
77941 root 1 74 0 11M 1792K CPU1 1 1:07 8.69% tr
63499 root 1 74 0 11M 1776K RUN 2 1:09 8.67% tr
90217 root 1 74 0 11M 1776K RUN 2 1:10 8.58% tr
66716 root 1 74 0 11M 1776K RUN 0 1:10 8.58% tr
89774 root 1 74 0 11M 1776K RUN 3 1:10 8.53% tr
23132 root 1 74 0 11M 1776K RUN 0 1:10 8.49% tr
92683 root 1 74 0 11M 1776K CPU0 0 1:10 8.48% tr
80782 root 1 74 0 11M 1776K RUN 3 1:10 8.40% tr
67498 root 1 74 0 11M 1776K RUN 0 1:10 8.40% tr
54801 root 1 74 0 11M 1792K RUN 3 1:08 8.28% tr
89203 root 1 74 0 11M 1776K RUN 0 1:10 8.23% tr
29612 root 1 74 0 11M 1776K RUN 0 1:09 8.14% tr
81137 root 1 74 0 11M 1776K RUN 1 1:09 8.09% tr
87551 root 1 74 0 11M 1776K RUN 1 1:10 8.07% tr
866 root 1 74 0 11M 1776K RUN 3 1:10 7.94% tr
4974 root 1 74 0 11M 1776K RUN 2 1:09 7.80% tr
76965 root 1 74 0 11M 1776K RUN 1 1:10 7.70% tr
81731 root 1 74 0 11M 1776K RUN 0 1:10 7.69% tr
57276 root 1 74 0 11M 1776K RUN 1 1:10 7.37% tr
73559 root 1 74 0 11M 1776K RUN 1 1:10 7.19% tr
82753 root 1 74 0 11M 1776K RUN 1 1:11 7.11% tr
76384 root 1 74 0 11M 1776K RUN 3 1:09 7.09% tr
92805 root 1 74 0 11M 1776K RUN 2 1:10 6.53% tr
85982 root 1 74 0 11M 1776K RUN 3 1:10 5.62% tr
55231 nginx 33 20 0 192M 53M kqread 2 0:02 0.56% nginx
55997 root 1 20 0 14M 3884K CPU2 2 0:00 0.13% top
6096 root 3 20 0 163M 90M select 0 31:51 0.03% vmtoolsd
92421 mysql 35 20 0 730M 299M select 1 16.8H 0.03% mysqld
96135 bind 14 52 0 190M 30M sigwai 3 5:52 0.01% named
56691 admin 1 20 0 20M 6172K select 3 0:00 0.01% sshd
38776 root 1 20 0 221M 15M kqread 2 3:17 0.00% php-fpm74
32120 _pflogd 1 20 0 12M 1388K bpf 3 1:22 0.00% pflogd
36505 root 1 20 0 222M 17M kqread 2 3:04 0.00% php-fpm73
55790 nginx 33 20 0 161M 33M kqread 2 0:02 0.00% nginx
55493 nginx 33 20 0 161M 35M kqread 0 0:01 0.00% nginx
37271 root 1 20 0 11M 1552K select 2 1:45 0.00% syslogd
99247 root 1 20 0 13M 1752K nanslp 3 0:57 0.00% da-popb4smtp
55840 nginx 33 20 0 156M 30M kqread 2 0:00 0.00% nginx
30530 root 1 20 0 10M 628K select 3 2:21 0.00% devd
82831 root 1 20 0 19M 2724K select 1 0:33 0.00% sshd
5711 root 1 21 0 22M 4756K piperd 2 0:32 0.00% dataskq
46299 root 1 20 0 22M 4204K piperd 3 0:31 0.00% dataskq
72245 root 1 20 0 21M 3976K piperd 3 0:31 0.00% dataskq
51012 root 1 21 0 22M 4676K piperd 2 0:31 0.00% dataskq
16617 root 1 21 0 22M 4576K piperd 3 0:31 0.00% dataskq
56758 root 1 21 0 21M 4468K piperd 0 0:31 0.00% dataskq
25517 root 1 20 0 22M 3240K piperd 0 0:31 0.00% dataskq
27304 root 1 21 0 21M 3772K piperd 1 0:31 0.00% dataskq
94438 root 1 20 0 22M 2968K piperd 0 0:31 0.00% dataskq
3373 root 1 21 0 21M 4548K piperd 3 0:31 0.00% dataskq
94861 root 1 21 0 22M 4556K piperd 1 0:31 0.00% dataskq
51113 root 1 21 0 21M 4564K piperd 1 0:31 0.00% dataskq
31027 root 1 24 0 21M 3904K piperd 2 0:31 0.00% dataskq
46072 root 1 21 0 21M 4488K piperd 1 0:31 0.00% dataskq
95277 root 1 21 0 22M 4600K piperd 0 0:31 0.00% dataskq

I then went ahead and killed them all to try to clear up the CPU however this happens..

root@admin:/usr/local/directadmin/custombuild # pkill -9 tr

they all spawn up again and there is a "lego" process what seems to load too.

last pid: 85184; load averages: 48.40, 49.31, 51.40 up 47+03:35:43 18:25:41
320 processes: 20 running, 216 sleeping, 51 zombie, 33 lock
CPU: 78.9% user, 0.0% nice, 21.0% system, 0.0% interrupt, 0.1% idle
Mem: 605M Active, 68M Inact, 550M Laundry, 8222M Wired, 466M Free
ARC: 6716M Total, 5652M MFU, 436M MRU, 901K Anon, 41M Header, 586M Other
5434M Compressed, 7568M Uncompressed, 1.39:1 Ratio
Swap: 8192M Total, 287M Used, 7905M Free, 3% Inuse, 1188K In

PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND
74562 root 1 73 0 11M 1628K RUN 3 0:00 19.09% tr
81959 root 1 73 0 11M 1648K RUN 1 0:00 14.47% tr
95453 root 1 72 0 11M 1656K RUN 2 0:00 12.99% tr
6490 root 1 72 0 11M 1656K RUN 3 0:00 11.84% tr
45990 root 9 26 0 720M 21M uwait 2 0:00 7.24% lego
48249 root 7 28 0 720M 21M uwait 0 0:00 6.31% lego
45901 root 7 30 0 720M 21M uwait 3 0:00 5.96% lego
45671 root 8 26 0 720M 22M uwait 3 0:00 5.31% lego
46180 root 7 25 0 720M 22M kqread 2 0:00 5.29% lego
29402 root 11 52 0 720M 22M uwait 1 0:00 5.26% lego
47928 root 7 26 0 720M 20M RUN 0 0:00 4.67% lego
45836 root 7 26 0 720M 20M kqread 2 0:00 4.62% lego
43890 root 7 26 0 720M 20M uwait 0 0:00 4.62% lego
38768 root 7 52 0 720M 22M uwait 2 0:00 4.50% lego
43695 root 7 52 0 720M 23M uwait 2 0:00 4.44% lego
38567 root 7 26 0 720M 19M uwait 0 0:00 4.44% lego
32702 root 8 25 0 720M 20M kqread 2 0:00 4.41% lego
33087 root 7 26 0 720M 21M kqread 1 0:00 4.40% lego
37654 root 7 45 0 720M 20M uwait 0 0:00 4.39% lego
36432 root 8 25 0 720M 20M uwait 1 0:00 4.39% lego
47313 root 7 31 0 720M 20M uwait 3 0:00 1.83% lego
65663 root 1 52 0 12M 2164K piperd 1 0:00 1.15% sh
44577 root 1 20 0 14M 3308K CPU0 0 0:00 1.10% top
94438 root 1 52 0 21M 3308K piperd 3 0:31 0.86% dataskq
27304 root 1 52 0 21M 3236K piperd 3 0:31 0.86% dataskq
46299 root 1 52 0 21M 4140K piperd 1 0:31 0.83% dataskq
46072 root 1 52 0 21M 3464K piperd 3 0:31 0.82% dataskq
17443 root 1 52 0 21M 4072K piperd 3 0:31 0.82% dataskq
94995 root 1 52 0 21M 4140K piperd 2 0:31 0.82% dataskq
73491 root 1 52 0 21M 3360K piperd 2 0:30 0.82% dataskq
3373 root 1 52 0 21M 3568K piperd 0 0:31 0.80% dataskq
25517 root 1 72 0 21M 3352K *vm ob 2 0:31 0.80% dataskq
6608 root 1 52 0 21M 4124K piperd 2 0:31 0.79% dataskq
7345 root 1 52 0 21M 4156K piperd 2 0:30 0.79% dataskq
51113 root 1 52 0 21M 3456K piperd 3 0:31 0.78% dataskq
73549 root 1 52 0 21M 3292K piperd 0 0:30 0.77% dataskq
62588 root 1 52 0 21M 4152K piperd 3 0:31 0.77% dataskq
19567 root 1 52 0 21M 3416K piperd 3 0:29 0.76% dataskq
91714 root 1 52 0 21M 3408K piperd 0 0:29 0.76% dataskq
16617 root 1 52 0 21M 4192K piperd 1 0:31 0.71% dataskq
81446 root 1 72 0 21M 3512K *vm ob 0 0:31 0.71% dataskq
43719 root 1 52 0 21M 3272K wait 3 0:30 0.64% dataskq
87450 root 1 52 0 21M 3364K wait 1 0:31 0.63% dataskq
67719 root 1 52 0 21M 3316K wait 3 0:30 0.58% dataskq
82235 root 1 52 0 21M 3368K wait 2 0:30 0.58% dataskq
95277 root 1 72 0 21M 4164K *vm ob 3 0:31 0.56% dataskq
26540 root 1 52 0 21M 4220K wait 0 0:31 0.40% dataskq


Any thoughts?

I may need to reboot this is there anything I can do to troubleshoot? The server is basically running like garbage right now.
 
Back
Top