Apache cannot restart - Mutex 'n Clamav

sky

sky

Verified User
Joined
Nov 12, 2004
Messages
321
Hello

I am having a litle problem since last update of apache 2.4.4.
Not sure its related, but around midnight, apache died and did not manage to restart.

Apache error logs :
Code: 
[Thu Mar 07 00:22:01.210299 2013] [mpm_prefork:notice] [pid 3893] AH00169: caught SIGTERM, shutting down
[Thu Mar 07 00:22:02.000734 2013] [ssl:notice] [pid 27248] AH01886: SSL FIPS mode disabled
[Thu Mar 07 00:22:02.077768 2013] [ssl:warn] [pid 27248] AH01909: RSA certificate configured for www.example.com:443 does NOT include an ID which matches the server name
[Thu Mar 07 00:22:02.077942 2013] [ssl:warn] [pid 27248] AH01909: RSA certificate configured for shared.domain:443 does NOT include an ID which matches the server name
[Thu Mar 07 00:22:02.077982 2013] [ssl:warn] [pid 27248] AH02292: Init: Name-based SSL virtual hosts only work for clients with TLS server name indication support (RFC 4366)
[Thu Mar 07 00:22:02.077996 2013] [suexec:notice] [pid 27248] AH01232: suEXEC mechanism enabled (wrapper: /usr/sbin/suexec)
[Thu Mar 07 00:22:02.090147 2013] [so:warn] [pid 27248] AH01574: module php5_module is already loaded, skipping
[Thu Mar 07 00:22:02.146058 2013] [auth_digest:notice] [pid 27249] AH01757: generating secret for digest authentication ...
[Thu Mar 07 00:22:03.001379 2013] [ssl:notice] [pid 27249] AH01886: SSL FIPS mode disabled
[Thu Mar 07 00:22:03.071678 2013] [ssl:warn] [pid 27249] AH01909: RSA certificate configured for www.example.com:443 does NOT include an ID which matches the server name
[Thu Mar 07 00:22:03.071854 2013] [ssl:warn] [pid 27249] AH01909: RSA certificate configured for shared.domain:443 does NOT include an ID which matches the server name
[Thu Mar 07 00:22:03.071895 2013] [ssl:warn] [pid 27249] AH02292: Init: Name-based SSL virtual hosts only work for clients with TLS server name indication support (RFC 4366)
[Thu Mar 07 00:22:03.071918 2013] [lbmethod_heartbeat:notice] [pid 27249] AH02282: No slotmem from mod_heartmonitor
[Thu Mar 07 00:22:03.086408 2013] [mpm_prefork:notice] [pid 27249] AH00163: Apache/2.4.4 (Unix) OpenSSL/1.0.0-fips PHP/5.4.12 configured -- resuming normal operations
[Thu Mar 07 00:22:03.086433 2013] [core:notice] [pid 27249] AH00094: Command line: '/usr/sbin/httpd -D SSL'
[Thu Mar 07 07:56:29.808877 2013] [:error] [pid 22940] [client 216.245.197.200:4240] [22940] cannot create mutex /var/tmp/clamav.lock
[Thu Mar 07 07:56:29.808913 2013] [:error] [pid 22940] [client 216.245.197.200:4240] [22940] cannot create mutex /var/tmp/clamav.lock
[Thu Mar 07 09:14:35.436252 2013] [:error] [pid 3393] [client 216.245.197.200:3751] [3393] cannot create mutex /var/tmp/clamav.lock
[Thu Mar 07 09:14:35.436306 2013] [:error] [pid 3393] [client 216.245.197.200:3751] [3393] cannot create mutex /var/tmp/clamav.lock
[Thu Mar 07 10:55:22.321446 2013] [core:notice] [pid 27249] AH00052: child pid 26427 exit signal Segmentation fault (11)
[Thu Mar 07 11:00:01.637252 2013] [core:notice] [pid 27249] AH00052: child pid 27102 exit signal Segmentation fault (11)
[Thu Mar 07 11:54:06.199032 2013] [:error] [pid 7981] [client 216.245.197.200:2664] [7981] cannot create mutex /var/tmp/clamav.lock
[Thu Mar 07 11:54:06.199066 2013] [:error] [pid 7981] [client 216.245.197.200:2664] [7981] cannot create mutex /var/tmp/clamav.lock
[Thu Mar 07 11:55:47.858323 2013] [:error] [pid 8440] [client 216.245.197.200:1437] [8440] cannot create mutex /var/tmp/clamav.lock
[Thu Mar 07 11:55:47.858369 2013] [:error] [pid 8440] [client 216.245.197.200:1437] [8440] cannot create mutex /var/tmp/clamav.lock
[Thu Mar 07 14:28:50.834262 2013] [core:notice] [pid 27249] AH00052: child pid 9024 exit signal Segmentation fault (11)
[Thu Mar 07 17:18:44.395307 2013] [core:notice] [pid 27249] AH00052: child pid 18289 exit signal Segmentation fault (11)
[Thu Mar 07 18:11:06.915813 2013] [core:notice] [pid 27249] AH00052: child pid 32709 exit signal Segmentation fault (11)
[Fri Mar 08 00:08:02.313663 2013] [core:notice] [pid 27249] AH00052: child pid 28251 exit signal Segmentation fault (11)
[Fri Mar 08 00:22:05.290567 2013] [core:warn] [pid 27249] AH00045: child process 6730 still did not exit, sending a SIGTERM
[Fri Mar 08 00:22:13.000657 2013] [ssl:notice] [pid 12077] AH01886: SSL FIPS mode disabled
[Fri Mar 08 00:22:13.055395 2013] [core:emerg] [pid 12077] (28)No space left on device: AH00023: Couldn't create the ssl-cache mutex 
AH00016: Configuration Failed
[Fri Mar 08 00:22:14.001214 2013] [ssl:notice] [pid 12096] AH01886: SSL FIPS mode disabled
[Fri Mar 08 00:22:14.052321 2013] [core:emerg] [pid 12096] (28)No space left on device: AH00023: Couldn't create the ssl-cache mutex 
AH00016: Configuration Failed

The last part repeats it self untill i killed all the running mutex (if i understand correctly) and then managed to restart apache.

Is there a problem with clamav, or mod_heartmonitor, or ssl ?

For information, i used these 2 commands to resolv the problem for the moment :
ipcs -s | grep apache
ipcs -s | grep apache | awk ' { print $2 } ' | xargs -n 1 ipcrm -

Thank-you for your help.
 
Hello

I have not solved the issue.
This happened also wen i updated apache 2.44.

Then again this night.

I just use this cmd : "ipcs -s | grep apache | awk ' { print $2 } ' | xargs -n 1 ipcrm -"
And then start apache.

I did not find that help item, thx, i just executed it, i got a file with lines inside it :)

How can i check the inodes left on /var/tmp ?

Results for a df /var/tmp :
df /var/tmp
Sys. de fichiers 1K-blocs Utilisé Dispo. Uti% Monté sur
/dev/loop0 989184 20140 918796 3% /tmp
Click to expand...

Thanks for your help !!!
 
Last edited:
It seams ok :
/dev/loop0 62848 1698 61150 3% /tmp
 
Well, i cleaned up /var/tmp and i executed that help cmd.
Hope things will be ok now, ill update if not here :)
 
I get this problem, too. Cleaned /var/tmp, restart apache but there is still the message "[lbmethod_heartbeat:notice] [pid 32413] AH02282: No slotmem from mod_heartmonitor"

any suggest?

thanks
 
Hello

I had the problem again.
Solved with this page http://help.directadmin.com/item.php?id=110

Its less than a month since last... why does this happen ?

/tmp and /var/tmp and not full at all ...

Perhaps a reboot of the server would be good ?
Has not been since a year or so...

Thx
 
Yep, same here. Once per couple of days Apache 2.4.4 don't wanna UP after reload ;(

Code: 
(28)No space left on device: AH00023: Couldn't create the ssl-cache mutex

ipcs -s | grep apache | perl -e 'while (<STDIN>) { @a=split(/\s+/); print `ipcrm sem $a[1]`}'

This helps but it's burdensome.
 
It doesn't need to be burdensome, you can always run it nightly in cron.daily. OIr put it into your apache reload code.

Or you can learn the linux kernel, and rebuild it with more available semaphores.

It's not a DirectAdmin issue.

Jeff
 
Same problem here. We can start apache again just after removing the semaphores.

Info from the affected server:

Code: 
[B]$ cat /proc/version[/B]
Linux version 2.6.32-358.6.1.el6.x86_64 ([email protected]) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-3) (GCC) ) #1 SMP Tue Apr 23 19:29:00 UTC 2013

[B]$ httpd -v[/B]
Server version: Apache/2.4.4 (Unix)

[B]$ /usr/local/bin/php -v[/B]
PHP 5.4.16 
(loaded as FastCGI)

[B]$ cat /proc/sys/kernel/{msgmni,sem}[/B]
15677
250     32000   32      128

Anyone have more info about this problem?
If possible, also share the affected system info so we can try to diagnose the problem.
 
You must log in or register to reply here.
Back
Top