Big reseller account issue

D

Djunity

Verified User
Joined
Mar 9, 2008
Messages
243
Location
Holland
Hi all,

We are currently facing a big issue with one of or customers reseller accounts.

The server load is high becouse of this account memory only 75% use cpu's 50% but load is about 8.
When running the nightly admin backups the load spikes higher and will take about 10 till 15 hour to complete.
Removing this reseller will take up to 1 hour and restoring a backup from this reseller takes up to 7 hours.

The backup file of this user was only 300Mb but it had a DB off 1.5Gb so we thought that was the problem so we removed this cache DB.
creating a backup of this account is now quick less then 15 minutes and only 80Mb in size but removing the user still takes up to 30 minutus and restore doesn work.

We looked at the dataskq.error.log but no strange messages there an the latest attempt to restore started last evening and still isnt completed we dont have a message from da and the domains are not added to the zone and web data is missing.

So obbiosly there is some thing wrong but where not sure what and we thing the restore some how creates a stall or loop in the dataskq somehow.

Additional when trying to restore the user the memory use doesnt get more nor does the cpu usage but the system load is going up in about 4 hours it goes from a load of 1.0 to 200.0 +.
Altho the load gets to 200 the server will respond slower but you can still access it and do stuff.
The user is added to the reseller list but not in the list of all users in dns its added also on apache but domains are offline and webdata isnt restored from backup.

This reseller doens't have any user accounts only about 30 domains in it own user level

Any one knows maybe what we can check more ?
 
Last edited:
Hello,

The biggest resource/load hog that I've seen is when there are Maildir folders with tens of thousands of unread emails..
The files are small, but their quantity is what causes the load spike.

While the dataskq runs and seems stuck, you can type:
Code: 
killall -USR1 dataskq
then type:
Code: 
tail -n 10 /var/log/directadmin/errortaskq.log
This should tell us what it's up to.
You can repeat the USR1 kill multiple times to keep track of it as it runs.
Related on dataskq load:
http://help.directadmin.com/item.php?id=402

The ionice program can help lower the load.. but that won't speed up the process at all:
http://www.directadmin.com/features.php?id=1423

Related guide on slow backups:
http://help.directadmin.com/item.php?id=335


But if it comes down to an over-sized email account, then the issue would be to simply remove the unread email accounts.


Also check:
Code: 
top
to see how much swap ram is being used. If it's anything more than a few Meg, then it's hitting the swap memory which will make the system run very slowly.
Add more ram, if possible.


John
 
DirectAdmin Support said:
Hello,

The biggest resource/load hog that I've seen is when there are Maildir folders with tens of thousands of unread emails..
The files are small, but their quantity is what causes the load spike.

While the dataskq runs and seems stuck, you can type:
Code: 
killall -USR1 dataskq
then type:
Code: 
tail -n 10 /var/log/directadmin/errortaskq.log
This should tell us what it's up to.
You can repeat the USR1 kill multiple times to keep track of it as it runs.
Related on dataskq load:
http://help.directadmin.com/item.php?id=402

The ionice program can help lower the load.. but that won't speed up the process at all:
http://www.directadmin.com/features.php?id=1423

Related guide on slow backups:
http://help.directadmin.com/item.php?id=335


But if it comes down to an over-sized email account, then the issue would be to simply remove the unread email accounts.


Also check:
Code: 
top
to see how much swap ram is being used. If it's anything more than a few Meg, then it's hitting the swap memory which will make the system run very slowly.
Add more ram, if possible.


John
Click to expand...

Hi john,

Ok i have try'd the mothodes you descript incl the kill and tail the log but that didnt show anything.

However you mention large email box im gona investigate this point becouse i thinks this might be the issue couse the hom.tar.gz contains 60K+ files

ill respond later
 
This becomes a problem more and more, as users have large imap accounts. One of our servers runs a daily backup which consumes almost 20 hours of a 24-hour day. I'm not sure yet how to resolve the problem and still allow users to store IMAP on their servers.

The only thing I've done is started to move all users with large IMAP stores to our newest servers, with multiple processors, plenty of memory, and lots of extra space.

Anyone have any other suggestions?

Jeff
 
Not really a suggestion, I just wanted to mention that I do not have this problem regarding backups, because I use R1Soft/Idera to make daily backups. I only use "Admin Backup/Transfer" to make daily backups of all the databases (so that they are included in the backup transfer done with R1Soft/Idera. Only time I will use DirectAdmin "Admin Backup/Transfer" to make a full backup of user accounts, is when/if I transfer a user account to another server.
 
1) I'm about 1/2 way done implementing inode limits in Reseller/User packages, along side the existing quota options.
This should help "cap" runaway email accounts... but does have a side-effect in that, similar to reaching the quota limit, it blocks further file creation.
http://www.directadmin.com/features.php?id=1445


2) I was also thinking of adding a check where DA counts the number of files in the email Maildir folders, and throw a warning if an account is over a threshold.
Shouldn't be too hard to implement if people could use it.

John
 
Hello,

Step 4 of this guide:
http://help.directadmin.com/item.php?id=335

explain how to select different aspects of the accounts.

You could create multiple different backups into different paths with the opposite options (one for everything, less email, the 2nd for just email).

Or.. create backup crons for everything except email, and use rsync for the ~/imap email data, which would be far more efficient.

But be sure to still include the "E-Mail Accounts" in the backup.. only exclude the "E-Mail Data".

John
 
ditto said:
Not really a suggestion, I just wanted to mention that I do not have this problem regarding backups, because I use R1Soft/Idera to make daily backups.
Click to expand...
Looks like it could be a good suggestion. Do you use Idera's free backup? Or the commercial product for service providers? Have you ever used it for a bare-metal restore?

Jeff
 
The datacenter wich I rent all my dedicated servers, offers R1Soft/Idera for a extra fee (I pay them for the amount GB I need for each server), so I do not have my own license for R1Soft/Idera.

Yes, I have needed to use the bare metal restore, and it did work very well, and there was no problems. This happen when I needed to replace two failing hard drives in a hardeware raid 10, but it did not work, and failed, and then I needed to restore using bare metal restore to my new hard drives. It works.

R1Soft/Idera do have a addon (cost extra money) to MySQL backups, but I do not use it. I don't trust that addon to much, because I have read bad things about it. So I save those money, and use DirectAdmin to make daily backups of all mysql databases.

Also R1Soft/Idera has a DirectAdmin module (wich is free, don't cost extra), wich let the end user in DirectAdmin have access to their backups. I just give my clients the URL to the backup server, then they can log into R1Soft/Idera with the same username/password that they use to log into DirectAdmin. They then have access to 48 days of backups, wich can be downloaded to home computer, or restored directly to the server.

Only thing to remember is that you need to install the kernel module from R1Soft/Idera on your dedicated server again each time you have installed a new kernel version.
 
ditto said:
Yes, I have needed to use the bare metal restore, and it did work very well, and there was no problems. This happen when I needed to replace two failing hard drives in a hardeware raid 10, but it did not work, and failed, and then I needed to restore using bare metal restore to my new hard drives. It works.
Click to expand...
Sounds as if it may be worth the money. I'm going to look into it.
R1Soft/Idera do have a addon (cost extra money) to MySQL backups, but I do not use it. I don't trust that addon to much, because I have read bad things about it. So I save those money, and use DirectAdmin to make daily backups of all mysql databases.
Click to expand...
I'm thinking you're right; best to just use DirectAdmin to back up the MySQL, and put the backups where R1Soft/Idera will back them up.
Also R1Soft/Idera has a DirectAdmin module (wich is free, don't cost extra), wich let the end user in DirectAdmin have access to their backups. I just give my clients the URL to the backup server, then they can log into R1Soft/Idera with the same username/password that they use to log into DirectAdmin. They then have access to 48 days of backups, wich can be downloaded to home computer, or restored directly to the server.
Click to expand...
Very interesting. Have you insalled the DirectAdmin module? Does it appear to work well?

Care to write some How-Tos for us :) ?

Jeff
 
You must log in or register to reply here.
Back
Top