If you remove the cert exim, dovecot, nginx/apache and directadmin will fail to start after a reboot or on restart. You should replace it with another cert, but not to remove.
Just go to your SSL page of Directadmin, choose SSL and then choose "use the server's certificate", then the default server certificate which was used before Letsencrypt will be used again.