Can I switch around the primary and secondary php version without recompiling?

I'm trying to open phpmyadmin but I get the error that I need to run php 5.5 or newer.
We are currently running php 5.3 as primairy php version and php 5.5 as secondary php version.
currently my options.conf in /usr/local/directadmin/custombuild looks like this:

#PHP Settings
php1_release=5.3
php1_mode=mod_php
php2_release=5.5
php2_mode=fastcgi

Can I set 5.5 as primary and 5.3 as secondary release without recompiling php?

No, after you change a PHP version in the CustomBuild options you need to recompile.