I'm a bit late with my reply. While Alex (zEitEr) makes some good points, I had some other thoughts wheile looking at yor two choices.
I don't like this particular hardware configuration because it uses an Intel I3 processor, which is a desktop processor, not at all optimized for use in servrs, which tend to need larger on-chip cache for adequate server performance. And I don't have enough information on the VPS, since you don't say what VPS platform it uses.
For example, how does the provider map the VPS 'cores' to the actual cores on the server? A vps host (server) can have two six-cord Xeon hardware processors, total 12 cores, and yet nothing stops the provider from setting up ten, twenty, or more, VPS instances, each presenting to the VPS buyer as two cores.
The two servers aren't directly comparable in my opinion. Hopefully you can get more information from the provider concerning what you're getting.
I do notice you're looking for better performance at a better price. So from that point of view, depending on what you're on now, you may want to go to dedicated hardware. I'd want to be sure if gong to a VPS platform to be as isolated as possible from others on the same hardware; otherwise your performance may be at the mercy of how your provider configures hist VPS isntances on his host machines and how your neighbors on the same host behave.
For best performance with all the advantages of a VPS, I'd seriously consider getting a server configured as a VPS host, with one VPS on it (yours), but part of a cluster so you retain some hardware independence. For best hardware independence even have disk space separately on Network Attached Storage with RAID 10 redundancy.
But that may be outside your budget.
Do you currently manage your own server both from root shell and as admin? Otherwise to avoid a huge jump in learning curve you may want to look at a dedicated or virtual resellr account; we've done that for sevral clients who wanted their own machine but none of the management work, and I'm sure other providers do that as well.
Jeff