So I have a Windows Server 2012. I managed to install Apache 2.4 as a service and it's running.
Is Magento and PHP db going to install on this box or do I need a different OS?
Quite frankly, unless you're very competent Windows DevOps with black belt in Magento you're in the world of pain. While it's technically possible to run Magento on Microsoft stack, it's never meant to. Do youself a favor and use some kind of Linux instead (Ubuntu, Debian and CentOS being most common, but pretty much all of them work just fine, so pick your poison).