Hi @AndyJH
Everything you said is normal. Adding widget via cms is fine.
With develop mode, you should see real error message instead of 500 internal error.
Go to errors folder (same level with app folder) and turn on local.xml file too. That's also help to see the error.
Best Regards,
Jimmy.