If it's a plugin then yes, you would usually have to run it through a host application as a VST or DXi instrument - cubase/fruityloops/logic etc etc

Some synths are 'standalone' - is there an .exe or just a .dll file ?

Chances are you can't run it alone, though personally I don't know that 100% - just most things don't offer 'standalone' functionality.