I have the same problem. Brand new Windows and EN installation. Pressing the X does not close EN, but simply minimizes it to the taskbar. There is no option to change or disable it.
Its a shame though. I was trying EN for the first time on recommendation from a colleague, and so far this is a complete no-no from me.