I think I press Esc at times when I want to de-select something, or think I have a drop-down menu focused but don't actually.
I don't use Outlook so am not used to Esc closing windows.
Would probably prefer a Ctrl+W shortcut to close the window, akin to Explorer or most web browsers.