I agree that, in general, it would be good if an empty note that had been started in error did not save but it does. So the only way of removing it is by the standard note deletion process for the app in question.
On mobile the options are limited as you have discovered.