I don't know why Evernote wants to be inconsistent with google and other search engines here. Search engines will search for punctuation if you put it in quotes. Try it #Paul yields all Paul's but "#Paul" yields just the #Paul's. They really should fix this, it is what people expect.
Is this ever going to get fixed? It is really a problem for me.