Landlord Breach of Lease?

I walked out of my bathroom to find a strange man standing in my living room last night. He said he worked for my landlord and my landlord told him to enter my unit. He had my keys in his hand. I didn't receive any notice, via email or phone. He didn't knock or announce his entry. I have never been in arrears with my rent and have maintained my unit properly. I contacted her and she said she made a mistake and told him to go to the wrong unit. I am a single parent and very distressed over this situation. I feel unsafe and want to move out but don't want to pay anything to move out. My lease doesn't say anything about if my Landlord enters unlawfully, only if I "refuse to let them in" with reasonable notice. Can i move out without penalty?