I caught my boss snooping in my email?

I usually keep my email pword protected, but recently I had problems w/my PC & my OS had to be reinstalled. I neglected to reinstall the pword protection on my .pst files. I have remote access to my PC via LogMeIn & one day I called in sick. I was well enough to periodically check my email & I accessed my PC remotely. I found someone was @ my PC & was going thru my email & viewed a correspondence I had w/a potential other employer. (I am ALWAYS looking at other jobs -- it keeps me sharp). I called a co worker & asked if the boss was sitting at my PC & she said yes. I have since reinstated the pword protection so he can no longer do that. But what should I do now? We are a v/small org. & there is no sys. admin -- I am it, so I am not worried about hi tech espionage on my personal stuff. Should I confront him? He knows I have remote access. I don't think there is anything wrong with keeping up w/the job mkt, either, but don't relish having to defend that concept for myself