I wouldn't worry about it hes probably just messin with you.
Hmmm, its pretty freaky he new that you restarted your computer. But really. Unless you told him anything or send/recieve a file or somehow got your ip, you should be totaly fine. Give him the ol' f off.