What can i do if someone talks in a condescending manner to me and I did nothing wrong?

I've been in that situation many times. I normally just smile or smirk and not say anything, then walk away. Some people purposely try to agitate you into some sort of debate/confrontation, but when they see their plan don't work they'd get angry that they failed.