I went to school at which about half the students were from outside the country - you can tell pretty obviously when someone is using profanity directed toward you.
Of course, the best is when I ref soccer - I know the meanings of a good portion of swears in Spanish.