"Don't point fingers"

[Freddy]

No problems when it's done by the book (cf. Faceless Pictograph Guy/Girl):
5-4-1.
5 - Upraised open hand subsequent to whistle for violation
4 - Direction play will resume
1 - Location of throw-in (used to be 2, but picto-graph guy changed last year)

A "deal-breaker"? Maybe not with all responsible authorities. But it's promoted as the standard for signaling and just looks good when everyone in the pool does it the same.

As to general pointing, no big deal.

Pointing to the bench of the team who fouled (the "Accusatory Point") when reporting to the table was branded "verboten" and considered unapproved several years ago.

Pointing at the spot of the violation when no approved signal is given is approved by the manual. Nothing impolite about that.