If your kid said that to you in a rage, that would be pretty hurtful, right?
But if your spouse said that to you in a teasing way after you play a(n innocuous) practical joke on them, that’s a totally different tone.
And in Chinese, the word “??????” (t??oyàn) meaning “hate” or “dislike” or “annoying” has both flavors, though it leans much more heavily toward the latter (playful, not serious).
For example, if a boyfriend teases his girlfriend she may say, “???????????????” (N?? h??o t??oyàn!) aka You’re so annoying!