My family said I have no sense of direction.

This gag lands perfectly thanks to some clever wordplay. The humor hinges on the double meaning of the phrase "where that came from." In a normal conversation, it expresses confusion about the *reason* for a comment or accusation. The joke, however, unexpectedly pivots to the phrase's literal, spatial meaning, as if the speaker is genuinely disoriented and can't locate the physical source of the words being spoken to them.

The setup is universally relatable. Every family seems to have at least one member who is navigationally challenged, a source of endless teasing on road trips or even just walks around a new neighborhood. This joke taps right into that familiar dynamic of lighthearted family criticism. By having the speaker immediately prove the accusation true with their confused reply, the punchline becomes a perfect, self-fulfilling prophecy. It’s a wonderfully simple joke where the character is comically lost in the conversation itself.