1. Punctuation is part of the learned pattern
DocumentedWhat model makers sayOpenAI explains that language models learn relationships in text and predict likely next tokens; punctuation can be one of those tokens.
What we can inferA model may output an em dash when that mark fits its prompt and surrounding text. This does not tell us why one exact response used it.