Maybe I should be smugger about myself having kids, but it was really meant as nothing else as a lightheaded remark. From my own perspective of course - there is clearly my (nick)name over it.
Sure, and if it was just your comment it wouldn't annoy me. But these sorts of comments about non-parents from parents are constant. I totally parents that they enjoy having kids--why is it so implausible to parents that I can equally enjoy not having kids?
I didn't read their comment as smugness.