Your comment is at the bottom of a long page, which adds latency to it being reviewed. When it's in the positive it gets downvotes by people who didn't think it was very funny and people who don't want to encourage that kind of joking. When it's negative it gets sympathy upvotes, like the one I just gave you.