Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

GPT 4 says that the student was late. If you look at the sentence objectively, then the best interpretation is that the submission was late, not that the "professor turned up late", since essays are typically reviewed over multiple days, not at a specific date and time where lateness of the reviewer might be a factor.

Sometimes GPT 4 says that the sentence is ambiguous, but as I explained above, it isn't really, but that takes a lot of understanding of the review process.



The parent comment is taking about two separate prompts: one with only "he" and one with only "she". Your comment sounds like you're only talking about one prompt (but maybe I misunderstood).


Yes, I get that. I tested GPT 4 with both 'she' and 'he', and in both cases it consistently said that the student was late, across several trials for each gender. Once it said it was an ambiguous statement, but it never seemed to be sexist like older or smaller LLMs.


My bad, I should have written [he/she].


That was covered by the "depending on the pronoun" part; your statement didn't make sense otherwise. The response was nonsense.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: