Their fellow man (or enough of them) will screenshot the product saying outrageous things and post it as proof that your company is bigoted and your product is harmful to society.
Enough users will use the product in bad faith that they have to nerf the output to keep investors happy and their business viable.
It's why open source models have an edge right now. Sam Altman more or less acknowledged this edge recently, saying OAI's products will start to get more flexible on point on view and people need to be ready for that.
Their fellow man (or enough of them) will screenshot the product saying outrageous things and post it as proof that your company is bigoted and your product is harmful to society.
Enough users will use the product in bad faith that they have to nerf the output to keep investors happy and their business viable.
It's why open source models have an edge right now. Sam Altman more or less acknowledged this edge recently, saying OAI's products will start to get more flexible on point on view and people need to be ready for that.