They can claim he's an integral safety for the test of the whole self-driving system, and he failed to do his job.

Which would make other safety drivers either think "I have to pay 100 %attention" (which they should, anyway), or "I'm outta here!"