No institution is going to sign a contract like that. There are more people who would be happy to speak at events like this than speaking slots. If you demand a contract that says "you can't disinvite me," they're just going to move to the next person on the list.