Perhaps, but "negative one" would sound a little odd to lot of people from certain countries, including the UK, where "minus one" is the standard way of referring to a negative number. We would be perfectly okay with hearing "three minus minus two" in mathematical context.
The distinction is useful when reading aloud expressions like 3-(-2) as "three minus negative two".