Actually had to double check this to make sure it wasn't in the sources. It seems the the encoder basically sees the trees as only having a small difference, but really visually it's quite large. The solution is a better distortion function in the encoder - libaom's is simple but dumb. (luckily this means no decoder or format changes)