That's in fact the viewpoint Lorentz took when he discovered the Lorentz transform and relativity. He showed that you can make an ether (i.e. a preferred reference frame) consistent with the observations by applying Lorentz transforms to the observations of anybody who is in a different reference frame.