Unless you are using the "url-safe" variant (rfc 4648)
And the RFC explicitly says:
Implementations MUST reject the encoded data if it contains characters outside the base alphabet
Unless you are using the "url-safe" variant (rfc 4648)