You can use Futhark; it compiles to PyOpenCL and then can be called by python fairly fluently.

Accelerate is a nice example of an array library with a JIT backend.