How does it compare to recombee or AWS personalize? I'm in the market for this but I guess I'm a bit more technical than the people you're selling to and so can use stuff that's a tad lower level?
This smells fishy. If you're experimenting with a typical p < 0.05 (which is often too high for ecommerce optimisation), surely you'd expect to fail 1 in 20 by chance, even if your product is better?