Statistics is based on probability and probability is based on set theory and a concept of measure. Discrete probability may do away without calculus. But it needs some basic understanding of algebra. Concept of probability, imo, is very hard to understand. And then you have conditional probability, which fooled even high ranking mathematicians. Allegedly Paul Erdos didn’t get it until a computer simulation was presented to him [0]. I think venturing into statistics may be left for later. I would agree though that combinatorics can be taught earlier and give a good understanding or discrete probability. I don’t see thought how it can be successfully without algebra and calculus.

[0] https://www.wired.com/2014/11/monty-hall-erdos-limited-minds...