miniCOIL is a contextualized per-word embedding model. It generates extremely small embeddings (8dim or even 4dim) while still preserving the word's context for each word in a sentence.

GitHub https://github.com/qdrant/miniCOIL HuggingFace https://huggingface.co/Qdrant/minicoil-v1