Compact numerical representations where most values are non-zero, used to encode the meaning of text in a form that computers can compare mathematically.
Performance retention over long documents and conversations