Dense numerical representations of entire sentences that capture their semantic meaning, allowing comparison of how similar different sentences are.
Performance retention over long documents and conversations