Vector representations where most or all of the numbers contain meaningful information, as opposed to sparse embeddings where most numbers are zero.
Performance retention over long documents and conversations