A way of encoding text where the meaning of each word depends on the words around it, rather than being fixed for every occurrence.
World knowledge accuracy, recall of facts and relationships