A process to transform Words within a Language into -dimensional vectors, for easier processing in Language Models.
- Similar words are closer in magnitude to eachother
- Same words with different meanings can have multiple vectors Often done with One Hot Encodings ran through a Look Up Table Matrix