Tokenizer

A part of the Interpreter that is responsible for breaking down the source-code text into C Enums tokens. Performs Lexical Analysis.

Guides

https://www.youtube.com/watch?v=5zkDwZs5Y-s