See all articles from CATS v8 n9
The first part of any translator or compiler, is the lexical analyser. A lexical analyser takes the “words” of a program and breaks them up into parts that understands. It separates the operators ( +, =, *, etc) , the reserved words (FORWARD, RIGHT, LEFT, etc) , and variables. It does not check to make sure the program makes any sense. A11 operators and reserved words are broken down to “tokens”. The word FORWARD is translated to just F.