Publication: CATS Newsletter
Pub Details: CATS v8 n9 (Volume 8, Issue 9)
Date: February 1991
Pages: 6-8
The first part of any translator or compiler, is the lexical analyser. A lexical analyser takes the “words” of a program and breaks them up into parts that understands. It separates the operators ( +, =, *, etc) , the reserved words (FORWARD, RIGHT, LEFT, etc) , and variables. It does not check to make sure the program makes any sense. A11 operators and reserved words are broken down to “tokens”. The word FORWARD is translated to just F.