Lexical Analyzer

Learn how to convert human-readable text into machine-readable data using the StringTokenizer and StreamTokenizer classes in Java.

Overview

This project demonstrates lexical analysis by breaking down text into tokens using Java's built-in tokenizing classes. The primary classes used are:

• StringTokenizer
• StreamTokenizer

Files

• LexicalAnalyser.java: Contains the main logic for the lexical analyzer.
• Parse.java: Handles parsing logic.
• LICENSE: The project is licensed under the Apache-2.0 license.

Usage

To run the lexical analyzer:

1. Clone the repository:

   git clone https://github.com/ahmedrafat-SW/Lexical-Analyzer.git

2. Compile the Java files:

   javac LexicalAnalyser.java Parse.java

3. Run the analyzer:

   java LexicalAnalyser

License

This project is licensed under the Apache-2.0 License.

Topics

• Java
• Lexical Analysis
• Compiler Design
• Automata Theory