Module com.maroontress.clione
Package com.maroontress.clione.impl
package com.maroontress.clione.impl
This package provides the implementation of a lexical parser that must
not be exported outside the module.
-
ClassDescriptionAn abstract
Reader
with the only one abstract method that isReader.read()
.The mapping of one or more characters to a tokenizer.The function that that takes a character and returns a tokenizer associated with the character.Provides immutableSet
objects of a character and utility methods for determining a character's category (that is letter, digit, and so on).The default implementation ofLexicalParser
.The implementation of a preprocessing token.The function that changes the state of the specifiedTranscriber
object with the specifiedSourceChar
object, lets theTranscriber
object read characters from its source and store a new token in its builder, and returns the token type of the stored token.Provides the facility of digraph substitution.Represents the abstract EOF.This source reads characters from upstream source, replacing trigraph sequences with the character that they represent.This source reads characters from upstream source, splicing lines ended with the backslash (\).This source reads characters from upstream reader, counting the line and column number.Provides the stream of the source file.The factory ofSourceChar
objects.Provides mappers that associate a character with a tokenizer.The builder ofToken
objects that has a mutable sequence of characters.The function that changes the state of the specifiedTranscriber
object, lets it read characters from its source and store a new token in its builder, and returns the token type of the stored token.Transcribes a token read from theSource
object into theTokenBuilder
object.This reader substitutes'\n'
for all newlines (LF, CRLF, and CR) in the stream, even if different newlines are mixed in the stream.