lex
Performs "lexing" on the given code string, i.e., it breaks it into tokens.
abstract fun lex(inputStream: InputStream, charset: Charset = Charsets.UTF_8, onlyFromDefaultChannel: Boolean = true): LexingResult<T>
Performs "lexing" on the given code stream, i.e., it breaks it into tokens.