How to tokenize a text using RSyntaxText TokenMaker?

92 views Asked by At

I would like to just tokenize a text using RSyntaxtText's TokenMaker class. TokenMaker.getTokenList looks promising, however it only works for a single line and I'm a little bit worried that tokenizing a complete file isn't just calling this method for every line of the file (multi-line comments, opening/closing curly-braces, ...).

How would a minimal portion of code look like which properly tokenizes e.g. a Java file?

0

There are 0 answers