How to define a custom separator in TLex
TLex does not provide support for user defined separators, hence a possible workaround could be using the MarkedToken(), Mark(), Get(), and Peek() methods for achieving the desired results.
// As an example taking "," as a separator.
_LIT8(KSomeConstString, "first, second, third, fourth,");
while((ch = lex.Get()) != 0 )
while ((ch = lex.Peek()) != ',')
/* Now we have the string as the token,
* do something.. */