The art of tokenizing (Photo: Sergei Zolkin)Iâve decided to create a lexer (a.k.a scanner) for an upcoming hobby project. Before creating the lexer, I wanted to see how a lexer can be implemented in Go. Also important for me was how to implement it with an idiomatic Go usage. During my research Iâve found that in Go land most of the lexers out there are written in two forms (in terms of API usage)


{{#tags}}- {{label}}
{{/tags}}