22 lines
562 B
ReStructuredText
22 lines
562 B
ReStructuredText
.. xo-tokenizer documentation master file.
|
|
|
|
Xo-tokenizer documentation
|
|
==========================
|
|
|
|
xo-tokenizer provides a tokenizer for the Schematika language.
|
|
|
|
Syntax is generally C-like, but with some important differences.
|
|
Notably, characters used for arithmetic operators (``+``, ``-``, ``*``, ``/``)
|
|
may appear in variable names: ``one-of-those-days`` is an ordinary symbol.
|
|
|
|
.. toctree::
|
|
:maxdepth: 2
|
|
:caption: xo-tokenizer contents
|
|
|
|
install
|
|
examples
|
|
implementation
|
|
token-class
|
|
tokenizer-error-class
|
|
span-class
|
|
tokentype-enum
|