xo-tokenizer: + doc for tokenizer + other doc-related improvements

This commit is contained in:
Roland Conybeare 2025-06-25 23:50:30 -05:00
commit 573afb6030
9 changed files with 143 additions and 30 deletions

View file

@ -35,9 +35,10 @@ Context
allowmixing
object tkz1<<tokenizer>>
tkz : input_state
tkz1 : input_state = ins1
object ins1<<input_state>>
ins1 : current_line = (9 * 8)
tkz1 o-- ins1
@ -54,9 +55,14 @@ Class
Instance Variables
------------------
.. doxygenclass:: tokenizer-instance-vars
.. doxygengroup:: tokenizer-instance-vars
Constructors
------------
.. doxygengroup:: tokenizer-ctors
Methods
-------
.. doxygengroup:: tokenizer-general-methods