Roland Conybeare
1f981a0636
subrepo: subdir: "xo-tokenizer" merged: "6e665ed7" upstream: origin: "git@github.com:Rconybea/xo-tokenizer.git" branch: "main" commit: "6e665ed7" git-subrepo: version: "0.4.9" origin: "???" commit: "???"
38 lines
1 KiB
ReStructuredText
38 lines
1 KiB
ReStructuredText
.. _implementation:
|
|
|
|
.. toctree::
|
|
:maxdepth: 2
|
|
|
|
Components
|
|
==========
|
|
|
|
Library dependency tower for *xo-tokenizer*:
|
|
|
|
.. ditaa::
|
|
|
|
+-----------------+
|
|
| xo_tokenizer |
|
|
+-----------------+
|
|
| xo_indentlog |
|
|
+-----------------+
|
|
| xo_cmake |
|
|
+-----------------+
|
|
|
|
Install instructions :doc:`here<install>`
|
|
|
|
Abstraction tower for *xo-tokenizer* components:
|
|
|
|
.. ditaa::
|
|
:--scale: 0.85
|
|
|
|
+-----------------------------------------+----------+
|
|
| tokenizer | |
|
|
+-----------------------------------------+ |
|
|
| scan_result | |
|
|
+-----------------+-----------------------+ |
|
|
| | tokenizer_error | buffer |
|
|
| token +-----------------------+ |
|
|
| | input_state | |
|
|
+-----------------+-----------------------+ |
|
|
| tokentype | span | |
|
|
+-----------------+-----------------------+----------+
|