xo-tokenizer/docs/tokentype-enum.rst
Roland Conybeare ee68675848 xo-tokenizer: docs + error-handling improvement
drop exceptions for return-value error object
2025-06-23 23:08:12 -05:00

34 lines
878 B
ReStructuredText

.. _tokentype-enum:
Tokentype
=========
Distinguish different lexical tokens for the Schematika language.
Context
-------
.. ditaa::
:--scale: 0.85
+-----------------------------------------+----------+
| tokenizer | |
+-----------------------------------------+ |
| scan_result | |
+-----------------+-----------------------+ buffer |
| token | tokenizer_error | |
+-----------------+-----------------------+ |
|cBLU tokentype | span | |
+-----------------+-----------------------+----------+
.. code-block:: cpp
#include <xo/tokenizer/tokentype.hpp>
Enum
----
.. doxygenfunction:: xo::scm::tokentype_descr
.. doxygenfunction:: xo::scm::operator<<(std::ostream&,tokentype)