36 lines
996 B
ReStructuredText
36 lines
996 B
ReStructuredText
|
|
.. _tokentype-enum:
|
|
|
|
Tokentype
|
|
=========
|
|
|
|
Distinguish different lexical tokens for the Schematika language.
|
|
|
|
Context
|
|
-------
|
|
|
|
.. ditaa::
|
|
:--scale: 0.85
|
|
|
|
+-----------------------------------------+----------+
|
|
| tokenizer | |
|
|
+-----------------------------------------+ |
|
|
| scan_result | |
|
|
+-----------------+-----------------------+ |
|
|
| | tokenizer_error | buffer |
|
|
| token +-----------------------+ |
|
|
| | input_state | |
|
|
+-----------------+-----------------------+ |
|
|
|cBLU tokentype | span | |
|
|
+-----------------+-----------------------+----------+
|
|
|
|
.. code-block:: cpp
|
|
|
|
#include <xo/tokenizer/tokentype.hpp>
|
|
|
|
Enum
|
|
----
|
|
|
|
.. doxygenfunction:: xo::scm::tokentype_descr
|
|
|
|
.. doxygenfunction:: xo::scm::operator<<(std::ostream&,tokentype)
|