xo-tokenizer: build + utest + reasonable implementation

This commit is contained in:
Roland Conybeare 2024-07-22 12:30:46 +10:00
commit 9dc37e84e6
15 changed files with 2154 additions and 0 deletions

View file

@ -0,0 +1,6 @@
/* file tokenizer_utest_main.cpp */
#define CATCH_CONFIG_MAIN
#include "catch2/catch.hpp"
/* end tokenizer_utest_main.cpp */