src: tokenize: Use symbol objects for symbols

Fork: 0

LuminaSensum / NewLang

Browse code src: tokenize: Use symbol objects for symbols This will be useful for when we add line numbers. main
1 parent b25df30 commit fcebb20fed5305fa1dc1c4523c2b425b6e066c03 Jookia authored on 4 Feb 2022

Patch

Unified Split

Showing 2 changed files

Ignore Space Show notes View src/tokenize.py

Ignore Space Show notes View tests/test_tokenize.py

Show line notes below