tokenize: Add WHITESPACE TokenType

Fork: 0

LuminaSensum / NewLang

Browse code tokenize: Add WHITESPACE TokenType This will be used later. main
1 parent 213e28d commit d06e4a957ac87ce43c9c38fffb5dcc6b71af7f42 Jookia authored on 7 Feb 2022

Patch

Unified Split

Showing 2 changed files

Ignore Space Show notes View src/tokenize.py

Ignore Space Show notes View tests/test_tokenize.py

Show line notes below