tokenize: Add NEWLINE token type

Fork: 0

LuminaSensum / NewLang

Browse code tokenize: Add NEWLINE token type This isn't used yet but is intended to make location handling easier. main
1 parent 33614b4 commit 40e09b7c82ec9c21f5b1efb7a16adae46182a202 Jookia authored on 8 Feb 2022

Patch

Unified Split

Showing 2 changed files

Ignore Space Show notes View src/tokenize.py

Ignore Space Show notes View tests/test_tokenize.py

Show line notes below