tokenize: Support CR LF new line sequences

Fork: 0

LuminaSensum / NewLang

Browse code tokenize: Support CR LF new line sequences main
1 parent 69e038e commit 49c8bc6d1c355dec880216b116f03278c83fb60e Jookia authored on 24 Apr 2022

Patch

Unified Split

Showing 4 changed files

Ignore Space Show notes View docs/syntax.md

Ignore Space Show notes View src/tokenize.py

Ignore Space Show notes View tests/test_syntax.py

Ignore Space Show notes View tests/test_tokenize.py

Show line notes below