parse: Ignore whitespace in text, instead join words with spaces

Fork: 0

LuminaSensum / NewLang

Browse code parse: Ignore whitespace in text, instead join words with spaces This cuts down on complexity as now only the tokenizer deals with whitespace and makes whitespace no longer a factor in the language. main
1 parent 91da776 commit 5e69e271443c1b2fb8f246f25c402c306043bf46 Jookia authored on 24 Apr 2022

Patch

Unified Split

Showing 5 changed files

Ignore Space Show notes View docs/syntax.md

Ignore Space Show notes View src/parse.py

Ignore Space Show notes View src/tokenize.py

Ignore Space Show notes View tests/test_parse.py

Ignore Space Show notes View tests/test_tokenize.py

Show line notes below