tests: parse: Draw text syntax tokens ...

This requires fixing a bug for comparing values of different types.

parse: tests: Clarify errors and tests

tests: parse: Draw classified tokens for better coverage

tests: parse: Mutate StartText/EndText for testing

tests: parse: Test parse_text fails without StartText or EndText

parse: Add parse_text to parse a text syntax node ...

No error handling tests are added yet.

tests: parse: Move test to make more sense

parse: Rename TokenStream to SyntaxStream

parse: Require the caller to copy the TokenStream list ...

This is more Pythonic I think.

parse: Add TokenStream class ...

This will be used for stateful parsing, with lookahead in future.

parse: Don't strip non-token syntax ...

This bug was picked up by mutmut.

parse: Use syntax for strip_whitespace

tests: parse: Add draw_syntax_random

parse: Add import_tokens to import tokens to syntax

parse: Add Syntax node ...

Currently this just holds a token, but will eventually hold parsed
syntax tree values.

tests: parse: Use classified tokens for better coverage

parse: Rename remove_whitespace to strip_whitespace

parse: Add parse wrapper function

parse: Add remove_whitespace pass

parse: Move to oldparse ...

This is in preparation of writing a new parser.
Once the new parser is ready then this code can be junked.

tests: Add SPDX license headers

tests: parse: Remove unused integers include ...

Found by flake8.

tests: lexer: Drop error testing code ...

This code is awful:

- It reaches across multiple layers of abstractions
- It does a lot of string splitting and joining to rebuild code
- It only tests very specific cases because the main code is broken

Just dump it for now and start over.

tests: lexer: Add test for inserting an EndText in to test ...

This is BROKEN and fundamentally flawed, but I'm keeping it here for
reference in Git history.

tests: Clarify purpose of draw_error_endtext_remove

tests: Rename EndText test to EndText stray test

tests: parse: Use repr() to print string values

tests: lexer: Test that removing an EndText causes an error ...

This only applies to the last Text element in a soup.

tests: lexer: Check error location

tests: lexer: Test stray EndText errors are caught