parse: Wrap parse functionality to allow mock testing

parse: Parse boolean values

parse: Add skip_note for parsing notes

parse: Add ParseError and ParseErrorException for error reporting

tokenize: Support CR LF new line sequences

tokenize: Add more new line symbols

parse: Ignore whitespace in text, instead join words with spaces ...

This cuts down on complexity as now only the tokenizer deals with
whitespace and makes whitespace no longer a factor in the language.

syntax: Drop NewLang version keyword ...

Bundling NewLang solves the issue of version compatibility.

syntax: Drop support for shebangs ...

Shebangs are useful for writing scripts, but they assume an install of
NewLang separate from the application.

I don't plan to support that, only bundling of NewLang and its scripts.

docs: Clarify that we mean code points, not characters

syntax: Rename SyntaxLocation's column to offset ...

We don't know anything about columns or displaying the code points in
our source file, so be clear it's an offset and not a column.

tokenize: Move syntax to its own module

parse: Add read_token function

tokenize: Remove unused list of keywords

parse: Move Syntax to tokenize and replace Token ...

These are basically the same classes so merge them

parse: Don't nest tokens in values ...

Now that we don't need to copy the TokenType we can just copy the value
directly.

tokenize: Remove TokenType enum ...

In practice this wasn't used: The parse code always checks the value AND
the type. So just check the value only.

tests: parse: Draw text syntax tokens ...

This requires fixing a bug for comparing values of different types.

parse: tests: Clarify errors and tests

parse: Check token types when parsing text

parse: Add parse_text to parse a text syntax node ...

No error handling tests are added yet.

parse: Rename TokenStream to SyntaxStream

parse: Require the caller to copy the TokenStream list ...

This is more Pythonic I think.

parse: Add TokenStream class ...

This will be used for stateful parsing, with lookahead in future.

parse: Don't strip non-token syntax ...

This bug was picked up by mutmut.

parse: Use syntax for strip_whitespace

parse: Add import_tokens to import tokens to syntax

parse: Add Syntax node ...

Currently this just holds a token, but will eventually hold parsed
syntax tree values.

parse: Rename remove_whitespace to strip_whitespace

parse: Add parse wrapper function