tests: parse: Draw text syntax tokens ...

This requires fixing a bug for comparing values of different types.

parse: tests: Clarify errors and tests

parse: Check token types when parsing text

parse: Add parse_text to parse a text syntax node ...

No error handling tests are added yet.

parse: Rename TokenStream to SyntaxStream

parse: Require the caller to copy the TokenStream list ...

This is more Pythonic I think.

parse: Add TokenStream class ...

This will be used for stateful parsing, with lookahead in future.

parse: Don't strip non-token syntax ...

This bug was picked up by mutmut.

parse: Use syntax for strip_whitespace

parse: Add import_tokens to import tokens to syntax

parse: Add Syntax node ...

Currently this just holds a token, but will eventually hold parsed
syntax tree values.

parse: Rename remove_whitespace to strip_whitespace

parse: Add parse wrapper function

parse: Add remove_whitespace pass

parse: Move to oldparse ...

This is in preparation of writing a new parser.
Once the new parser is ready then this code can be junked.

tokenize: Add shebang types

tokenize: Classify language keywords

tokenize: Add booleans

tokenize: Add is_newline and is_whitespace functions

tokenize: Move classify_tokens to before locate_tokens

tokenize: Use type for locating newlines ...

This allows us to test locating with a broader variety of inputs, not
just what we pass to split_tokens.

tokenize: Add NEWLINE token type ...

This isn't used yet but is intended to make location handling easier.

tokenize: Add tokenize wrapper function

tokenize: Add classify_tokens to set token types

tokenize: Add WHITESPACE TokenType ...

This will be used later.

tokenize: Add type value for token type

src: tokenize: Rename symbol to token

tokenize: Add locate_symbols function to add symbol locations ...

This isn't the best soltuion yet, but it's a start.

tokenize: Always specify a location for symbols ...

This gets rid of the default symbol location. The 'default' used now is
just the result of split_symbols.

tokenize: Fix no mutate pragmas