parse: Don't strip non-token syntax ...

This bug was picked up by mutmut.

parse: Use syntax for strip_whitespace

tests: parse: Add draw_syntax_random

parse: Add import_tokens to import tokens to syntax

parse: Add Syntax node ...

Currently this just holds a token, but will eventually hold parsed
syntax tree values.

tests: parse: Use classified tokens for better coverage

parse: Rename remove_whitespace to strip_whitespace

parse: Add parse wrapper function

parse: Add remove_whitespace pass

make: Remove hypothesis statistics and seed ...

We don't really need these.

make: Remove _build/NewLang when building ...

I'm fairly sure Python alrady does this. Better safe than sorry.

parse: Move to oldparse ...

This is in preparation of writing a new parser.
Once the new parser is ready then this code can be junked.

testss: tokenize: Add documentation on the expected behaviours

tests: tokenize: Give garbled tokens to the classifier ...

This helps prove that the classifier only classifies full tokens, not
substrings.

tokenize: Add shebang types

tokenize: Classify language keywords

tokenize: Add booleans

tokenize: Add is_newline and is_whitespace functions

test: tokenize: Move draw_tokens_list to draw_tokens_to_split ...

While we're at it include the source flattening code.

tests: tokenize: Add a draw_token_classified strategy

tests: tokenize: Use random tokens again for locations ...

By using random tokens and passing that set to the test we now have both
random values, random locations and random types to help prove that the
location pass only uses types and length for locating.

tests: tokenize: Test location using types only

tokenize: Move classify_tokens to before locate_tokens

tokenize: Use type for locating newlines ...

This allows us to test locating with a broader variety of inputs, not
just what we pass to split_tokens.

tokenize: Add NEWLINE token type ...

This isn't used yet but is intended to make location handling easier.

tests: tokenize: Add more accurate comments

tests: tokenize: Have draw_token_* use draw_token_random

tests: tokenize: Put generic draws at top of file

tokenize: Add tokenize wrapper function

tests: tokenize: Add comments