2022-04-24 |
tokenize: Support CR LF new line sequences
Jookia
committed
on 24 Apr 2022
|
---|---|
tokenize: Add more new line symbols
Jookia
committed
on 24 Apr 2022
|
|
2022-04-21 | |
2022-03-16 |
tests: tokenize: Move syntax tests to new file
Jookia
committed
on 16 Mar 2022
|
tokenize: Move syntax to its own module
Jookia
committed
on 16 Mar 2022
|
|
2022-03-14 | |
tests: tokenize: Remove reference to NEWLINE
Jookia
committed
on 14 Mar 2022
|
|
2022-02-27 |
tests: tokenize: Fix typo
Jookia
committed
on 27 Feb 2022
|
2022-02-15 |
testss: tokenize: Add documentation on the expected behaviours
Jookia
committed
on 15 Feb 2022
|
2022-02-08 |
tokenize: Add shebang types
Jookia
committed
on 8 Feb 2022
|
tokenize: Classify language keywords
Jookia
committed
on 8 Feb 2022
|
|
tokenize: Add booleans
Jookia
committed
on 8 Feb 2022
|
|
tests: tokenize: Add a draw_token_classified strategy
Jookia
committed
on 8 Feb 2022
|
|
tests: tokenize: Test location using types only
Jookia
committed
on 8 Feb 2022
|
|
tests: tokenize: Add more accurate comments
Jookia
committed
on 8 Feb 2022
|
|
tests: tokenize: Have draw_token_* use draw_token_random
Jookia
committed
on 8 Feb 2022
|
|
tests: tokenize: Put generic draws at top of file
Jookia
committed
on 8 Feb 2022
|
|
2022-02-07 |
tokenize: Add tokenize wrapper function
Jookia
committed
on 7 Feb 2022
|
tests: tokenize: Add comments
Jookia
committed
on 7 Feb 2022
|
|
tests: tokenize: Run classification with random input
Jookia
committed
on 7 Feb 2022
|
|
tokenize: Add classify_tokens to set token types
Jookia
committed
on 7 Feb 2022
|