A few libraries we depend on no longer support old versions of Python like 3.5 and 3.6. Remove testing for these old versions.