Relax their oauthlib pin to 3.1.0, we have already move on to an unstable version for the latest PyJWT support.