I think I know why JWKs aren’t working. The RSA key supplied with a JWK is base64 decoded to a binary representation of the key as opposed to a PEM encoded version. And our JWT decoder assumes PEM encoding (string format).
So all that may be needed is a conversion or a direct byte array parser instead of assuming PEM step in the JWK method.
Shall go on the investigatory list