Karate as Proxy Server?

[nycjoker]

I have an application that consumes 3rd party services? Is it possible to utilize Karate as a true HTTP proxy server such that request to a 3rd party service are intercepted and my mocks are returned in the response? I would like a seamless way to enable and disable mocking.

[ptrthomas]

yes, look at the last row in this table: https://github.com/intuit/karate/tree/master/karate-netty#consumer-provider-example

the limitation currently is that it does not support HTTPS. typically not an issue since you have control over your environment (and config / property files). so to enable and disable, just set a system HTTP proxy that points to your karate instance

[nycjoker]

That worked, thank you! When you say it does not support HTTPS, what exactly do you mean?

I tried to proxy to an https endpoint and was unsuccessful. I did set ssl to true in the feature file but the request was forwarded on HTTP, not HTTPS.

[ptrthomas]

@nycjoker that you can't "unpack" HTTPS in the feature file.

you should be able to forward to HTTPS - keep in mind that it is not just the ssl = true that matters, it is the full URL, so if you write some logic to use https://blah it should work

[nycjoker]

@ptrthomas I'm trying to have Karate Proxy Server act as a pass-through for HTTPS URLs that are not mocked. However, when I use karate.proceed() it does not forward to the incoming HTTPS URL. Is this what you mean by "unpack"?

Example
When I curl to https://www.google.com through the Karate Proxy with the attempt to have Karate forward the request, the following error is present:

09:03:35.160 [nioEventLoopGroup-3-1] DEBUG com.intuit.karate - handling method: CONNECT, uri: www.google.com:443
09:03:36.739 [nioEventLoopGroup-3-1] ERROR com.intuit.karate - org.apache.http.NoHttpResponseException: www.google.com:443 failed to respond, http call failed after 62 milliseconds for URL: http://www.google.com:443

[ptrthomas]

@nycjoker yes, we haven't implemented handling of CONNECT as an HTTPS proxy. so HTTP works and then you can proceed() to anything. proceed() takes the incoming URL by default - but you can override it e.g. proceed('https://someurl.com')

[nycjoker]

@ptrthomas thanks for the quick reply. Is support planned on the roadmap?

[ptrthomas]

@nycjoker we really want to do this, just that is a little complex ! take a look at https://github.com/adamfisk/LittleProxy

[nycjoker]

@ptrthomas LittleProxy looks great. Would be awesome for Karate to have this ability.

[nycjoker]

@ptrthomas Been working with mock server as an HTTP PROXY a bit more. I've encountered several HTTPS endpoints at my company that need to be mocked. Unfortunately, HTTP endpoints are unavailable.

What is your recommendation in mocking these HTTPS endpoints? Setup LittleProxy to handle HTTPS endpoints by intercepting them and then forward on to Karate mock server via HTTP?

[ptrthomas]

yes LittleProxy. but I would first explore if I can re-wire the "callers" to use HTTP, and then Karate can intercept and forward on to HTTPS. typically in pre-prod environments, you would have this level of control

[nycjoker]

@ptrthomas thanks for the feedback.

[ptrthomas]

@nycjoker I've had some success implementing an HTTPS proxy. are you interested in joining the slack channel and discuss more / do some early testing - please send an e-mail to ptrthomas at gmail dot com

[prernad0903]

Hi,

As suggested, i have been trying to intercept the 3rd party APIs being consumed in my spring boot application, using karate as a proxy server, and return mock responses, but it is still executing the actual API and not the mock.
Attached files for reference.
Please advise what is the issue here.

Thanks
ThirdPartyMock.zip

[ptrthomas]

@prernad0903 this is of no use. see if this answer helps: https://stackoverflow.com/a/61414022/143475 else follow this process: https://github.com/intuit/karate/wiki/How-to-Submit-an-Issue

[prernad0903]

@ptrthomas Thank you! This helps..

[ptrthomas]

an update HTTPS is not yet possible because we need a change in the underlying Armeria server we use. details here: https://stackoverflow.com/q/64755992/143475