Page not fully rendered (Compression + HTML builder)

[gzoritchak]

I put brackets on Compress and HTML builder because I'm not completely sure of what is happening.

The problem appeared on some pages generated from markdown files through HTML builders. The MD files are parsed and transformed into HTML with a third party library. This HTML is then injected into HTML builders using an unsafe block. MD files, and by extension unsafe content, can be quite big.

When loading pages from a browser they often appear to be only partially rendered even though the HTTP code is 200.

My current intuition, after some debugging and with a partial knowledge of ktor internals, is that the bug comes from the combination of Compression feature and big html streams. At one moment, the html stream uses some BufferedWriter and the compression takes the content of buffer and ends the HTTP request even if the content as not complete the html generation.

[gzoritchak]

I was able to reproduce this bug on Jetty and Netty.

[Bluexin]

Might be the same cause as #685

[cy6erGn0m]

Workarounded in 1.0.0-beta-4

[gzoritchak]

Thanks @cy6erGn0m for this quick resolution.

You indicates the solution to be a workaround. Are there some limitations with this implementation?

[cy6erGn0m]

This solution is not good enough due to performance impact (introduces scheduling delay)

[Bluexin]

Is there an issue open for tracking updates for an actual definitive fix ? Seeing this is just a workaround (so it doesn't get forgotten)

[cy6erGn0m]

@Bluexin See #742