-
Notifications
You must be signed in to change notification settings - Fork 84
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Supporting additional compression formats #12
Comments
Now that Zstd is supported over streams, it'd be nice to aggregate some resources for anyone wishing to provide more support over different encoding schemes.
This likely won't be worked on unless there's a hotter compression algorithm in town I suppose, but it's here for anyone that wants to give one of them a try. |
Async support has been requested for lz4_flex PSeitz/lz4_flex#15. It's not a http compression encoding though. |
I'll point out that lz4 is the default compression for clickhouse over http, which would make lz4 support very appealing to me. |
lz4 is really useful for some big data applications where you need a better balance of speed. Also, for async file io, this would be super convenient. |
I am willing to review and merge PR for lz4 |
Just an idea that was fishing around in my head lately, but I think it would be awesome to support additional crates for use between the newest async types/traits.
One in particular that stands out to me (and could be useful for the near future) is the zstd crate. In particular, we could apply the same kind of byte-stream encoding/decoding logic that we use for Deflate/Zlib to the zstd raw compresser/decompressers here. Also another thing to note is while it does support
AsyncRead
/AsyncWrite
through a feature gatetokio-io
, that is still on futures 0.1.For zstd, it shouldn't take too long -- I might actually start work on it soon!
The text was updated successfully, but these errors were encountered: