Add Arrow Flight SQL to retrieve data faster through arrow flight driver

[YuriyGavrilov]

Use Case
Retrieve data faster through arrow flight driver

Describe the solution you'd like
see above.

Describe alternatives you've considered
Actually there is no.

Additional context
There is new modern SQL way to retrieve data in a faster way through Arrow Flight SQL driver.
https://arrow.apache.org/docs/java/flight_sql_jdbc_driver.html#
https://arrow.apache.org/blog/2022/02/16/introducing-arrow-flight-sql/
https://www.postgresql.org/about/news/apache-arrow-flight-sql-adapter-for-postgresql-010-2716/

Some explanations and research:
https://www.vldb.org/pvldb/vol10/p1022-muehleisen.pdf

Some server examples:
https://github.com/voltrondata/flight-sql-server-example
https://www.kamu.dev/blog/2023-09-datafusion-flightsql/ https://github.com/kamu-data/kamu-cli

[josevalim]

Hi @YuriyGavrilov! Please take a look at https://github.com/elixir-explorer/adbc. It already supports Flight SQL, which you can use from Livebook. Have you tried it out? Does it work? We would also be open to expanding kino_db with Flight SQL smart cells. PRs welcome!

[YuriyGavrilov]

Hi @josevalim nice to know about it. Thanks for info. Will test it. I am also waiting Flight support for Trino. Hope next year it will be done.