SoTA LLM for converting natural language questions to SQL queries

Flink Scala API is a thin wrapper on top of Flink Java API which support Scala Types for serialisation as well the latest Scala version

Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!

Bigtop is an Apache Foundation project for Infrastructure Engineers and Data Scientists looking for comprehensive packaging, testing, and configuration of the leading open source big data components.

A portable accelerated data query and LLM-inference engine, written in Rust, for data-grounded AI apps and agents.

Scala and SQL happy together.

Write ETL using your favorite SQL dialects

Fast, Free SQL Parser

Base classes to use when writing tests with Spark

Interact with your SQL database, Natural Language to SQL using LLMs

Evaluate the accuracy of LLM generated outputs

DuckDB is an analytical in-process SQL database management system

A vector search SQLite extension that runs anywhere!

A portable embedded database using Arrow.

Powerful SQL migration toolkit for Rust.

Manage your database schema as code

A suite of tools to develop RAG, semantic search, and other AI applications more easily with PostgreSQL

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

A flow-style query language for SQL engines

Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive (AI) workloads.

Embeddable stream processing engine based on Apache DataFusion

dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

Limbo is a project to build the modern evolution of SQLite.

Scala ORM to query SQL databases from Scala via concise, type-safe, and familiar case classes and collection operations. Connects to Postgres, MySql, H2, and Sqlite out of the box

The ZetaSQL Toolkit is a library that helps users use ZetaSQL Java API to perform SQL analysis for multiple query engines, including BigQuery and Cloud Spanner.

An emulator for the Google BigQuery, that can be run locally, backed by PostgreSQL.

The Feldera Incremental Computation Engine