#

delta-lake

Here are 61 public repositories matching this topic...

delta-io / delta

This connector allows Apache Spark™ to read from and write to Delta Lake.

big-data spark analytics acid delta-lake

Updated Sep 17, 2022
Scala

roapi / roapi

Create full-fledged APIs for slowly moving datasets without writing a single line of code.

graphql rust query sql analytics arrow rest-api s3 cloud-native parquet datasets in-memory-database blob-storage columnar delta-lake datafusion query-frontends static-datasets

Updated Aug 25, 2022
Rust

databricks / LearningSparkV2

This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

spark apache-spark mllib structured-streaming spark-sql spark-mllib mlflow delta-lake

Updated Dec 12, 2021
Scala

delta-io / delta-rs

A native Rust library for Delta Lake, with bindings into Python and Ruby.

python rust pandas-dataframe pandas delta databricks delta-lake

Updated Sep 18, 2022
Rust

delta-io / delta-sharing

An open protocol for secure data sharing

big-data spark pandas data-sharing delta-lake

Updated Sep 14, 2022
Scala

delta-io / connectors

This library allows Scala and Java-based projects (including Apache Flink, Apache Hive, Apache Beam, and PrestoDB) to read from and write to Delta Lake.

java scala apache-flink prestodb trino apache-hive delta-lake

Updated Sep 17, 2022
Java

aws-samples / amazon-sagemaker-local-mode

Amazon SageMaker Local Mode Examples

Updated Sep 6, 2022
Python

japila-books / delta-lake-internals

The Internals of Delta Lake

books book internals datalake delta-lake deltalake

Updated Aug 21, 2022

Real-time-Data-Warehouse

izhangzhihao / Real-time-Data-Warehouse

Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi

Updated Feb 24, 2022
Dockerfile

tikal-fuseday / delta-architecture

Streaming data changes to a Data Lake with Debezium and Delta Lake pipeline

kafka spark databases streams data-pipeline debezium delta-lake

Updated Jun 18, 2020
HTML

neylsoncrepalde / edc-mod1-exercise-igti

Exercícios do módulo 1 - Bootcamp EDC - IGTI 2021

emr aws spark terraform delta-lake

Updated Mar 22, 2022
Python

jeppe742 / DeltaLakeReader

Read Delta tables without any Spark

delta-lake delta-tables

Updated Mar 10, 2022
Python

anneglienke / upsert-delta

This repository exemplifies a simple ELT process using delta to perform upsert and remove data files that aren't in the latest state of the transaction log for the table.

delta delta-lake deltalake

Updated Feb 24, 2022
Python

AndrewKuzmin / spark-structured-streaming-examples

Spark structured streaming examples with using of version 3.0.0

spark apache-spark structured-streaming spark-sql spark-structured-streaming delta-lake

Updated Sep 2, 2019
Scala

TatevKaren / free-resources-books-papers

Books and Papers in Mathematics, Econometrics, Machine Learning, Finance etc for different levels that can be useful for Data Scientists, Developers and everyone whoo is interesting in STEM.

data-science machine-learning statistics books mathematics econometrics databricks developers delta-lake free-books free-resources

Updated Apr 13, 2021

databrickslabs / delta-oms

DeltaOMS is a solution that helps to build a centralized repository of operational metrics/statistics for your Lakehouse built on Delta Lake

monitoring metrics delta centralized databricks delta-lake lakehouse

Updated Sep 1, 2022
Scala

modern-data-lake-storage-layers

dacort / modern-data-lake-storage-layers

Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work

aws amazon-emr iceberg hudi apache-iceberg delta-lake apache-hudi

Updated Jul 13, 2022
Jupyter Notebook

vvalcristina / Workshop-Data-Lakehouse

Repositório dedicado a Workshop de Data Lakehouse com Delta Lake

spark delta-lake lakehouse

Updated Dec 6, 2021
Jupyter Notebook

ysfesr / Building-Data-LakeHouse

Creation of a data lakehouse and ELT pipeline

docker spark presto hive minio s3-storage delta-lake lakehouse

Updated Sep 14, 2022
Python

bonnal-enzo / delta-lake-ui

UI to run SQL on Delta Lake tables and visualize the variations of the result among tables versions

flask apache-spark pygal delta-lake

Updated Apr 21, 2020
Python

Improve this page

Add a description, image, and links to the delta-lake topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the delta-lake topic, visit your repo's landing page and select "manage topics."