#
data-infrastructure
Here are 42 public repositories matching this topic...
Production PostgreSQL for Kubernetes, from high availability Postgres clusters to full-scale database-as-a-service.
kubernetes
postgres
database
postgresql
database-as-a-service
operator
database-management
high-availability
kubernetes-operator
disaster-recovery
postgresql-monitoring
pgo
data-infrastructure
postgresql-metrics
postgres-operator
postgresql-clusters
-
Updated
Oct 20, 2021 - Go
jinmingjian
commented
Aug 2, 2021
especially for less obvious but lengthy code snippets!
Highly available elephant herd: HA PostgreSQL cluster using Docker
-
Updated
Oct 19, 2021 - Python
A distributed event bus that implements a RESTful API abstraction on top of Kafka-like queues
-
Updated
Oct 15, 2021 - Java
A battle-tested, flexible & comprehensive monitoring solution for your PostgreSQL databases
-
Updated
Jun 25, 2020 - Python
Python function to stream unzip all the files in a ZIP archive: without loading the entire ZIP file or any of its files into memory at once
-
Updated
Oct 16, 2021 - Python
Continuously sync folder to S3, using inotify under the hood
-
Updated
May 15, 2021 - Python
Spawns JupyterHub single user servers in Docker containers running in AWS Fargate
-
Updated
Jun 28, 2020 - Python
A DNS proxy server that conditionally rewrites and filters A record requests
-
Updated
Oct 31, 2020 - Python
Kanadi is a Nakadi client for Scala
-
Updated
Sep 2, 2021 - Scala
Allows users to access data and launch applications to analyse it
-
Updated
Oct 20, 2021 - Python
Collections of POC/dev data infrastructure. | #SE
mysql
java
docker
infrastructure
redis
elasticsearch
devops
database
kafka
mongodb
deployment
backend
postgresql
superset
data-engineering
celery
backend-services
flower
system-design
data-infrastructure
-
Updated
May 7, 2021 - Python
Python utility function to communicate with a subprocess using iterables: for when data is too big to fit in memory and has to be streamed
-
Updated
Jun 21, 2021 - Python
Lightweight API service for querying for companies that have expressed interest in exporting to specific countries
-
Updated
Oct 17, 2021 - Python
Join iterables in code without loading them all in memory: similar to a SQL left join
-
Updated
Dec 19, 2020 - Python
The Data Engineering Book - หนังสือวิศวกรรมข้อมูล ของคนไทย เพื่อคนไทย
data
book
data-engineering
data-integration
hacktoberfest
data-pipeline
data-engineer
data-ingestion
data-infrastructure
-
Updated
Oct 18, 2021
-
Updated
Jun 10, 2021 - HTML
A command line report on a GitHub organisation's repositories, ordered by priority, and including time-to-SLA for each severity level
-
Updated
Sep 16, 2021 - Python
Utility function to perform the server-side of Hawk authentication
-
Updated
Jun 13, 2020 - Python
a sample app showing how to use the data-engineering-common repo to create a lightweight flask, hawk authenticated app
-
Updated
Jun 30, 2020 - Python
-
Updated
May 6, 2021 - Python
Utility function to perform the server-side of Hawk authentication for asyncio HTTP servers
-
Updated
Jun 13, 2020 - Python
-
Updated
Sep 17, 2021 - Python
Improve this page
Add a description, image, and links to the data-infrastructure topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the data-infrastructure topic, visit your repo's landing page and select "manage topics."
Initial questions
Background
In #1638 I described in detail the process I went thro