#

data-integration

Here are 239 public repositories matching this topic...

airbytehq / airbyte

Open

Connector Generator: create new singer based connector failed running check command

1

marcosmarxm commented Dec 10, 2021

Read more

type/bug good first issue CDK

Open

Modify webhook notifications to prevent error message trigger for cancelled jobs

Open

reduce java image sizes by using `ADD` docker command

Find more good first issues

rudder-server

rudderlabs / rudder-server

Privacy and Security focused Segment-alternative, in Golang and React

react go golang security privacy data-warehouse data-integration hacktoberfest warehouse-management data-synchronization hybrid-cloud customer-data rudder customer-data-platform rudder-labs segment-alternative rudderstack customer-data-pipeline customer-data-lake warehouse-first

Updated Jan 11, 2022
Go

apache / incubator-seatunnel

Open

[Feature][plugin-filter-date] Date filter supports Timestamp

2

RickyHuo commented Dec 23, 2021

Search before asking

I had searched in the feature and found no similar feature requirement.

Description

The filter of Date supports convert from Timestamp

Usage Scenario

date {
source_field = "timestamp_field"
target_field = "date"
source_time_format = "TIME

Read more

good first issue 1.X

Open

Please translate the FAQ into English

6

Open

[Feature][UT] add unit test

4

apache / hudi

Upserts, Deletes And Incremental Processing on Big Data.

bigdata stream-processing data-integration datalake apachespark hudi apachehudi incremental-processing apacheflink

Updated Jan 11, 2022
Java

jitsu

jitsucom / jitsu

Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days

golang bigquery postgres clickhouse snowflake data-integration data-collection redshift data-connectors

Updated Jan 11, 2022
TypeScript

seandavi / awesome-single-cell

Community-curated list of software packages and data resources for single-cell, including RNA-seq, ATAC-seq, etc.

python bioinformatics analysis clustering gene-expression data-visualization dimensionality-reduction awesome-list data-integration atac-seq single-cell rna-seq-data scrna-seq-data cell-cycle cell-differentiation gene-expression-profiles analysis-pipeline cell-populations rna-seq-experiments cell-clusters

Updated Jan 4, 2022

mara / mara-pipelines

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

python data pipeline etl postgresql data-integration

Updated Oct 27, 2021
Python

apache / incubator-inlong

Open

[Improve][InLong Website] The InLong Logo can be put in the inlong-website login page

2

leezng commented Dec 24, 2021

Description

The InLong Logo can be put in the inlong-website login page. It may be a universal design.

InLong Component

InLong Website

Are you willing to submit PR?

Yes, I am willing to submit a PR!

Code of Conduct

I agree to follow this project's [C

Read more

good first issue improve

Open

[Bug]some font of " DataProxy-SDK architecture " page incorrectly

5

Open

[Improve] Supplement deployment document

1

Find more good first issues

kuwala

kuwala-io / kuwala

Open

OSM-POI: including brand property

1

IritaSee commented Jan 3, 2022

In this PR, I wanted to solve issue #25 by creating a CSV file to list and also help the brand property matching process. This PR including:

Compile a list of all brand names and operator names from the name-suggestion-index as a CSV with the columns id, display_name, and wiki_data in tmp folder.
Deadline: 05.01.2022
Create a PySpark UDF similar to the ones in the osm

Read more

enhancement good first issue pipeline/osm-poi

Open

Implement consistent variable/feature naming

Open

Population-Density: Query a hex-grid within defined boundaries and set hex size

2

Find more good first issues

immunogenomics / harmony

Fast, sensitive and accurate integration of single-cell data with Harmony

algorithm r scrna-seq data-integration

Updated Oct 29, 2021
R

cuebook / cuelake

Use SQL to build ELT pipelines on a data lakehouse.

sql apache-spark etl pipelines data-engineering data-lake data-transfer delta data-integration upsert elt data-pipeline datalake data-ingestion spark-sql zeppelin-notebook apache-iceberg lakehouse incremental-updates

Updated Jan 3, 2022
JavaScript

leesf / hudi-resources

汇总Apache Hudi相关资料

bigdata apache stream-processing data-integration datalake hudi apachehudi incremental-processing hudi-resources

Updated Jan 10, 2022

CategoricalData / CQL

Open

Add type inference for open APG terms

wisnesky commented Sep 11, 2019

Complete algorithm: http://web.cecs.pdx.edu/~mpj/pubs/polyrec.html

Read more

good first issue APG

Open

Randomizer for instance presentations

Open

A few suggestions to attract contributors and make the project more robust

4

Find more good first issues

saeyslab / nichenetr

NicheNet: predict active ligand-target links between interacting cells

rna-seq gene-expression network-inference data-integration single-cell-rna-seq single-cell-omics intercellular-communication ligand-receptor ligand-target

Updated Jan 11, 2022
R

mara / mara-example-project-2

An example mini data warehouse for python project stats, template for new projects

bigquery sql etl pypi data-integration

Updated Jul 21, 2020
Python

hetio / hetionet

Hetionet: an integrative network of disease

neo4j network rephetio hetionet hetnet drug-repurposing data-integration

Updated Dec 10, 2020
HTML

ceumicrodata / mETL

mito ETL tool

python pipeline etl data-integration etl-framework

Updated Jun 1, 2021
Python

theislab / scarches

Query to reference mapping for single-cell genomics

deep-learning data-integration single-cell rna-seq-analysis batch-correction

Updated Jan 11, 2022
Jupyter Notebook

mims-harvard / scikit-fusion

scikit-fusion: Data fusion via collective latent factor models

embeddings matrix-factorization data-integration latent-features data-fusion knowledge-graphs

Updated May 27, 2021
Python

olehmberg / winter

WInte.r is a Java framework for end-to-end data integration. The WInte.r framework implements well-known methods for data pre-processing, schema matching, identity resolution, data fusion, and result evaluation.

identity-resolution tabular-data data-integration schema-matching data-fusion

Updated Jan 4, 2022
Java

CommonCoreOntology / CommonCoreOntologies

The Common Core Ontology Repository holds the current released version of the Common Core Ontology suite.

semantics interoperability data-integration ontologies owl-ontology bfo cco applied-ontology semantic-consistency ontology-suite

Updated Oct 6, 2021

slowkow / harmonypy

🎼 Integrate multiple high-dimensional datasets with fuzzy k-means and locally linear adjustments.

data-science data-integration

Updated Feb 10, 2021
Python

SDM-TIB / SDM-RDFizer

An Efficient RML-Compliant Engine for Knowledge Graph Construction

knowledge-graph data-integration rml

Updated Jan 10, 2022
Python

datasphere-oss / datasphere-integration

an data-centric integration platform

etl kettle esb data-integration elt data-sharing realtime-messaging data-bus data-interchange

Updated Aug 9, 2021
Java

megalista

google / megalista

First Party data integration solution built for marketing teams to enable audience and conversion onboarding into Google Marketing products (Google Ads, Campaign Manager, Google Analytics).

python bigquery google conversions dataflow data-integration googleanalytics googleads audiences customermatch audience-targeting

Updated Jan 10, 2022
Python

munchy-bytes / SchemaMapper

A .NET class library that allows you to import data from different sources into a unified destination

Updated Dec 8, 2020
C#

dataengineercafe / data-engineering-book

The Data Engineering Book - หนังสือวิศวกรรมข้อมูล ของคนไทย เพื่อคนไทย

data book data-engineering data-integration hacktoberfest data-pipeline data-engineer data-ingestion data-infrastructure

Updated Jan 10, 2022

mara / mara-etl-tools

Utilities for creating ETL pipelines with mara

sql etl data-integration date-dimension sql-utils

Updated Jul 7, 2020
PLpgSQL

SysBioChalmers / GECKO

Toolbox for including enzyme constraints on a genome-scale model.

matlab systems-biology toolbox data-integration proteomics kinetics enzyme-constraints

Updated Nov 30, 2021
MATLAB

marketing-data-sync

DP6 / marketing-data-sync

First Party data integration solution built for marketing teams to enable audience and conversion onboarding into Google Marketing products and Facebook Ads.

bigquery marketing-automation data-integration facebook-ads hacktoberfest conversion-rate-optimization campaign-manager marketing-tools audiences marketing-analytics crm-integration offline-conversion google-ads-api dp6

Updated Jan 1, 2022
Python

Improve this page

Add a description, image, and links to the data-integration topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the data-integration topic, visit your repo's landing page and select "manage topics."