Google Cloud Dataproc

hadoop-connectors Public
Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.

Java 240 Apache-2.0 189 31 13 Updated Jan 8, 2022
spark-bigquery-connector Public
BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.

Java 183 Apache-2.0 111 34 5 Updated Jan 8, 2022
initialization-actions Public
Run in all nodes of your cluster before the cluster starts - lets you customize your cluster

Shell 531 Apache-2.0 469 12 9 Updated Dec 30, 2021
custom-images Public
Tools for creating Dataproc custom images

Python 15 Apache-2.0 38 1 2 Updated Dec 17, 2021
jupyterhub-dataprocspawner Public

Python 11 Apache-2.0 9 4 2 Updated Jun 25, 2021
hive-bigquery-storage-handler Public
Hive Storage Handler for interoperability between BigQuery and Apache Hive

Java 15 Apache-2.0 6 5 1 Updated Mar 31, 2021
cloud-dataproc Public
Cloud Dataproc: Samples and Utils

Jupyter Notebook 153 Apache-2.0 104 0 0 Updated Oct 1, 2020
dataprocmagic Public

Python 2 Apache-2.0 2 0 1 Updated Sep 11, 2020
dataproc-jdbc-connector Public archive

Java 0 Apache-2.0 2 6 0 Updated Sep 10, 2020
bdutil Public archive
[DEPRECATED] Script used to manage Hadoop and Spark instances on Google Compute Engine

Shell 111 Apache-2.0 95 26 6 Updated Nov 15, 2019

Pinned