Skip to content
#

spark-sql

Star

Here are 352 public repositories matching this topic...

Language: All
Filter by language
All 352 Scala 130 Java 54 Jupyter Notebook 53 Python 46 HTML 14 Shell 7 JavaScript 5 C# 3 Kotlin 3 R 2
Sort: Best match
Sort options
Best match Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

dotnet / spark

Star
Open

[FEATURE REQUEST]: Spark 3.0 Readiness

8
suhsteve
suhsteve commented Aug 19, 2020

APIs

SparkSession

  • python def getActiveSession(cls)
  • scala def executeCommand(runner: String, command: String, options: Map[String, String]): DataFrame

DataFrame

  • python def transform(self, func)
  • python def tail(self, num)
    scala def tail(n: Int): Array[T]
  • scala def printSchema(level: Int): Unit
  • scala def explain(mode: String): U
Read more
enhancement good first issue help wanted
Find more good first issues →

microsoft / data-accelerator

Star
Find more good first issues →

Chabane / bigdata-playground

Star

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

nodejs python graphql docker machine-learning angular scala kafka big-data apache-spark mongodb hadoop avro twitter-api hbase spark-streaming parquet apache-flink kops spark-sql
  • Updated Feb 1, 2019
  • TypeScript

Re1tReddy / Spark

Star

Apache Spark is a fast, in-memory data processing engine with elegant and expressive development API's to allow data workers to efficiently execute streaming, machine learning or SQL workloads that require fast iterative access to datasets.This project will have sample programs for Spark in Scala language .

streaming consumer parquet kafka-producer spark-sql spark-kafka-integration spark-streaming-data spark-transformations spark-to-cassandra-connection spark-dataframes spark-joins spark-hive-context spark-jdbc-connection spark-with-mangodb spark-aggregations-using-dataframe spark-use-cases cassandra-installation spark-datadog spark-mangodb spark-catalog-api
  • Updated Jul 1, 2020
  • Scala

Improve this page

Add a description, image, and links to the spark-sql topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the spark-sql topic, visit your repo's landing page and select "manage topics."

Learn more

You can’t perform that action at this time.