parquet
Here are 213 public repositories matching this topic...
Hello everyone,
Recently I tried to set up petastorm on my company's hadoop cluster.
However as the cluster uses Kerberos for authentication using petastorm failed.
I figured out that petastorm relies on pyarrow which actually supports kerberos authentication.
I hacked "petastorm/petastorm/hdfs/namenode.py" line 250
and replaced it with
driver = 'libhdfs'
return pyarrow.hdfs.c-
Updated
Jun 4, 2021 - Jupyter Notebook
-
Updated
May 27, 2021 - Python
Currently, there isn't a way to get the table properties in the SparkOrcWriter via the WriterFactory.
-
Updated
May 29, 2021 - JavaScript
-
Updated
May 20, 2021 - Python
It's been reported by other projects that musl could lead to performance issues, so we should switch our Linux binary releases to use glibc instead to avoid these kind of potential pitfalls.
Over time we've had some things leak into the diff methods that make it more cumbersome to use BigDiffy via code instead of CLI.
For example diffAvro here https://github.com/spotify/ratatool/blob/master/ratatool-diffy/src/main/scala/com/spotify/ratatool/diffy/BigDiffy.scala#L284
User has to manually pass in schema otherwise we they receive a non-informative error regarding null schema, add
-
Updated
Apr 18, 2021 - C#
-
Updated
Feb 8, 2021 - Python
-
Updated
May 30, 2021 - JavaScript
-
Updated
Feb 1, 2019 - TypeScript
-
Updated
May 18, 2021 - C++
-
Updated
May 20, 2021 - C#
UML support
Provide support for working with UML diagrams as graphs, e.g., applying inference, shape constraints, probabilistic rules, etc.
These are the approximate steps to follow:
- Identify a reasonably small UML diagram to use as test case.
- Scope/Discovery: in what ways are UML diagrams represented commonly?
- Graphviz
DOTfiles, e.g., - https://github.com/abulka/pynsource
- <http
Problem description
Reading a dataset with eager's read functionality raises a ValueError when providing columns.
Example code (ideally copy-pastable)
import pandas as pd
from tempfile import TemporaryDirectory
from functools import partial
from storefact import get_store_from_url
from kartothek.io.eager import store_dataframes_as_dataset, read_dataset_as_data-
Updated
May 30, 2021 - Scala
-
Updated
May 1, 2021 - Go
-
Updated
Jun 2, 2021 - Python
Improve this page
Add a description, image, and links to the parquet topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the parquet topic, visit your repo's landing page and select "manage topics."
Append
classto allHashCodeBuildersin Gaffer for the below issue to minimise hash collisions.