pyarrow

Expressive analytics in Python at any scale.

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

Converts a whole subdirectory with a big (or small) volume of PDF documents to a dataset (pandas DataFrame) with error tracking and choice of features

↻ 一个 Mongodb 数据库转换为表格文件的库

A web application for viewing Apache Parquet files . This is a Python + Flask application

Concise interface to cache numpy arrays and pandas dataframes

highspeed timeseries pandas dataframe database

ibm_db extension to load a pyarrow table to db2

Dremio Arrow Flight Client

↻ 一个 MySQL 数据库转换为表格文件的库

A small cast tookit class drived from _ParquetDatasetV2 to support cast in filters argument

CSV converter

Saving large files on GitHub

Complete Guide to Data Munging

Convert data to the parquet format with Python dask and pyarrow.

En este repositorio se va a compartir todo el material relacionado con la charla "Como compartir grandes Datasets entre procesos sin perder la salud mental" de la Pycones 2021

Code examples / snippets for website news post

Dockerfile and Python 3.9 wheel for PyArrow 3.0.0 built on Alpine 3.14 (does not include Plasma or Parquet)