Skip to content

/ DALI

A library containing both highly optimized building blocks and an execution engine for data pre-processing in deep learning applications
fast-data-pipeline image-augmentation data-augmentation image-processing data-processing deep-learning machine-learning python neural-network gpu gpu-tensorflow
C++ Python Cuda CMake C Shell
  1. C++ 67.4%
  2. Python 14.1%
  3. Cuda 12.1%
  4. CMake 2.6%
  5. C 2.2%
  6. Shell 1.6%
Branch: master
Find file
Clone or download

Clone with HTTPS

Use Git or checkout with SVN using the web URL.

Open in Desktop Download ZIP

Latest commit

@mzient
mzient Normalize GPU - pImpl + Bessel's corrections (#1981) 
* Add pImpl front-end class: `dali::kernels::NormalizeGPU`
* Add Bessel's correction for standard deviation.

Signed-off-by: Michał Zientkiewicz <mzient@gmail.com>
Latest commit 9125deb May 27, 2020

Files

Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.github Update PR template (#1571) Dec 17, 2019
cmake Add -cudaXXX to dali package name (#1948) May 22, 2020
conda Add -cudaXXX to dali package name (#1948) May 22, 2020
dali Normalize GPU - pImpl + Bessel's corrections (#1981) May 27, 2020
dali_tf_plugin Add -cudaXXX to dali package name (#1948) May 22, 2020
docker Add -cudaXXX to dali package name (#1948) May 22, 2020
docs Fix typo in installation documentation (#1976) May 25, 2020
include/dali Fix out-of-source build (#1975) May 22, 2020
platforms Use CMake's CUDA language support (#1733) Feb 17, 2020
qa Update TF versions supported (#1973) May 22, 2020
third_party Make DALI buildable for Python 3.8 (#1782) Mar 14, 2020
tools Linter script change: from CMake to Python (#1951) May 12, 2020
.clang-format Extend shape support in DALI Dataset for TF (#1723) Mar 5, 2020
.gitignore Ignore VS Code settings directory in Git (#1826) Mar 18, 2020
.gitmodules Enable FFTS builds for ARM (Xavier, QNX) (#1686) Jan 27, 2020
Acknowledgements.txt Extend conda testing (#1784) Apr 26, 2020
CMakeLists.txt Add -cudaXXX to dali package name (#1948) May 22, 2020
CONTRIBUTING.md Add a STYLE_GUIDE for DALI, adjust Kernel example (#1167) Aug 19, 2019
COPYRIGHT Initial code drop Jun 18, 2018
DALI_EXTRA_VERSION Test for RNNT data pipeline (CPU) (#1745) Mar 7, 2020
Doxyfile CPU warp, with tests. (#1159) Aug 29, 2019
LICENSE Initial code drop Jun 18, 2018
README.rst Fix documentation drop-down menu and other links (#1972) May 21, 2020
STYLE_GUIDE.md GTest naming in STYLE_GUIDE (#1330) Oct 7, 2019
VERSION Update version to 0.23.0dev May 11, 2020

README.rst

License Documentation

NVIDIA DALI

Deep learning applications require complex, multi-stage pre-processing data pipelines. Such data pipelines involve compute-intensive operations that are carried out on the CPU. For example, tasks such as: load data from disk, decode, crop, random resize, color and spatial augmentations and format conversions, are mainly carried out on the CPUs, limiting the performance and scalability of training and inference.

In addition, the deep learning frameworks have multiple data pre-processing implementations, resulting in challenges such as portability of training and inference workflows, and code maintainability.

NVIDIA Data Loading Library (DALI) is a collection of highly optimized building blocks, and an execution engine, to accelerate the pre-processing of the input data for deep learning applications. DALI provides both the performance and the flexibility for accelerating different data pipelines as a single library. This single library can then be easily integrated into different deep learning training and inference applications.

Highlights

  • Full data pipeline--accelerated from reading the disk to getting ready for training and inference.
  • Flexibility through configurable graphs and custom operators.
  • Support for image classification and segmentation workloads.
  • Ease of integration through direct framework plugins and open source bindings.
  • Portable training workflows with multiple input formats: JPEG, PNG (fallback to CPU), TIFF (fallback to CPU), BMP (fallback to CPU), raw formats, LMDB, RecordIO, TFRecord.
  • Extensible for user-specific needs through open source license.

Table of Contents

Installing or building DALI

DALI is preinstalled in the NVIDIA GPU Cloud TensorFlow, PyTorch, and MXNet containers in versions 18.07 and later.

Latest DALI release as well as weekly and nightly developer builds can be installed using pip. Detailed instructions can be found in the documentation installation guide. Build instructions for DALI can be found in compilation guide.

Examples and tutorials

Introduction to DALI can be found at Getting started docs page.

The docs/examples directory contains a few examples (in the form of Jupyter notebooks) highlighting different features of DALI and how to use DALI to interface with deep learning frameworks.

Also note:

  • Documentation for the latest stable release is available here, and
  • Nightly version of the documentation that stays in sync with the master branch is available here.

Additional resources

  • GPU Technology Conference 2018; Fast data pipeline for deep learning training, T. Gale, S. Layton and P. Trędak: slides, recording.
  • GPU Technology Conference 2019; Fast AI data pre-preprocessing with DALI; Janusz Lisiecki, Michał Zientkiewicz: slides, recording.
  • GPU Technology Conference 2019; Integration of DALI with TensorRT on Xavier; Josh Park and Anurag Dixit: slides, recording.
  • GPU Technology Conference 2020; Fast Data Pre-Processing with NVIDIA Data Loading Library (DALI); Albert Wolant, Joaquin Anton Guirao recording.
  • Developer page.
  • Blog post.

Contributing to DALI

We welcome contributions to DALI. To contribute to DALI and make pull requests, follow the guidelines outlined in the Contributing document.

If you are looking for a task good for the start please check one from external contribution welcome label.

Reporting problems, asking questions

We appreciate feedback, questions or bug reports. When you need help with the code, follow the process outlined in the Stack Overflow https://stackoverflow.com/help/mcve document. Ensure that the posted examples are:

  • minimal: Use as little code as possible that still produces the same problem.
  • complete: Provide all parts needed to reproduce the problem. Check if you can strip external dependency and still show the problem. The less time we spend on reproducing the problems, the more time we can dedicate to the fixes.
  • verifiable: Test the code you are about to provide, to make sure that it reproduces the problem. Remove all other problems that are not related to your request.

Contributors

DALI is being built with major contributions from Trevor Gale, Przemek Tredak, Simon Layton, Andrei Ivanov, Serge Panev.

You can’t perform that action at this time.