google / iree

Extending the IREE compiler and runtime to support scheduling work across multiple devices (CPU+CPU, CPU+GPU, GPU+GPU, etc).

Project to track tasks to improve development flow for benchmarking

Issues tracking the work required to stabilize the IREE compiled module files to the point where we have some semblance of backwards and forwards compatibility. While still in the alpha phase the format is expected to break many times but at some point we'll need to not do that :)

Improvements to the multi-threaded CPU execution system used for work distribution.

Tracking work on bring up of VMVX (VM Vector Extensions) as a replacement to the VMLA reference backend.

Creating a new website powered by Material for MkDocs (https://github.com/google/iree/issues/4414), with a keen focus on user-facing documentation pages. Forking some pages from our old documentation and writing some from scratch. Developer documentation will either live in a dedicated "Developers" category or will not be published to the site.

Tasks related to brining up ASR pipelines on IREE

Tracking work to get to a super minimal runtime for embedded systems by adding the missing equivalents for the full system versions (like single-threaded execution vs the task system, static linkage of artifacts vs dynamic loading, etc). Most work involved is shared with the rest of IREE's use cases but there are some specific priorities for bootstrapping such environments.

Tracking the work required to bring up a CUDA backend for IREE's HAL (both compiler and runtime).

Work to create a java API for the IREE runtime to build android apps.

Tracking work on the bring-up of a WebAssembly HAL backend capable of executing wasm executables produced by the IREE compiler.

Tentative equivalent of the 2020Q4 CPU perf burndown but with a focus on GPUs. A lot of the work here will still benefit the CPU side so this is roughly just a widening of the net across performance/representation issues.

Frontend ingestion as supported in IREE core or the support for allowing frontends to layer on top of IREE.

Work tracking improvements to how IREE integrates into user applications/libraries such that it is the middleware layer we want it to be.

Required work and improvements to get both the IREE compiler and runtime installable with vcpkg and usable as a dependency for downstream projects.

A project to add bindings/tflite/ that implement the tflite C API using the IREE C APIs and ensure we have end-to-end compiler support for tflite-to-codegen by way of TOSA.

Code generation tasks common to all hardware/accelerators

Work related to TF, XLA HLO, IREE, and SPIR-V optimization focused on producing better generated code.