Powerful modern math library for PHP: Features descriptive statistics and regressions; Continuous and discrete probability distributions; Linear algebra with matrices and vectors, Numerical analysis; special mathematical functions; Algebra

Hierarchical unsupervised and semi-supervised topic models for sparse count data with CorEx

Python package for information theory.

CorEx or "Correlation Explanation" discovers a hierarchy of informative latent factors. This reference implementation has been superseded by other versions below.

Multi-level network clustering based on the Map Equation

Non-parametric Entropy Estimation Toolbox

Interpretable data visualizations for understanding how texts differ at the word level

JIDT: Java Information Dynamics Toolkit for studying information-theoretic measures of computation in complex systems

A flexible version of CorEx developed for bio-data challenges that handles missing data, continuous/discrete variables, multi-CPU, overlapping structure, and includes visualizations

Information Theory and Distance Quantification with R

📚Сборник информации по Flutter

We propose a new Portfolio Management strategy combining Log-Optimal based Strategy and Reinforcement-Learning based Strategy.

Uncertainty and causal emergence in complex networks

Implementation of Information Dropout

A Coq formalization of information theory and linear error-correcting codes

Fast, linear version of CorEx for covariance estimation, dimensionality reduction, and subspace clustering with very under-sampled, high-dimensional data

Improving generalization by controlling label-noise information in neural network weights.

Probabilistic question-asking system: the program asks, the users answer. The minimal goal of the program is to identify what the user needs (a target), even if the user is not aware of the existence of such thing/product/service. The maximal goal is to achieve the processing power of a single neuron of a human brain on a single PC. Interactions with billions of other computers should achieve human-level intelligence (AGI).

Periodic time series analysis tools based on information theory

Adaptive and automatic gradient boosting computations.

An open-source library for Python 3 providing tools for analysis and simulation of analog and digital communication systems.

The HSIC Bottleneck: Deep Learning without Back-Propagation

Implementation of linear CorEx and temporal CorEx.

Code for our paper: "Constraining Implicit Space with MDL: Regularity Normalization as Unsupervised Attention".

Official Implementation of Learning Diverse and Discriminative Representations via the Principle of Maximal Coding Rate Reduction (2020)

Resources and Implementations (PyTorch) for Information Theoretical concepts in Deep Learning

An information-theoretic pipeline for methylation analysis of WGBS data

Information Theory Toolkit

📦 Lempel-Ziv Complexity, fast implementations with 🐍 Python (naive, Numba or Cython for speedup), Open-Source (MIT) 👍 →