data-integrity

Addax is an open source universal ETL tool that supports most of those RDBMS and NoSQLs on the planet, helping you transfer data from any one place to another.

Silent CORruption CHecker and filesystem audit tool

🤝 Enforce referential and data integrity in Cloud Firestore using triggers

Create "immutable" objects with no setters, just getters.

Transactional power-failsafe filesystem for microcontrollers

Fixes your dataset according to your rules.

Lightweight library to write, orchestrate and test your SQL ETL. Writing ETL with data integrity in mind.

A GitHub Action that makes it easy to use Great Expectations to validate your data pipelines in your CI workflows.

Big Data Bag Utilities

🛡️ Robust data integrity tool. Prove data, text, & files using the Ethereum blockchain.

Checks the data integrity of your files across backups!

A collection of handy ML and data visualization and validation tools. Go ahead and train, evaluate and validate your ML models and data with minimal effort.

Useful resources for data integrity

Data signing and verification for rotating credentials and algorithms

hash-based data manger for MATLAB and python. Address data by what it is, rather than where it is

A set of check digit algorithms implemented in Dart

A simple blockchain web interface based on BlockMatrix Implementation

64-bit CRC (ISO 3309) checksum generator using python 3.x

Create and verify HMAC's for JSON objects.

Protect data using Reed-Solomon algorithm

An IoT connected NFC reader for authenticating actions on the HIAS network. Designed for the PN532 RFID/NFC Reader/Writer using Raspberry Pi 2B and above,

This demonstration shows how to ensure data integrity of an IoT data streaming from a typical IoT device such as raspberry pi. This demonstration is using Veracity Data Lineage Service, and the data integrity information is stored in the live DTL environment - IOTA tangle mainnet.

Steps for data integrity checks

Filesystems Synchronisator: Filesystem backup and archiving tool

Validate and check files for data corruption.

A demonstration on how to dynamically serialize JSON using TypeScript

Cryptography and Computer Security (Python) AES encryption and decryption, AES CBC and OFB modes, Hash Algorithm, Checking Data Integrity

Course "Verteilte Systeme" at Vienna University of Technology

Test data accuracy in NI lvm and tdms files

A tool for data integrity verification based on checksum(s) and digital signature(s).