awesome

Curated list of awesome Senzing software and resources. Inspired by other awesome sites.

Contents

1. Senzing's Top Picks
2. Documentation
3. Demonstrations
4. Docker
   1. Dockerfiles
   2. DockerHub
   3. docker-compose
   4. Kubernetes
   5. Helm Charts
5. Environment
   1. AWS environment
   2. Azure environment
6. Mapper
7. Resources
8. User Interface
9. Utilities
10. Under construction
11. Obsolete
12. Features and bugs
13. Other awesome sites

Senzing's Top Picks

Recommended projects from the team at Senzing.

1. docker-compose-demo - Demonstrate Senzing stack using docker-compose.
2. entity-search-web-app - A lightweight http server providing a web UI for entity search through the senzing api server.
3. senzing-api-server - Server of Senzing REST API.
4. stream-loader - Python tool for loading Senzing Engine from RabbitMQ, Kafka, or AWS SQS.
5. stream-producer - Produce a stream from different input formats.

Documentation

Documentation on Senzing usage.

1. Promoted articles - Promoted articles.
2. Senzing API for Developers - Senzing API for Developers.
3. Tags used in GitHub - GitHub tags for Senzing artifacts.
4. community-roadmap - A peek into the future of the Senzing Community.
5. evaluate - Information for evaluating Senzing at http://senzing.com/evaluate
6. video - Videos available at http://senzing.com/video

Demonstrations

Step-by-step instructions demonstrating use of Senzing.

1. aws-cloudformation-ecs - Multiple AWS Cloudformations demonstrating Senzing stack variations.
2. aws-cloudformation-ecs-poc-simple - Demonstrate Senzing stack using AWS CloudFormation - simplified.
3. azure-template-aks-poc-simple - An Azure ARM template for bringing up Senzing on Kubernetes (AKS)
4. docker-app-demo - Demonstrate Senzing stack using docker-app.
5. docker-compose-aws-ecscli-demo - Demonstrate Senzing stack using AWS ecs-cli.
6. docker-compose-demo - Demonstrate Senzing stack using docker-compose.
7. docker-python-demo - Dockerfile demonstrating simple Flask app using Senzing.
8. ibm-openshift-guide - Demonstrate Senzing stack using OpenShift and IBM Db2.
9. kubernetes-demo - Demonstrate Senzing stack using Kubernetes.
10. openshift-demo - Demonstrate Senzing stack using minishift.
11. senzing-up - Super easy Senzing demonstration using docker on Linux or Mac.

Dockerfiles

Repositories with Dockerfiles.

1. connector-neo4j - Transform Senzing data into Neo4j graph database.
2. data-encryption-aes256cbc-sample - This is a sample encryption plugin, for use with the G2 engine to encrypt sensitive data in the data repository.
3. docker-adminer - Dockerfile wrapping adminer, a database viewer.
4. docker-apt - Dockerfile wrapping apt-get, a package manager.
5. docker-aptdownloader - Dockerfile wrapping apt-get install --download-only.
6. docker-base-image-centos - A base docker image for Senzing processes built on CentOS.
7. docker-base-image-debian - A base docker image for Senzing processes built on Debian.
8. docker-compose-air-gapper - Create a TGZ bundle for air-gapped environments based on docker-compose.yaml
9. docker-db2-driver-installer - Install DB2 client drivers on mounted volumes.
10. docker-g2command - Dockerfile wrapping Senzing's G2Command.py.
11. docker-g2configtool - Dockerfile wrapping Senzing's G2ConfigTool.py.
12. docker-g2loader - Dockerfile wrapping Senzing's G2Loader.py.
13. docker-hello-world - Dockerfile for testing docker formations.
14. docker-ibm-db2 - Dockerfile wrapping ibmcom/db2 docker image.
15. docker-init-container - Dockerfile used to initialize Senzing artifacts.
16. docker-installer - Dockerfile use to install Senzing in a non-root container.
17. docker-jupyter - Dockerfile for running example Senzing Jupyter notebooks.
18. docker-mysql - Dockerfile wrapping mysql command line interpreter.
19. docker-mysql-init - Dockerfile for initializing mysql database with a one-time command.
20. docker-python-demo - Dockerfile demonstrating simple Flask app using Senzing.
21. docker-senzing-base - Dockerfile used in FROM statements.
22. docker-senzing-console - Docker-based console enabled for interacting with Senzing programs.
23. docker-senzing-debug - Dockerfile for debugging Senzing deployments.
24. docker-sshd - Dockerfile wrapping sshd.
25. docker-web-app-demo - Dockerfile combining Senzing API server and Senzing Entity WebApp.
26. docker-wrap-image-with-senzing-apt - Wrap an existing docker image with the Senzing package.
27. docker-wrap-image-with-senzing-data - Add /opt/senzing/data to a base image.
28. docker-xterm - Web-based X-terminal.
29. docker-yum - Dockerfile wrapping yum, a package manager.
30. docker-yumdownloader - Dockerfile wrapping yumdownloader.
31. entity-search-web-app - A lightweight http server providing a web UI for entity search through the senzing api server.
32. postgresql-client - A psql client that waits for the database to be ready before uploading SQL file.
33. redoer - Perform Senzing Redo operations.
34. resolver - Ephemeral Senzing entity-resolution.
35. risk-score-calculator - Risk scorer.
36. senzing-api-server - Server of Senzing REST API.
37. senzing-environment - Create an environment to use Senzing in a project / virtual environment style.
38. senzing-listener - Listener framework.
39. senzing-package - Python tool for installing Senzing package.
40. senzing-poc-server - Senzing API Server plus management APIs.
41. stream-loader - Python tool for loading Senzing Engine from RabbitMQ, Kafka, or AWS SQS.
42. stream-logger - A utility for dumping the contents of a stream to a log.
43. stream-producer - Produce a stream from different input formats.

DockerHub

Git repositories with Docker images on DockerHub.

1. data-encryption-aes256cbc-sample - This is a sample encryption plugin, for use with the G2 engine to encrypt sensitive data in the data repository.
2. docker-adminer - Dockerfile wrapping adminer, a database viewer.
3. docker-apt - Dockerfile wrapping apt-get, a package manager.
4. docker-aptdownloader - Dockerfile wrapping apt-get install --download-only.
5. docker-base-image-centos - A base docker image for Senzing processes built on CentOS.
6. docker-base-image-debian - A base docker image for Senzing processes built on Debian.
7. docker-db2-driver-installer - Install DB2 client drivers on mounted volumes.
8. docker-g2command - Dockerfile wrapping Senzing's G2Command.py.
9. docker-g2configtool - Dockerfile wrapping Senzing's G2ConfigTool.py.
10. docker-g2loader - Dockerfile wrapping Senzing's G2Loader.py.
11. docker-hello-world - Dockerfile for testing docker formations.
12. docker-ibm-db2 - Dockerfile wrapping ibmcom/db2 docker image.
13. docker-init-container - Dockerfile used to initialize Senzing artifacts.
14. docker-jupyter - Dockerfile for running example Senzing Jupyter notebooks.
15. docker-python-demo - Dockerfile demonstrating simple Flask app using Senzing.
16. docker-senzing-base - Dockerfile used in FROM statements.
17. docker-senzing-console - Docker-based console enabled for interacting with Senzing programs.
18. docker-senzing-debug - Dockerfile for debugging Senzing deployments.
19. docker-sshd - Dockerfile wrapping sshd.
20. docker-test - Used in Spikes. Not for production.
21. docker-web-app-demo - Dockerfile combining Senzing API server and Senzing Entity WebApp.
22. docker-xterm - Web-based X-terminal.
23. docker-yum - Dockerfile wrapping yum, a package manager.
24. docker-yumdownloader - Dockerfile wrapping yumdownloader.
25. entity-search-web-app - A lightweight http server providing a web UI for entity search through the senzing api server.
26. redoer - Perform Senzing Redo operations.
27. resolver - Ephemeral Senzing entity-resolution.
28. risk-score-calculator - Risk scorer.
29. senzing-api-server - Server of Senzing REST API.
30. senzing-environment - Create an environment to use Senzing in a project / virtual environment style.
31. senzing-listener - Listener framework.
32. senzing-package - Python tool for installing Senzing package.
33. senzing-poc-server - Senzing API Server plus management APIs.
34. stream-loader - Python tool for loading Senzing Engine from RabbitMQ, Kafka, or AWS SQS.
35. stream-logger - A utility for dumping the contents of a stream to a log.
36. stream-producer - Produce a stream from different input formats.

docker-compose

Docker formations using docker-compose.

1. docker-compose-air-gapper - Create a TGZ bundle for air-gapped environments based on docker-compose.yaml
2. docker-compose-demo - Demonstrate Senzing stack using docker-compose.

Kubernetes

Step-by-step instructions demonstrating use of Senzing on kubernetes-based systems.

1. azure-template-aks-poc-simple - An Azure ARM template for bringing up Senzing on Kubernetes (AKS)
2. charts - Helm Charts for use with Kubernetes, OpenShift, and Rancher.
3. kubernetes-demo - Demonstrate Senzing stack using Kubernetes.

Helm Charts

Git repositories with Helm Charts for Senzing on kubernetes-based systems.

1. charts - Helm Charts for use with Kubernetes, OpenShift, and Rancher.
2. docker-apt - Dockerfile wrapping apt-get, a package manager.
3. docker-db2-driver-installer - Install DB2 client drivers on mounted volumes.
4. docker-hello-world - Dockerfile for testing docker formations.
5. docker-ibm-db2 - Dockerfile wrapping ibmcom/db2 docker image.
6. docker-init-container - Dockerfile used to initialize Senzing artifacts.
7. docker-senzing-base - Dockerfile used in FROM statements.
8. docker-senzing-console - Docker-based console enabled for interacting with Senzing programs.
9. docker-senzing-debug - Dockerfile for debugging Senzing deployments.
10. docker-yum - Dockerfile wrapping yum, a package manager.
11. entity-search-web-app - A lightweight http server providing a web UI for entity search through the senzing api server.
12. redoer - Perform Senzing Redo operations.
13. resolver - Ephemeral Senzing entity-resolution.
14. senzing-api-server - Server of Senzing REST API.
15. senzing-package - Python tool for installing Senzing package.
16. senzing-poc-server - Senzing API Server plus management APIs.
17. stream-loader - Python tool for loading Senzing Engine from RabbitMQ, Kafka, or AWS SQS.
18. stream-producer - Produce a stream from different input formats.

AWS Environment

Projects specific to Amazon Web Services environment.

1. aws-cloudformation-database-cluster - AWS Cloudformation with VPC and Senzing database cluster
2. aws-cloudformation-ecs - Multiple AWS Cloudformations demonstrating Senzing stack variations.
3. aws-cloudformation-ecs-poc-simple - Demonstrate Senzing stack using AWS CloudFormation - simplified.
4. aws-cloudformation-ecs-senzing-stack-basic - AWS Cloudformation demonstrating a Senzing stack that can be used with aws-cloudformation-database-cluster.
5. aws-cloudformation-ecs-senzing-stack-choices - AWS Cloudformation with additional configuration options.
6. aws-marketplace-evaluation - AWS Marketplace offering.

Azure Environment

Projects specific to Microsoft's Azure environment.

1. azure-template-aks-poc-simple - An Azure ARM template for bringing up Senzing on Kubernetes (AKS)

Examples

Code that shows how to perform a task.

1. data-encryption-aes256cbc-sample - This is a sample encryption plugin, for use with the G2 engine to encrypt sensitive data in the data repository.

Mapper

Convert industry standard formats to Senzing-ready format.

1. mapper-base - Base functions used to map a variety of formats to a Senzing-acceptable format.
2. mapper-csv - Exemplar artifacts (files) that can be used in other Senzing repositories.
3. mapper-dnb - Map DNB format to Senzing format.
4. mapper-dowjones - Map Dow Jones Watchlist format to Senzing format.
5. mapper-icij - Map ICIJ format to Senzing format.
6. mapper-leie - Map US HHS LEIE to Senzing format.
7. mapper-nomino - Map Nomino format to Senzing format.
8. mapper-npi - Map NPPES NPI Registry to Senzing format.
9. mapper-ofac - Map OFAC to Senzing format.
10. mapper-openc - Map Open Corporate into Senzing format.
11. mapper-sayari - Map Sayari's global corporate data into Senzing format.

Resources

Non-code information.

1. awesome - Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.
2. knowledge-base - HOWTOs, tasks, explanations, and more knowledge.
3. senzing-data-encryption-specification - This is the interface for creating encryption plugins, to work with the G2 engine to encrypt sensitive data in the data repository.
4. senzing-entity-specification - None
5. senzing-rest-api-specification - OpenAPI specification of Senzing REST API.
6. senzing-sdk-api-specification - Software Development Kit documentation.
7. senzing.github.io - Organization site at http://hub.senzing.com

SDKs

Software development kits for various platforms.

1. g2-sdk-java - Java SDK hosted on MvnRepository.
2. g2-sdk-python - Python SDK hosted on PYPI.
3. sdk-components-ng - A collection of UI components to interface with the Senzing Rest API server.
4. sdk-graph-components - SDK components that can be used in other projects using Angular 7.X.X.
5. senzing-sdk-api-specification - Software Development Kit documentation.

User Interface

User interfaces for Senzing.

1. rest-api-client-ng - Angular TypeScript interfaces, and classes for interacting with the senzing-api-server.
2. sdk-components-ng - A collection of UI components to interface with the Senzing Rest API server.
3. sdk-graph-components - SDK components that can be used in other projects using Angular 7.X.X.

Utilities

Tools for working with Senzing.

1. ansible-playbook-demo - Example of Ansible playbook.
2. ansible-role-senzingapi - Ansible role - senzingapi
3. ansible-role-stream-producer - Ansible role - Senzing Stream Producer
4. docker-adminer - Dockerfile wrapping adminer, a database viewer.
5. docker-apt - Dockerfile wrapping apt-get, a package manager.
6. docker-aptdownloader - Dockerfile wrapping apt-get install --download-only.
7. docker-compose-air-gapper - Create a TGZ bundle for air-gapped environments based on docker-compose.yaml
8. docker-g2command - Dockerfile wrapping Senzing's G2Command.py.
9. docker-g2configtool - Dockerfile wrapping Senzing's G2ConfigTool.py.
10. docker-g2loader - Dockerfile wrapping Senzing's G2Loader.py.
11. docker-init-container - Dockerfile used to initialize Senzing artifacts.
12. docker-mysql - Dockerfile wrapping mysql command line interpreter.
13. docker-mysql-init - Dockerfile for initializing mysql database with a one-time command.
14. docker-senzing-debug - Dockerfile for debugging Senzing deployments.
15. docker-sshd - Dockerfile wrapping sshd.
16. docker-wrap-image-with-senzing-data - Add /opt/senzing/data to a base image.
17. docker-xterm - Web-based X-terminal.
18. docker-yum - Dockerfile wrapping yum, a package manager.
19. docker-yumdownloader - Dockerfile wrapping yumdownloader.
20. entity-search-web-app - A lightweight http server providing a web UI for entity search through the senzing api server.
21. g2-python - Tools found at g2/python in the SenzingAPI package.
22. github-util - Works with GitHub metadata.
23. governor-postgresql-transaction-id - Governor plugin for PostgreSQL transaction IDs.
24. packer-ansible - Use Packer to build virtual machines with Ansible.
25. postgresql-client - A psql client that waits for the database to be ready before uploading SQL file.
26. redoer - Perform Senzing Redo operations.
27. resolver - Ephemeral Senzing entity-resolution.
28. risk-score-calculator - Risk scorer.
29. senzing-api-server - Server of Senzing REST API.
30. senzing-commons-java - None
31. senzing-environment - Create an environment to use Senzing in a project / virtual environment style.
32. senzing-listener - Listener framework.
33. senzing-package - Python tool for installing Senzing package.
34. senzing-poc-server - Senzing API Server plus management APIs.
35. senzinggo - Run docker containers via pythonscript.
36. stream-loader - Python tool for loading Senzing Engine from RabbitMQ, Kafka, or AWS SQS.
37. stream-logger - A utility for dumping the contents of a stream to a log.
38. stream-producer - Produce a stream from different input formats.

Under construction

Being worked on. a.k.a. Fresh meat.

1. aws-cloudformation-dev-rest - AWS Cloudformation for developers using Senzing HTTP REST API
2. configurator - Web service for configuring Senzing.
3. data-mart-replicator - Data mart
4. docker-terraform-aws - 🚧 [Under construction]
5. java-g2loader - 🚧 [Under construction]
6. packer-senzing-demo-ubuntu-18.04 - 🚧 [Under construction] A packer build of a senzing demo.
7. rest-api-client-java - 🚧 [Under construction] - Client built from OpenAPI specification.
8. stream-configuration - 🚧 [Under construction] Temporary Senzing configuration service.

Obsolete

Although no longer current, may be informative.

1. certification - ⚠️ [Obsolete] Information on the Senzing Certification process.
2. certified - ⚠️ [Obsolete] Preliminary work on certified Senzing artifacts.
3. docker-compose-db2-cluster-demo - ⚠️ [Obsolete] Demonstrates docker-compose formation of Senzing, DB2 database cluster, and a simple Flask web app.
4. docker-g2command-db2-cluster - ⚠️ [Obsolete] Dockerfile of Senzing's python G2Command for DB2 cluster.
5. docker-g2loader-db2-cluster - ⚠️ [Obsolete] Dockerfile of Senzing's python G2Loader for DB2 cluster.
6. docker-opt-senzing - ⚠️ [Obsolete] Dockerfile containing a "baked-in" /opt/senzing directory.
7. docker-python-db2-cluster-base - ⚠️ [Obsolete] Dockerfile for Senzing, DB2 cluster, and python 2.7.
8. docker-python-db2-cluster-demo - ⚠️ [Obsolete] Dockerfile demonstrating simple Flask app using Senzing and DB2 cluster.
9. g2-configuration-initializer - ⚠️ [Obsolete] Replaced by https://github.com/Senzing/docker-init-container
10. hello-senzing-springboot-java - ⚠️ [Obsolete] Demonstrates how to create an HTTP interface to Senzing using SpringBoot.
11. mock-data-generator - ⚠️ [Obsolete] Python tool for generating mock Senzing data and sending it to Kafka, RabbitMQ, or STDOUT.
12. rancher-demo - ⚠️ [Obsolete] Demonstrates Rancher deployment of Senzing with queue, database, and Senzing API server.
13. spike-docker-store-based-images - ⚠️ [Obsolete] Use docker image in Docker Store.
14. webapp-drillthrough-demo - ⚠️ [Obsolete] A demonstration of Senzing drill through using Senzing developer toolkit, Node-RED, and Python Flask.

Features and bugs

How to request new features and bug fixes.

1. Request bug fix
2. Request new feature in existing repository
3. Request new feature

Other awesome sites

Our thanks to those who blazed the 'awesome' trail before us.

• General: sindresorhus/awesome,
• GoLang: avelino/awesome-go
• Java: java-lang/awesome-java, akullpp/awesome-java, awesome-java
• JavaScript: sorrycc/awesome-javascript, uhub/awesome-javascript
• PHP: https://github.com/uhub/awesome-php, ziadoz/awesome-php
• Python: vinta/awesome-python