google / uncertainty-metrics

Watch 9
Star 32
Fork 3

Code
Issues 18
Pull requests 3
Actions
Projects
Security
Insights

Code
Issues
Pull requests
Actions
Projects
Security
Insights

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Pick a username

Email Address

Password

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

18 Open 2 Closed

Author

Filter by author

Label

Filter by label

Use alt + click/return to exclude labels.

Projects

Filter by project

Milestones

Filter by milestone

Assignee

Filter by who’s assigned

Sort

Sort by

Newest Oldest Most commented Least commented Recently updated Least recently updated

Most reactions

Remove reliance on tensorflow's removed_undocumented function

#32 opened Aug 18, 2020 by dustinvtran

Convert all tensorflow based metrics to keras metrics.

#30 opened Aug 13, 2020 by JeremyNixon

normalize disagreement metric by default

#29 opened Aug 13, 2020 by dustinvtran

Add calibration metric from Verified Uncertainty Calibration.

#28 opened Aug 13, 2020 by JeremyNixon

Convert documentation with latex to include math-rendered images

#26 opened Aug 11, 2020 by dustinvtran

Update documentation to use import uncertainty_metrics.numpy as np for pytorch / sklearn users.

#25 opened Aug 10, 2020 by JeremyNixon

Add binary classification support to reliability_diagram

#24 opened Aug 8, 2020 by jereliu

Adjust Brier score implementation to use squared loss formulation

#23 opened Aug 8, 2020 by jereliu

Implement signed Expected Calibration Error (sECE)

#22 opened Aug 8, 2020 by jereliu

Add Reliability Diagrams for Classification and Regression

#11 opened Jun 26, 2020 by JeremyNixon

self.accuracies and self.confidences only return the final class when GeneralCalibrationError is class conditional.

#9 opened May 26, 2020 by JeremyNixon

Add and design diversity metrics API

#8 opened May 21, 2020 by dustinvtran

Consolidate calibration error APIs

#7 opened May 21, 2020 by dustinvtran

Numpy / Tensorflow input testing.

#6 opened May 21, 2020 by JeremyNixon

Add class number correction to general calibration error

#4 opened May 21, 2020 by JeremyNixon

Support arbitrary batch axes.

#3 opened May 21, 2020 by JeremyNixon

Speed up test for mutual information ensemble score.

#2 opened May 21, 2020 by JeremyNixon

Throw error message when returned calibration error is outside of 0-1 range.

#1 opened May 21, 2020 by JeremyNixon

ProTip! Type g p on any issue or pull request to go back to the pull request listing page.