PAIR Interpretability
This repo contains code and articles on PAIR interpretability projects.
Visualizing and Measuring the Geometry of BERT
bert-tree and context-atlas are repos for two interactive blogposts/visualizations for the paper Visualizing and Measuring the Geometry of BERT :
-
Language, trees, and geometry in neural networks explores the geometry of syntactic information in BERT (bert-tree)
-
Language, Context, and Geometry in Neural Network explores semantics and context in BERT. See the accompanying tool, Context Atlas, for more details (context-atlas)
Deep dreaming on text
text-dream contains different experiments and tools to work with deep dreaming for text.