We should allow data augmentation using masked-token prediction models through WordSwapMaskedLM. This would leverage the power of transformers like BERT to generate augmented inputs.

Some of the available datasets are downloaded in an uncompressed format. For example, Colin27 version 2008 takes 1014 MB. Some storage could be saved if the images were compressed after downloading.