Improving fastai's mixed precision support with NVIDIA's Automatic Mixed Precision.

vxlabs.com

TL;DR: For best results with mixed precision training, use NVIDIA’s Automatic Mixed Precision together with fastai, and remember to set any epsilons, for example in the optimizer, correctly.