My distillation of noisy student paper

Latest noisy student paper has improved Imagenet SOTA results by almost 2%. On the face of it, it is an easy paper to read and understand. Following are my take aways from it. Dataset size They have used all 14M labelled images for supervised learning and additional 300M unlabelled images for generating pseudo labels. Unlabelled [...]