Distillation Makes AI Models Smaller and Cheaper

"The paper was rejected from a conference, and Vinyals, discouraged, turned to other topics."

"The original distillation paper, still published only on the arxiv.org preprint server, has now been cited more than 25,000 times (opens a new tab)."

I wonder what the reason was for rejecting this critical paper.