What they achieved is to create tiny student models. Trained on specific set of input. Off the teacher model's output.
There is clearly novelty in the method and what it achieve. Whether what it achieve would cover many cases that's another question.
This item has no comments currently.
It looks like you have JavaScript disabled. This web app requires that JavaScript is enabled.
Please enable JavaScript to use this site (or just go read Hacker News).
What they achieved is to create tiny student models. Trained on specific set of input. Off the teacher model's output.
There is clearly novelty in the method and what it achieve. Whether what it achieve would cover many cases that's another question.