Adversarial robustness distillation is a common technique for transferring robustness from a large teacher model to a compact student. As described in a new arXiv paper, the standard paradigm treats the teacher as a fixed knowledge source and sends knowledge in one direction only. Once the distillation process ends, the teacher and student stop interacting.

The paper introduces CARD, a method that closes this loop. Rather than a one-way transfer, CARD keeps the teacher and student in an interactive relationship, though the abstract does not specify the exact mechanism. The significance is in reframing distillation as a bidirectional process rather than a static extraction.

The work is available on arXiv under identifier 2610.19911.