Multi-task active learning (MTL-AL) aims to select the most informative data points while training a model on multiple tasks simultaneously. According to a new preprint on arXiv, most existing MTL-AL methods combine heterogeneous objectives—such as uncertainty, diversity, and gradient conflict—using a simple linear scalarization. The authors argue that this entangled formulation is problematic, though the abstract is cut short before fully explaining why.
The paper's title points to a central tension: the paradox of gradient conflict and orthogonal decomposition. The authors propose a way to deconstruct the problem, likely by separating objectives into orthogonal components to reduce interference. However, the abstract does not provide implementation details, so the exact mechanism remains unclear from the announcement alone.
If the proposed approach holds up, it could offer a more principled way to balance competing goals in active learning for multi-task models. For now, the preprint serves as a critique of current practices and a call for more careful handling of objective interactions in this growing area of research.