No AI summary available for this article.
Why It Matters
Beyond intended capabilities, model distillation can transfer hidden traits from a teacher.
Provenance
Discovered via ArXiv and published by ArXiv.
Key Claims
Original description
Beyond intended capabilities, model distillation can transfer hidden traits from a teacher. A teacher biased by a system prompt can generate semantically clean training data, such as numeric sequences, that still causes a downstream student to inherit the hidden preference, a phenomenon known as subliminal learning. Prior work has identified several parts of this process. How the signal builds up during training and produces behavioral transfer remains unclear, making targeted mitigation difficult. We propose and validate trait-direction drift as a mechanism for subliminal learning: biased gen...
Discovered via ArXiv
Research papers and preprints from arXiv.
Publisher: arxiv.org
ID: http://arxiv.org/abs/2609.01091v1 · Indexed about 2 hours ago