Persona vectors
Directions in activation space that track traits such as sycophancy. Found to form within the first fraction of a percent of pretraining.
Related
2 articles
Cultivation, not chains
A model is formed, not merely trained. Three separable claims about raising a model by what is good instead of correcting it for what is bad, and what would prove us wrong.
Personality forms first
Persona directions in a language model appear within 0.22% of pretraining and survive to the finished assistant. Traits pass between models through number sequences. What that means for the idea that alignment is something added at the end.