What If the Harness Comes Before Pretraining? A Data Flywheel Perspective
The usual way that people look at the agent life cycle follows a temporal order: pretrain, midtrain, posttrain. And then, almost as an afterthought, the harness comes. First you train the model, then you build the harness. However, in this post we will argue that the harness and pretraining, the two ends of the pipeline, are secretly holding hands. And this comes in two directions: ...