Learning from better data
Learning is, at its core, fitting data, so the data often matters most. I am interested in which data should be used for which tasks, how to organize it into curricula, and how to construct effective data for knowledge distillation.
Where should knowledge live?
What should a model absorb into its parameters, retain in external memory, or receive through context? I am interested in how stability, reuse, and forgetting should affect that choice.
Exploration and self-improvement
A system can only learn from the experiences it produces. I am curious about agents that guide their own exploration and about whether useful exploration should happen in text, latent, or task-specific spaces.