TimEE: End-to-end Time Series Classification via In-Context Learning
Traditional time series classification (TSC) operates on a decoupled, two-stage paradigm: a feature encoder is trained either from scratch or via pretraining, followed by fitting a task-specific classifier. This approach separates representation learning from the classification objective, demands per-dataset training, and fails to leverage label information dynamically during inference. To resolve these limitations, researchers Jaris Küken, Shi Bin Hoo, Martin Mráz, Frank Hutter, and Lennart Purucker introduced TimEE in a paper published on arXiv. TimEE is a compact, 4.5-million-parameter foundation model that achieves end-to-end TSC in a single forward pass via in-context learning (ICL), eliminating the need for any per-dataset training or fine-tuning.
Engineered for machine learning practitioners and researchers seeking highly efficient, zero-shot time series analysis, TimEE implements the Prior-Data Fitted Network (PFN) framework. It is meta-trained exclusively on synthetically generated TSC tasks characterized by structured distributional shifts, meaning the model never encounters real-world time series during its training phase. At inference, given a labeled support set and an unlabeled query time series, TimEE directly outputs a predicted class distribution. Despite its purely synthetic pretraining, TimEE ranks first in ROC AUC and third in accuracy on the competitive UCR benchmark, outperforming existing foundation models and supervised deep learning baselines that are trained directly on target data.
This work demonstrates that purely synthetic priors combined with end-to-end in-context learning can match or exceed the performance of traditional supervised approaches. Going forward, TimEE establishes a new paradigm for time series modeling, shifting the focus from transfer learning via representation alignment to direct in-context reasoning. It opens promising research directions in scaling model capacity, refining synthetic data generation processes, and designing richer prior distributions to handle increasingly complex temporal dynamics. Note that this analysis is based on the published abstract of the paper.