FrontierMemory

Changelog

  1. Corpus

    • Updated the corpus to v1.1 (750 trajectories) to reduce reward hacking through trajectory metadata and balance out the corpus sources.

    Results

    • Reran every model and harness on the v1.1 corpus, with three independent runs each.
    • Leaderboard scores are now the mean of the three runs, with ±1 standard deviation error bars.

  2. Models

    • Added GPT-6.1 Terra.
    • Added DeepSeek V4.1 Flash.
    • Added Kimi K3.1 Pro.