Task bank

Tasks

Browse the tasks by category, intro, evaluation setting.

Public set

LLM Agent Memory Architecture Design

AI Models & Agents

Design an LLM agent memory architecture that generalizes

Small-Model Math Reasoning Post-Training

AI Models & Agents

Design a distillation recipe for a 1.7B student using a fixed 8B teacher

Scientific Discovery Agent Harness Design

AI Models & Agents

Redesign a ReAct harness for long-horizon scientific discovery in unseen simulated worlds

Vision-Language Compositional Generalization Post-Training

AI Models & Agents

Design a GRPO recipe for visual counting across unseen attribute combinations and renderers

Lean 4 Proof-Search LLM agent Workflow Design

AI Models & Agents

Design a compiler-guided LLM workflow for unseen theorems under fixed inference and checking budgets

Video Point-Track Candidate Routing

AI Models & Agents

Select candidate trajectories and predict visibility under a four-switch budget on unseen videos

TriFinger Cube-Pushing Offline RL

AI Models & Agents

Train a control policy from fixed logged trajectories without simulator interaction

Multi-View Point Cloud Fusion

AI Models & Agents

Fuse noisy multi-view observations into one point cloud

10M-Scale Metadata-Filtered ANN Search

Systems & Hardware

Optimize single-core top-10 vector retrieval under one- and two-tag predicates

EDA Standard-Cell Gate Sizing Optimization

Systems & Hardware

Minimize leakage while satisfying timing, slew, and capacitance constraints on unseen netlists

EDA Flip-Flop Banking and Placement Optimization

Systems & Hardware

Optimize multi-bit flip-flop grouping and legal placement across power, area, timing, and displacement costs

Quantum Color-Code Decoder

Systems & Hardware

Reimplement a colour-code decoder without the usual libraries

Quantum Circuit TDD Contraction Planning

Systems & Hardware

Choose contraction pairs to minimize peak diagram size and runtime in exact equivalence checking

Ragged GQA Training Kernel Optimization

Systems & Hardware

Accelerate packed variable-length attention with complete Q/K/V backward passes on unseen shapes

Multi-Stream Gated FlashFFTConv Kernel Optimization

Systems & Hardware

Accelerate gated causal long convolutions across independent streams and unseen shapes

Paged Ragged GQA Decode Kernel Optimization

Systems & Hardware

Accelerate grouped-query attention over paged, variable-length KV caches and unseen shapes

TPU v6e Masked GQA Kernel Optimization

Systems & Hardware

Accelerate decode, prefill, and encoder attention across masks, head-sharing ratios, and unseen shapes

Robot Routing and Macro-Program Optimization

Physical Sciences & Engineering

Jointly plan pickup routes and reusable macro recordings to minimize controller button presses

Power-Diode Extreme-Regime I–V Extrapolation

Physical Sciences & Engineering

Predict leakage and conduction currents at destructive voltage-temperature conditions from safe-window measurements

Distribution Feeder Model Calibration from Smart-Meter Data

Physical Sciences & Engineering

Jointly infer customer phases, line impedances, and regulator taps on unseen feeders

Tidal Seabed Friction Field Inversion

Physical Sciences & Engineering

Recover a spatial drag field from sparse, noisy tide-gauge amplitudes and phases on unseen basins

2048 Search-Policy Optimization

Optimization, Planning & Control

Maximize mean game score on unseen seeds under a pooled CPU budget

Query-Budgeted Noisy Black-Box Optimization

Optimization, Planning & Control

Minimize 10-dimensional multimodal objectives with 120 noisy evaluations on unseen instances

Query-Budgeted Stochastic Inventory Policy Optimization

Optimization, Planning & Control

Minimize simulated inventory cost by tuning four replenishment controls within 48 noisy queries

City-Scale Traffic Signal Control Optimization

Optimization, Planning & Control

Coordinate phases, green times, and offsets across ~600 junctions under unseen traffic demand

Fixed-Color-Budget Graph Coloring Optimization

Optimization, Planning & Control

Minimize monochromatic edges on unseen hard graphs under a 45-second solve limit

Defect-Aware Guillotine Glass Cutting Optimization

Optimization, Planning & Control

Pack glass orders into minimum stock plates under staged cuts, defects, and stack-sequence constraints

Cross-Site Chest X-Ray Triage Policy Optimization

Life Sciences & Medicine

Calibrate and rank frozen model scores to prioritize critical studies under a shared review budget

Unsupervised PBMC scATAC Batch Integration

Life Sciences & Medicine

Remove batch effects while preserving cell-type structure in embeddings recomputed on unseen cells

Perturbation-Conditioned Six-Channel Cell Morphology Generation

Life Sciences & Medicine

Generate treated-cell image distributions from controls and condition embeddings without paired examples

Five-Shot Lung scRNA-seq Cell-Type Annotation

Life Sciences & Medicine

Label donor-disjoint cells using five examples per class, an unlabeled pool, and a fixed reference model

Protein–Ligand Co-Folding Inference Optimization

Life Sciences & Medicine

Improve sampling, pose selection, and post-processing under physical-validity and 2 Å RMSD checks

Equity DCF Value-Driver Forecasting

Finance, Law & Business

Forecast growth, margins, reinvestment, WACC, and terminal growth for unseen companies from messy fundamentals

Multi-Matter Legal Research and Analysis Agent

Finance, Law & Business

Answer regulatory and transactional questions across six matters and 1,000+ case documents

Cross-Sectional Stock Return Ranking

Finance, Law & Business

Predict daily forward-return rankings from a 360-factor temporal panel on a sealed later period

Private set

Terminal Task Agent Scaffold

AI Models & Agents

Improve the harness around a frozen base model, not the model

Quantitative Reasoning Workflow

AI Models & Agents

One workflow that solves both maths and statistics problems

Gaussian Splat Compression

AI Models & Agents

Drop Gaussians to a budget while holding novel-view fidelity

Five-Step Image Sampler Schedule

AI Models & Agents

Optimize a five-query structured-image trajectory integrator

Budgeted Medical Reasoning

AI Models & Agents

Design a multi-agent medical QA workflow under a call budget

Point-Track Candidate Fusion

AI Models & Agents

Select and fuse point-track candidates over a lattice

Query-Driven Frame Selection

AI Models & Agents

Select query-conditioned temporal evidence from candidate tracklets

Ten-Call Diffusion Sampler

AI Models & Agents

Fit a ten-evaluation generative solver

World Model Hallucination Risk

AI Models & Agents

Predict when a world model is about to hallucinate, without labels

Edit Stability Under Image Variants

AI Models & Agents

Keep one semantic edit correct across nuisance variation

Haskell Dart Code Formatter

Systems & Hardware

Rebuild the Dart formatter in Haskell, byte-for-byte

Postgres Wire on SQLite

Systems & Hardware

Reimplement the PostgreSQL server over SQLite storage, in Zig

Incremental Placement Refinement

Systems & Hardware

Relocate, resize and buffer a placed netlist for better PPA

Mamba-3 Training Kernel

Systems & Hardware

Mamba-3 scan with joint states and a full backward pass

Unmeasured Dwelling Temperatures

Physical Sciences & Engineering

Predict summer indoor heat from one mild-season record

Climate Sub-Grid Emulator

Physical Sciences & Engineering

Emulate sub-grid convection for a climate model

Dual-Doppler Wind Retrieval

Physical Sciences & Engineering

Recover 3D wind where the vertical component is underdetermined

Online Hybrid Energy Management

Physical Sciences & Engineering

Split power in a hybrid using only what the car can see now

Exoplanet Atmospheric Retrieval

Physical Sciences & Engineering

Retrieve exoplanet atmospheres from transmission spectra

Sparse-Sensor Damage Mapping

Physical Sciences & Engineering

Localize stiffness loss in a steel structure

Real-Time Gear-Shift Policy

Physical Sciences & Engineering

Choose the gear every second to burn less fuel

Molecular Orbital Gap Model

Physical Sciences & Engineering

Predict a molecule's HOMO-LUMO gap from its SMILES string

Automated Parking Trajectories

Physical Sciences & Engineering

Park an Ackermann car in a tightly constrained slot

Photometric Source Classifier

Physical Sciences & Engineering

Classify transients and variables from their light curves

Time-Optimal Drone Racing

Physical Sciences & Engineering

Fly a quadrotor through gates in minimum time

Suspension Geometry Co-Design

Physical Sciences & Engineering

Place suspension hardpoints and pick the tuning that goes with them

Universal Scientific Law Fitter

Physical Sciences & Engineering

Propose an equation family that extrapolates, not just fits

Borehole Rock-Type Labeling

Physical Sciences & Engineering

Classify lithology facies from wireline well logs

Wind Farm Layout Optimization

Physical Sciences & Engineering

Place turbines so wakes cost the least energy

Disguised Objective Search

Optimization, Planning & Control

Ship a self-contained ask/tell optimizer

Bilevel Road Network Design

Optimization, Planning & Control

Choose which links to widen and how to price them

Self-Funding Rail Expansion

Optimization, Planning & Control

Grow a rail network that pays for its own next track

Dial-a-Ride Robotaxi Fleet

Optimization, Planning & Control

Dispatch robotaxis under two-sided time windows

Electric Van Charging Routes

Optimization, Planning & Control

Route electric vans that must detour to charge

OpenTTD Company Manager

Optimization, Planning & Control

Run a transport company for 20 simulated years

Recursive Sokoban Solver

Optimization, Planning & Control

Solve Sokoban where rooms nest inside themselves

Pickup and Delivery Routing

Optimization, Planning & Control

Serve 500 paired pickup-delivery requests on time

Railway Disruption Recovery

Optimization, Planning & Control

Dispatch trains through breakdowns you cannot see coming

Non-Crossing Crane Scheduling

Optimization, Planning & Control

Choreograph five terminal cranes that cannot pass each other

Battle Tetris Agent

Optimization, Planning & Control

Survive Battle Tetris with holds, combos and garbage

Urban Bus Route Network

Optimization, Planning & Control

Design a bus network that covers every node

Sequence-to-Signal ATAC-seq Model

Life Sciences & Medicine

Predict base-resolution chromatin accessibility from DNA

ECG Chagas Screening

Life Sciences & Medicine

Flag likely Chagas cases from a 12-lead ECG

Peak-to-Gene Expression Model

Life Sciences & Medicine

Predict expression from chromatin accessibility alone

Mini-Protein Stability Predictor

Life Sciences & Medicine

Train and ship a protein-stability regressor

OOD Cell Morphology Generation

Life Sciences & Medicine

Generate OOD cell morphology that keeps its mode of action

Cross-Protocol Cell-Type Transfer

Life Sciences & Medicine

Annotate cells across datasets with a frozen foundation model

TCR Binding Specificity Scorer

Life Sciences & Medicine

Match TCRs to epitopes never seen in training

Investment Banking Deal-Document Question Answering

Finance, Law & Business

Answer transaction and diligence questions grounded in underlying deal files

Management Consulting Engagement-Document Question Answering

Finance, Law & Business

Answer consulting questions grounded in underlying engagement files

Arbitrage-Free Implied-Volatility Surface Calibration

Finance, Law & Business

Calibrate an arbitrage-free volatility surface from a single noisy market snapshot

Transactional Legal Matter Document Reasoning

Finance, Law & Business

Resolve transactional legal matters across a 745-document case corpus

Multivariate Time-Series Structural Break Detection

Finance, Law & Business

Detect regime changes across a fleet of noisy time series