What the model can see
Player-view video, audio, depth, language, and sensor measurements.
World-model data infrastructure
Actions attached.Futures learnable.
Observations, controls, state, and outcomes structured for models that learn what happens next.
Direct answer
What is an action trajectory?
An action trajectory is a time-ordered record connecting what an agent observed, what it did, how the environment changed, and what happened as a result.
World models learn environment dynamics. Action trajectories supply the causal sequence that makes prediction controllable.
Read the technical explanationFour linked signals. One usable episode.
A folder of clips becomes training infrastructure only when the streams resolve through a common clock and release record.
What changed the future
Keys, pointer deltas, gamepad axes, policy commands, or robot controls.
What the environment knew
Pose, physics, objects, inventory, score, contact, and system status.
What the action achieved
Progress, reward, event, success, failure, or terminal condition.
Evidence before access
A catalog that states what it can prove.
First-party inventory and public research references remain visibly separate. Every listing names creator, source, license, restrictions, and verification date.
Open directoryOpen reference2026-07-24
MineRL 2019
Human Minecraft demonstrations with recorded video, actions, rewards, and simulator-aligned state for imitation and reinforcement learning research.
- Creator
- MineRL Team
- Scale
- 60M+ annotated state-action pairs reported in the paper
- License
- MIT License
- Commercial use
- Rights review required
Useful data survives inspection.
The release should answer the questions a researcher, lawyer, and data engineer will ask before the first training run.
Which timestamp aligns every observation, action, and event?
What does each field mean, in which unit and coordinate frame?
Which source and transformation produced this file?
Who authorized training, delivery, and customer use?
Which checks passed, failed, or remain unknown?
Open references, honestly labeled.
These records help teams compare schemas and research uses. They are not ActionTrajectories products.
Open reference2026-07-24
Rocket Science
Synchronized four-player Rocket League video, keyboard actions, game events, and per-frame physics state used to train the MIRA multiplayer world model.
- Creator
- General Intuition and Kyutai, in collaboration with Epic Games
- Scale
- 15,769 train matches and 62 test matches, approximately 29.2 TB
- License
- CC BY-NC-SA 4.0
- Commercial use
- Non-commercial
Open reference2026-07-24
NitroGen
Per-frame gamepad action annotations for public gameplay videos, intended for behavior cloning and action-to-video world-model research.
- Creator
- NVIDIA Corporation
- Scale
- 30K annotated videos and approximately 15B annotated frames
- License
- CC BY-NC 4.0
- Commercial use
- Non-commercial
Research library
Buyers need definitions before they need a form.
Source-backed guides translate emerging terminology into dataset requirements, evaluation checks, and rights decisions.
Browse all resourcesWhat Data Do World Models Need?A practical guide to observations, actions, state, outcomes, time alignment, and coverage for world-model training datasets.Action-Conditioned Data vs. Passive VideoHow action labels change what a world model can learn, and when large passive-video corpora still provide value.Gameplay Data for World ModelsWhat makes gameplay data useful for interactive world models, from control capture and engine state to rights and replay filtering.How to Evaluate a World-Model DatasetA buyer-side evaluation framework covering alignment, coverage, state validity, leakage, rights, and loader-level QA.
Independent brand. Named operator.
ActionTrajectories is operated by 10xme Technology Inc. Dataset claims are tied to visible evidence, review dates, and primary sources.
Bring us the training target.
We will map it to the observations, actions, state, outcomes, rights, and delivery evidence the dataset must contain.