Home / Technology / AI Robot Learns to Play Doom and Fly Drones
AI Robot Learns to Play Doom and Fly Drones
23 Sep
Summary
- New AI model achieves high success rate on robotics benchmark.
- Model shows promise in robotics, simulations, and gaming.
- Open-weight model aims to simplify robot development.
German AI startup Black Forest Labs (BFL) has advanced into robotics with FLUX 3 Action, a 7-billion-parameter "World Action Model." This model translates camera observations, robot state, and natural language into physical actions. BFL reports a 42.92% success rate on NVIDIA's RoboLab-120 benchmark, potentially surpassing existing models.
Significantly, FLUX 3 Action uses fewer parameters than comparable models and runs faster, making it more efficient for deployment. BFL is exploring its application beyond physical robots, including simulations and gaming, with early experiments showing success in drone piloting and playing the game "Doom."
The company plans to release the model's weights, code, and training resources to facilitate developer use and fine-tuning on custom robot data. This open-weight approach aims to simplify the development and adaptation of robotic systems.
FLUX 3 Action builds on BFL's prior work in image and video models, optimizing for practical deployment. The model predicts future video frames and actions, allowing robots to interpret environments and plan subsequent movements, facilitating tasks like pick-and-place operations.
