mirror of
https://github.com/NousResearch/atropos.git
synced 2026-04-19 12:57:58 +00:00
46f0602227
* minimal implementation, simplified challenge registry * need game save logic * fixed challenge gen, works with local test * updated challenge gen with wider ranges, working with local script * runs working correctly, wandb stats look ok * linting * Add diplomacy environment with AI_Diplomacy submodule - Add diplomacy_env_minimal.py for diplomacy game environment - Add atropos_client_minimal.py for client interface - Add diplomacy_local_server.py for local game server - Add AI_Diplomacy submodule from GoodStartLabs/AI_Diplomacy - Fix import ordering and remove unused imports * test file working, moving to cluster to test training * updated gitignore * removed logs * minor fixes, training running now * readded proxy reg and queue system * linting * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * queue gameid bug, refactored * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * cleaned up configs & allowed for openrouter models to be easily used * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * linting * Remove duplicate dependencies from diplomacy requirements.txt Only keep AI_Diplomacy-specific dependencies that aren't already in the main project --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
1.4 KiB
1.4 KiB
Minimal Diplomacy Environment
A simplified Diplomacy RL training environment for Atropos that integrates with AI_Diplomacy.
Overview
This minimal implementation provides:
- Basic game integration via AI_Diplomacy submodule
- Parallel rollouts with configurable group_size
- LLM request interception through AtroposClient proxy
- Simple supply center based scoring
- No complex features (no GRPO, memory systems, or advanced scoring)
Architecture
Atropos Policy Server
↓
AtroposClientMinimal (proxy)
↓
AI_Diplomacy Game Engine
↓
Game Execution
Quick Start
- Install dependencies:
pip install -r requirements.txt
cd AI_Diplomacy
pip install -e .
-
Start your Atropos policy server on port 8000
-
Run the environment:
python diplomacy_env_minimal.py serve
Configuration
Key settings in DiplomacyEnvMinimalConfig:
max_game_turns: Number of game turns (default: 10)training_power: Which power the RL agent controls (default: "FRANCE")group_size: Number of parallel games per trajectory (default: 4)
How It Works
- Parallel Rollouts: Each training step runs
group_sizegames with the same initial seed - LLM Interception: AtroposClientMinimal intercepts all LLM calls from AI_Diplomacy
- Trajectory Collection: Game interactions are collected and scored
- Best Selection: The highest scoring trajectory is returned for training