GoodStartLabs/AI_Diplomacy
1
0
Fork 0
mirror of https://github.com/GoodStartLabs/AI_Diplomacy.git synced 2026-04-24 17:05:04 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Merge branch 'main' into streamline-prompts

Browse source
This commit is contained in:
Tyler Marques 2025-08-22 11:14:30 -07:00 • committed by GitHub
commit c95888bbf0
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
40 changed files with 15332 additions and 12655 deletions
Download patch file Download diff file Expand all files Collapse all files

17
experiment_runner/analysis/compare_stats.py
View file

@ -1,3 +1,20 @@
"""
experiment_runner.analysis.compare_stats
----------------------------------------
Compares two completed Diplomacy experiments, printing every metric
whose confidence interval (1 – α) excludes 0.
Derived “maximum‐ever” metrics
• max_supply_centers_owned – per-power max across phases
• max_territories_controlled – per-power max across phases
• max_military_units – per-power max across phases
• max_game_score – *game-level* max across powers
(only used in the aggregated-across-powers comparison)
All CLI semantics, CSV outputs, significance tests, etc., remain intact.
"""
from __future__ import annotations
from pathlib import Path