Commit graph

714 commits

Author SHA1 Message Date
Rich Jones
c3ced61c6e adds Needle in a Haystack problems 2025-02-20 12:28:30 +01:00
Rich Jones
921c9b1d7b type hints
blind roboting
2025-02-20 12:10:28 +01:00
Andreas Koepf
6103bbe1b4 exclude PropositionalLogicDataset from auto-import (needs to be improved) 2025-02-20 12:08:48 +01:00
Andreas Koepf
67bf9d10cb use correct signature for CryptarithmDataset.score_answer() method 2025-02-20 11:55:32 +01:00
Andreas Köpf
e391981a67 Merge pull request #169 from AhmedSaif2/products
Add allow-negation in products dataset
2025-02-20 11:30:21 +01:00
Andreas Köpf
c6e0e5a6a2 Merge pull request #155 from theblackcat102/cryptarithm
Cryptarithm add score_answer function
2025-02-20 11:28:03 +01:00
Rich Jones
da0b882b87 rc gallery format 2025-02-20 11:26:05 +01:00
Rich Jones
988b093800 fix weird GoL fmt 2025-02-20 11:09:29 +01:00
ahmedsaif
df4bb0b897 Add allow-negation in products dataset 2025-02-20 12:01:09 +02:00
Rich Jones
e8691d74a1 add to init 2025-02-20 10:51:00 +01:00
Rich Jones
16d96e6af1 Merge branch 'rich/decimalmath' of github.com:open-thought/reasoning-gym into rich/decimalmath 2025-02-20 10:46:13 +01:00
Rich Jones
eb64e3a2b8 add random paren grouping 2025-02-20 10:46:01 +01:00
Rich Jones
772ca584b5 Merge branch 'main' into rich/decimalmath 2025-02-20 10:07:28 +01:00
theblackcat102
daa3b309f2 [fix] precommit not happy 2025-02-20 17:00:18 +08:00
theblackcat102
9c955f5b3c [feat] remove answer parsing since its already handled 2025-02-20 16:57:51 +08:00
Andreas Köpf
bd3ef0ee65 Merge pull request #166 from joesharratt1229/fix/envs
Fix/envs
2025-02-20 00:40:27 +01:00
vncntt
8423aba33f Merge branch 'open-thought:main' into decimal_chain_sum 2025-02-19 15:31:20 -08:00
vncntt
b94c385c46 register decimal_chain_sum 2025-02-19 15:30:30 -08:00
Andreas Köpf
3cd0fd9019 Merge pull request #164 from vncntt/decimal_chain_sum
decimal_chain_sum
2025-02-20 00:14:23 +01:00
vncntt
36ca729824 decimal refactor 2025-02-19 14:46:27 -08:00
Andreas Köpf
52b44c47d5 reasoning-gym-server & cli tool (#154)
* feat: Add initial server structure with configuration, registry, and middleware

* feat: Add chain_sum dataset to experiment registry test

* fix: Update test_registry to use DatasetSpec for composite config validation

* refactor: Update Pydantic config to use json_schema_extra and ConfigDict

* feat: Add Pydantic models for API request/response data

* feat: Implement basic experiment management endpoints with tests

* feat: Implement composite configuration endpoints for experiments

* fix: Add missing DatasetConfigUpdate import in server.py

* refactor: Update dataset config update method to properly merge config updates

* fix: Correctly retrieve current dataset config in composite endpoint

* feat: Add basic CLI structure with experiments and config commands

* feat: Add initial CLI tool with basic experiment management commands

* refactor: Reorganize CLI package structure and fix import paths

* refactor: Implement initial CLI commands for experiment management

* feat: Implement HTTP client for Reasoning Gym server in RGC CLI tool

* fix: Move print statements inside try block to resolve SyntaxError

* fix: Resolve SyntaxError in edit_config function by adding missing except block

* feat: Add default app instance in server module for easier uvicorn startup

* docs: Add README.md with server and RGC tool documentation

* remove unused files

* refactor: Remove unsupported type annotation in registry.py

* refactor: Move ExperimentRegistry to coaching module and add Experiment class

* fix: Add missing CompositeDataset import in test_registry.py

* refactor: Implement lazy ASGI app creation for server initialization

* feat: Add health check command to RGC CLI for server connection

* feat: Add version tracking support to CompositeDataset

* feat: Add DatasetVersionManager for tracking dataset versions

* feat: Add entry_id metadata and score_answer_with_id method to CompositeDataset

* feat: Add entry_id metadata combining version and index

* fix: Resolve undefined variable by storing version_id before use

* test: Add comprehensive unit tests for score_answer_with_id() function

* test: Add comprehensive version tracking test for dataset config updates

* feat: Validate dataset weights are positive in CompositeDataset initialization

* feat: Add weight update and normalization methods to CompositeDataset

* refactor: Centralize weight normalization in CompositeDataset and allow zero-weight datasets

* feat: Add negative weight validation to CompositeDataset constructor

* feat: Add duplicate dataset name check in CompositeDataset and update test

* refactor: Move duplicate dataset name check inside dataset iteration loop

* refactor: Update CompositeDataset weight management to use config as source of truth

* refactor: Move duplicate dataset name check to CompositeConfig.validate()

* test: Update composite dataset weight test assertions and validation

* feat: Add methods to add and remove datasets in CompositeDataset

* refactor: Remove weight normalization and use unnormalized weights directly

* refactor: Remove redundant total weight check in update_dataset_weights

* feat: Add batch generation and scoring endpoints to server

* fix: Import BatchEntry in server.py to resolve undefined name error

* refactor: Update ReasoningGymDataset to use server for batch generation and scoring

* fix: Add missing List and Dict type imports

* feat: Add get_batch() and score_outputs() methods to RGClient

* test: Add unit tests for generate_batch and score_outputs endpoints

* refactor: Add DatasetVersionManager to Experiment class and CompositeDataset constructor

* feat: Add validation for base_index and batch_size in generate_batch endpoint

* refactor: Remove unused BatchRequest type from imports

* refactor: Convert models to use Pydantic exclusively

* test: Update scoring endpoint tests to use correct request model format

* refactor: Rename ScoreItem to AnswerItem and update related code

* feat: Update scoring endpoint to return ordered ScoringResponse with scores and entry_ids

* fix: Add missing ScoringResponse import in server.py

* move verl ppo sample with server into own file

* refactor: Use Pydantic models for get_batch() and score_outputs() in RGClient

* refactor: Update client methods to use Pydantic models for type safety

* refactor: Use Pydantic models for experiment and dataset config operations

* refactor: Clean up duplicate methods and improve error handling in main.py

* first bits of rg server use for verl

* refactor: Optimize scoring with single HTTP request in _score_output

* fix: Correct experiment creation with ExperimentCreate object

* grpo tests with server
2025-02-19 22:41:33 +01:00
joesharratt1229
be9a7dbf06 adjusted geom prompt 2025-02-19 19:52:18 +00:00
joesharratt1229
4a9a47e7b5 updated geometry 2025-02-19 18:38:36 +00:00
joesharratt1229
ab0fb7a58c added zebra 2025-02-19 18:13:03 +00:00
joesharratt1229
1a27d9b0a4 added colour cube score answer impl 2025-02-19 18:12:31 +00:00
joesharratt1229
edfe7f19b1 cleaned up caesar cipher 2025-02-19 18:11:59 +00:00
Rich Jones
a76e56fccc implement decimal precision 2025-02-19 12:30:07 +01:00
Zafir Stojanovski
fec058d905 number format 2025-02-19 11:41:06 +01:00
vncntt
0420dfe433 decimal_chain_sum 2025-02-19 01:51:10 -08:00
Andreas Koepf
e9a2097a71 remove redundant assert in ChainSumConfig.validate() 2025-02-19 09:42:32 +01:00
Rich Jones
0cd2eb50d7 Merge branch 'rich/decimalmath' of github.com:open-thought/reasoning-gym into rich/decimalmath 2025-02-19 03:34:57 +01:00
Rich Jones
c3bc7937dc [wip] more flexible api 2025-02-19 03:29:40 +01:00
theblackcat102
c95a163ea6 [fix] normalize to <answer></answer> 2025-02-19 08:40:31 +08:00
Andreas Köpf
9fb231dde9 Merge pull request #161 from olliestanley/fix/sudoku-unique
Fix Sudoku generator for uniqueness, implement scoring
2025-02-18 22:55:43 +01:00
Oliver
47321936a5 Add docstring 2025-02-18 21:38:46 +00:00
Oliver
47b4f29c6a Remove now redundant is_valid function 2025-02-18 21:37:37 +00:00
Oliver
43ccddf1ac Remove comment 2025-02-18 21:32:15 +00:00
Oliver
368d13d470 Optimise Sudoku uniqueness checks 2025-02-18 21:30:59 +00:00
Oliver
c1d2e555ee Fix Sudoku generator uniqueness and scoring 2025-02-18 21:02:49 +00:00
Rich Jones
36b2bceda3 Merge branch 'main' into rich/decimalmath 2025-02-18 20:53:36 +01:00
Oliver
8a7c782c73 Tweak mini sudoku config 2025-02-18 18:46:14 +00:00
Oliver
90a77d0f5a Tweak mini sudoku config 2025-02-18 18:43:19 +00:00
Oliver
0ccb3cbdfd Tweak num_empty logic 2025-02-18 18:36:12 +00:00
Oliver
bf4c3d26d3 Ensure unique mini sudokus 2025-02-18 18:31:30 +00:00
Rich Jones
bd56a7b1fe lint 2025-02-18 19:22:03 +01:00
Rich Jones
e2bdfb4c1c decimal math 2025-02-18 19:20:33 +01:00
theblackcat102
822c096e73 [fix] pre-commit fix 2025-02-18 21:48:54 +08:00
theblackcat102
e714d5e395 [feat] add test case 2025-02-18 21:45:51 +08:00
theblackcat102
0e49bd8180 Merge remote-tracking branch 'upstream/main' into cryptarithm 2025-02-18 21:34:42 +08:00
theblackcat102
3975f78343 [feat] added score_answer function 2025-02-18 21:33:14 +08:00