Commit graph

388 commits

Author SHA1 Message Date
Rich Jones
229086131a fix CCC scoring 2025-02-26 12:54:40 +01:00
Andreas Köpf
d115655f0a
Merge pull request #191 from zafstojano/env/shortest-path
feat(env): Shortest Path
2025-02-23 22:28:43 +01:00
Zafir Stojanovski
c5f37d5e9f predict actual path 2025-02-23 18:24:23 +01:00
Andreas Koepf
469934d9b7 minor arc_1d tweaks 2025-02-23 16:37:40 +01:00
Andreas Koepf
ba56aa0092 add arc_1d size range test 2025-02-23 12:58:51 +01:00
Andreas Koepf
7a45b14a49 fix index out of range of arc_1d dataset (#190) 2025-02-23 12:51:41 +01:00
Zafir Stojanovski
97b3097984 shortest path 2025-02-23 11:25:00 +01:00
Andreas Köpf
c56045b9a7
Merge branch 'main' into feat/emoji-mystery 2025-02-21 20:58:39 +01:00
joesharratt1229
9b9554e489 added tests 2025-02-21 17:58:13 +00:00
Andreas Köpf
1c6359f1f3
Merge pull request #181 from open-thought/rich/bitwise
Add Bitwise Arithmetic
2025-02-21 17:27:45 +01:00
Andreas Köpf
2947038557
Merge pull request #182 from zafstojano/env/binary-alternation
feat(env): Binary Alternation
2025-02-21 17:27:16 +01:00
Andreas Koepf (aider)
af4d79e947 fix: Handle negative hex number prefix variations in bitwise arithmetic test 2025-02-21 17:23:50 +01:00
Andreas Koepf (aider)
e846c53347 test: Update bitwise arithmetic difficulty levels to [1, 2, 3] 2025-02-21 17:22:36 +01:00
Andreas Koepf (aider)
660f7e6f03 test: Add comprehensive unit tests for BitwiseArithmeticDataset 2025-02-21 17:21:00 +01:00
Andreas Köpf
700aab6114
Merge pull request #180 from Adefioye/list-functions
Add induction-based tasks for list functions
2025-02-21 16:20:49 +01:00
Andreas Köpf
802b8c4bed
Merge branch 'main' into fix/prop_logix 2025-02-21 15:38:29 +01:00
Andreas Köpf
a6a5d30f1c
Merge pull request #175 from AhmedSaif2/fix-format
Add score_answer function to handle comma-formatted numbers
2025-02-21 15:36:21 +01:00
Andreas Koepf
3e7ff3b084 use native types List->list, Dict->dict, Set->set, Tuple->tuple 2025-02-21 15:15:38 +01:00
AhmedSaif2
5c45e55340 extend format tests to allow questions that ends with question marks 2025-02-21 15:50:03 +02:00
Zafir Stojanovski
96464388bb pre-commit 2025-02-21 13:39:05 +01:00
Zafir Stojanovski
941085e0c5 binary alternation 2025-02-21 13:09:21 +01:00
Rich Jones
17088e9b42 add bitwise arithmetic 2025-02-21 12:02:41 +01:00
abdulhakeem
624594bb1a Commit more changes 2025-02-21 00:37:29 -06:00
joesharratt1229
ed10c5f9bc added testing func for prop logic 2025-02-20 23:59:07 +00:00
Andreas Koepf
bedee59616 fix jugs unit test 2025-02-20 23:09:46 +01:00
Andreas Köpf
000e179781
Merge branch 'main' into env/rotten-oranges 2025-02-20 22:51:07 +01:00
Andreas Köpf
a8ce2747c1
Merge pull request #172 from open-thought/rich/jugs
Add Water Jug Puzzles
2025-02-20 22:48:12 +01:00
Zafir Stojanovski
0d65bf3668 rotten oranges 2025-02-20 22:33:39 +01:00
Andreas Köpf
994ffa8459
Merge pull request #170 from open-thought/rich/needle
Adds Needle in a Haystack problems
2025-02-20 22:12:47 +01:00
Rich Jones
0f798457ed jugs jugs jugs lint 2025-02-20 16:15:29 +01:00
Rich Jones
6f00690ae1 basic jugs 2025-02-20 15:24:46 +01:00
Andreas Köpf
e25973b118
Merge pull request #158 from open-thought/rich/decimalmath
Decimal Arithmetic
2025-02-20 12:35:41 +01:00
Rich Jones
621c20d8d8 adds Needle in a Haystack problems 2025-02-20 12:28:30 +01:00
Andreas Koepf
50eab616f8 use correct signature for CryptarithmDataset.score_answer() method 2025-02-20 11:55:32 +01:00
Andreas Köpf
8b03bf6a92
Merge pull request #169 from AhmedSaif2/products
Add allow-negation in products dataset
2025-02-20 11:30:21 +01:00
Andreas Köpf
6bbe8886e5
Merge pull request #155 from theblackcat102/cryptarithm
Cryptarithm add score_answer function
2025-02-20 11:28:03 +01:00
ahmedsaif
14b2f1f99d Add allow-negation in products dataset 2025-02-20 12:01:09 +02:00
Rich Jones
da9b215278 add to init 2025-02-20 10:51:00 +01:00
Rich Jones
edba52d2a2
Merge branch 'main' into rich/decimalmath 2025-02-20 10:07:28 +01:00
theblackcat102
44559aac95 [fix] precommit not happy 2025-02-20 17:00:18 +08:00
theblackcat102
407b212326 [feat] remove answer parsing since its already handled 2025-02-20 16:57:51 +08:00
Andreas Köpf
1cf44267f3
Merge pull request #164 from vncntt/decimal_chain_sum
decimal_chain_sum
2025-02-20 00:14:23 +01:00
vncntt
83e5e92126 decimal refactor 2025-02-19 14:46:27 -08:00
Andreas Köpf
e2702092f4
reasoning-gym-server & cli tool (#154)
* feat: Add initial server structure with configuration, registry, and middleware

* feat: Add chain_sum dataset to experiment registry test

* fix: Update test_registry to use DatasetSpec for composite config validation

* refactor: Update Pydantic config to use json_schema_extra and ConfigDict

* feat: Add Pydantic models for API request/response data

* feat: Implement basic experiment management endpoints with tests

* feat: Implement composite configuration endpoints for experiments

* fix: Add missing DatasetConfigUpdate import in server.py

* refactor: Update dataset config update method to properly merge config updates

* fix: Correctly retrieve current dataset config in composite endpoint

* feat: Add basic CLI structure with experiments and config commands

* feat: Add initial CLI tool with basic experiment management commands

* refactor: Reorganize CLI package structure and fix import paths

* refactor: Implement initial CLI commands for experiment management

* feat: Implement HTTP client for Reasoning Gym server in RGC CLI tool

* fix: Move print statements inside try block to resolve SyntaxError

* fix: Resolve SyntaxError in edit_config function by adding missing except block

* feat: Add default app instance in server module for easier uvicorn startup

* docs: Add README.md with server and RGC tool documentation

* remove unused files

* refactor: Remove unsupported type annotation in registry.py

* refactor: Move ExperimentRegistry to coaching module and add Experiment class

* fix: Add missing CompositeDataset import in test_registry.py

* refactor: Implement lazy ASGI app creation for server initialization

* feat: Add health check command to RGC CLI for server connection

* feat: Add version tracking support to CompositeDataset

* feat: Add DatasetVersionManager for tracking dataset versions

* feat: Add entry_id metadata and score_answer_with_id method to CompositeDataset

* feat: Add entry_id metadata combining version and index

* fix: Resolve undefined variable by storing version_id before use

* test: Add comprehensive unit tests for score_answer_with_id() function

* test: Add comprehensive version tracking test for dataset config updates

* feat: Validate dataset weights are positive in CompositeDataset initialization

* feat: Add weight update and normalization methods to CompositeDataset

* refactor: Centralize weight normalization in CompositeDataset and allow zero-weight datasets

* feat: Add negative weight validation to CompositeDataset constructor

* feat: Add duplicate dataset name check in CompositeDataset and update test

* refactor: Move duplicate dataset name check inside dataset iteration loop

* refactor: Update CompositeDataset weight management to use config as source of truth

* refactor: Move duplicate dataset name check to CompositeConfig.validate()

* test: Update composite dataset weight test assertions and validation

* feat: Add methods to add and remove datasets in CompositeDataset

* refactor: Remove weight normalization and use unnormalized weights directly

* refactor: Remove redundant total weight check in update_dataset_weights

* feat: Add batch generation and scoring endpoints to server

* fix: Import BatchEntry in server.py to resolve undefined name error

* refactor: Update ReasoningGymDataset to use server for batch generation and scoring

* fix: Add missing List and Dict type imports

* feat: Add get_batch() and score_outputs() methods to RGClient

* test: Add unit tests for generate_batch and score_outputs endpoints

* refactor: Add DatasetVersionManager to Experiment class and CompositeDataset constructor

* feat: Add validation for base_index and batch_size in generate_batch endpoint

* refactor: Remove unused BatchRequest type from imports

* refactor: Convert models to use Pydantic exclusively

* test: Update scoring endpoint tests to use correct request model format

* refactor: Rename ScoreItem to AnswerItem and update related code

* feat: Update scoring endpoint to return ordered ScoringResponse with scores and entry_ids

* fix: Add missing ScoringResponse import in server.py

* move verl ppo sample with server into own file

* refactor: Use Pydantic models for get_batch() and score_outputs() in RGClient

* refactor: Update client methods to use Pydantic models for type safety

* refactor: Use Pydantic models for experiment and dataset config operations

* refactor: Clean up duplicate methods and improve error handling in main.py

* first bits of rg server use for verl

* refactor: Optimize scoring with single HTTP request in _score_output

* fix: Correct experiment creation with ExperimentCreate object

* grpo tests with server
2025-02-19 22:41:33 +01:00
vncntt
810afd5d05 . and negative bug 2025-02-19 10:06:13 -08:00
Rich Jones
17ba950c1a implement decimal precision 2025-02-19 12:30:07 +01:00
Zafir Stojanovski
f9a3fd4ddf number format 2025-02-19 11:41:06 +01:00
vncntt
60cedc62dd decimal_chain_sum 2025-02-19 01:51:10 -08:00
Rich Jones
59229bd2d2 Merge branch 'rich/decimalmath' of github.com:open-thought/reasoning-gym into rich/decimalmath 2025-02-19 03:34:57 +01:00
Rich Jones
19b697c89a [wip] more flexible api 2025-02-19 03:29:40 +01:00