atropos/environments/kernelbench_env/README.md
2025-05-17 04:34:49 +00:00

25 lines
913 B
Markdown
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

# KernelBench Environment Setup Instructions
## Prerequisites
Before running this script, you need to install KernelBench:
1. Install KernelBench from source:
```bash
pip install git@github.com:ScalingIntelligence/KernelBench.git
cd KernelBench
pip install -r requirements.txt
pip install -e .
cd -
```
2. Set variables at the top of this script:
- `KERNELBENCH_LEVEL`: The difficulty level (1-3)
- `KERNELBENCH_PROBLEM_NUMBER`: The specific problem number to solve
- `KERNELBENCH_DIR`: The absolute path to your KernelBench install
These environment variables will be used to configure the evaluation environment.
## Citations
> Baronio,C., Marsella,P., Pan,B., & Alberti,S. (2025May6). **Kevin32B:MultiTurnRLforWritingCUDAKernels**. *CognitionAI Blog*. RetrievedMay16,2025, from<https://cognition.ai/blog/kevin-32b>