Update README.md
Browse files
README.md
CHANGED
@@ -1,7 +1,7 @@
|
|
1 |
---
|
2 |
license: mit
|
3 |
datasets:
|
4 |
-
- TIGER-Lab/AceCode-
|
5 |
language:
|
6 |
- en
|
7 |
base_model:
|
@@ -13,23 +13,23 @@ tags:
|
|
13 |
---
|
14 |
|
15 |
|
16 |
-
# 🂡 AceCode-
|
17 |
|
18 |
[Paper](https://arxiv.org/abs/2502.01718) |
|
19 |
[Github](https://github.com/TIGER-AI-Lab/AceCoder) |
|
20 |
-
[AceCode-
|
21 |
[AceCodePair-300K](https://huggingface.co/datasets/TIGER-Lab/AceCodePair-300K) |
|
22 |
[RM/RL Models](https://huggingface.co/collections/TIGER-Lab/acecoder-67a16011a6c7d65cad529eba)
|
23 |
|
24 |
|
25 |
-
We introduce AceCoder, the first work to propose a fully automated pipeline for synthesizing large-scale reliable tests used for the reward model training and reinforcement learning in the coding scenario. To do this, we curated the dataset AceCode-
|
26 |
|
27 |
![https://tiger-ai-lab.github.io/AceCoder/static/images/ac_overview.png](https://tiger-ai-lab.github.io/AceCoder/static/images/ac_overview.png)
|
28 |
|
29 |
|
30 |
## Note
|
31 |
-
- **This model official is trained on the hard version of [TIGER-Lab/AceCode-
|
32 |
-
- You can reproduce the hard version of [TIGER-Lab/AceCode-
|
33 |
- The training takes 6 hours to finish on 8 x H100 GPUs in around 80 optimization steps.
|
34 |
- To reproduce the training, please refer to our [training script in the Github](#)
|
35 |
- To use the model, please refer to the codes in [Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct)
|
|
|
1 |
---
|
2 |
license: mit
|
3 |
datasets:
|
4 |
+
- TIGER-Lab/AceCode-87K
|
5 |
language:
|
6 |
- en
|
7 |
base_model:
|
|
|
13 |
---
|
14 |
|
15 |
|
16 |
+
# 🂡 AceCode-87K
|
17 |
|
18 |
[Paper](https://arxiv.org/abs/2502.01718) |
|
19 |
[Github](https://github.com/TIGER-AI-Lab/AceCoder) |
|
20 |
+
[AceCode-87K](https://huggingface.co/datasets/TIGER-Lab/AceCode-87K) |
|
21 |
[AceCodePair-300K](https://huggingface.co/datasets/TIGER-Lab/AceCodePair-300K) |
|
22 |
[RM/RL Models](https://huggingface.co/collections/TIGER-Lab/acecoder-67a16011a6c7d65cad529eba)
|
23 |
|
24 |
|
25 |
+
We introduce AceCoder, the first work to propose a fully automated pipeline for synthesizing large-scale reliable tests used for the reward model training and reinforcement learning in the coding scenario. To do this, we curated the dataset AceCode-87K, where we start from a seed code dataset and prompt powerful LLMs to "imagine" proper test cases for the coding question and filter the noisy ones. We sample inferences from existing coder models and compute their pass rate as the reliable and verifiable rewards for both training the reward model and conducting the reinforcement learning for coder LLM.
|
26 |
|
27 |
![https://tiger-ai-lab.github.io/AceCoder/static/images/ac_overview.png](https://tiger-ai-lab.github.io/AceCoder/static/images/ac_overview.png)
|
28 |
|
29 |
|
30 |
## Note
|
31 |
+
- **This model official is trained on the hard version of [TIGER-Lab/AceCode-87K](https://huggingface.co/datasets/TIGER-Lab/AceCode-87K) with about 22k examples, using the [TIGER-Lab/AceCodeRM-7B](https://huggingface.co/TIGER-Lab/AceCodeRM-7B) as the reward**
|
32 |
+
- You can reproduce the hard version of [TIGER-Lab/AceCode-87K](https://huggingface.co/datasets/TIGER-Lab/AceCode-87K) using [script in our Github](#)
|
33 |
- The training takes 6 hours to finish on 8 x H100 GPUs in around 80 optimization steps.
|
34 |
- To reproduce the training, please refer to our [training script in the Github](#)
|
35 |
- To use the model, please refer to the codes in [Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct)
|