Update README.md
Browse files
README.md
CHANGED
|
@@ -52,7 +52,7 @@ tags:
|
|
| 52 |
<p class="justified-text">
|
| 53 |
After intense refining, <b>Nerdsking-python-coder-3B-i</b> has achieved <b>88.41 in HumanEval (bf16)</b>, ranking it amongst the highest-performing Python-focused 3B models ever reported on HumanEval. Surpassing even much bigger models in that area.
|
| 54 |
</p>
|
| 55 |
-
<i>Benchmark details (164 tasks):</i>
|
| 56 |
|
| 57 |
- official HumanEval execution protocol: test suites executed via `exec()`
|
| 58 |
- zero-shot pass@1
|
|
|
|
| 52 |
<p class="justified-text">
|
| 53 |
After intense refining, <b>Nerdsking-python-coder-3B-i</b> has achieved <b>88.41 in HumanEval (bf16)</b>, ranking it amongst the highest-performing Python-focused 3B models ever reported on HumanEval. Surpassing even much bigger models in that area.
|
| 54 |
</p>
|
| 55 |
+
<i>Benchmark details (164 tasks.):</i>
|
| 56 |
|
| 57 |
- official HumanEval execution protocol: test suites executed via `exec()`
|
| 58 |
- zero-shot pass@1
|