| ``` | |
| 7B (act-order true-sequential groupsize) | |
| wikitext2 5.677095890045166 (stock 16bit) | |
| wikitext2 5.768329620361328 (32g) | |
| wikitext2 5.833956718444824 (128g) | |
| ptb-new 10.10704231262207 (stock 16bit) | |
| ptb-new 10.273148536682129 (32g) | |
| ptb-new 10.347890853881836 (128g) | |
| c4-new 7.343583106994629 (stock 16bit) | |
| c4-new 7.443920612335205 (32g) | |
| c4-new 7.5146918296813965 (128g) | |
| ``` |