7B (act-order true-sequential groupsize)
wikitext2 5.677095890045166 (stock 16bit)
wikitext2 5.768329620361328 (32g)
wikitext2 5.833956718444824 (128g)
ptb-new 10.10704231262207 (stock 16bit)
ptb-new 10.273148536682129 (32g)
ptb-new 10.347890853881836 (128g)
c4-new 7.343583106994629 (stock 16bit)
c4-new 7.443920612335205 (32g)
c4-new 7.5146918296813965 (128g)