File size: 784 Bytes
4264d2c 6abc08c 4264d2c 6abc08c 4264d2c 6abc08c 4264d2c |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 |
---
license: cc-by-nc-4.0
language:
- en
---
Fimbulvetr-v2 but extended to 16K with PoSE. A sane context value would be ~12K before it degrades.
<br>I get consistent and reliable answers at ~11K context fine.
<br> Still coherent at up to 16K though! Just works not that well.
Notes:
<br> \- I noticed peoplle having bad issues with quants. Be it GGUF or others, at 8 bit or less. Kind of a weird issue? I had little to no issues during testing at the full precision
<br> \- Slightly different results from base Fimbulvetr-v2, but during my tests they are similar enough. The vibes are still there.
<br> \- Formatting issues happen rarely. Sometimes. A reroll / regenerate fixes it from tests.
 |