Skip to content

Commit b10c4ad

Browse files
authored
chore(model): add l3.1-nemotron-sunfall-v0.7.0-i1 to the gallery (#4175)
Signed-off-by: Ettore Di Giacinto <[email protected]>
1 parent a7db97e commit b10c4ad

File tree

1 file changed

+22
-0
lines changed

1 file changed

+22
-0
lines changed

gallery/index.yaml

Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2883,6 +2883,28 @@
28832883
- filename: magnum-v2-4b.i1-Q4_K_M.gguf
28842884
sha256: 692618059fee8870759d67d275ebc59bc0474b18ae3571b3ebdec8f9da786a64
28852885
uri: huggingface://mradermacher/magnum-v2-4b-i1-GGUF/magnum-v2-4b.i1-Q4_K_M.gguf
2886+
- !!merge <<: *llama31
2887+
name: "l3.1-nemotron-sunfall-v0.7.0-i1"
2888+
urls:
2889+
- https://huggingface.co/crestf411/L3.1-nemotron-sunfall-v0.7.0
2890+
- https://huggingface.co/mradermacher/L3.1-nemotron-sunfall-v0.7.0-i1-GGUF
2891+
description: |
2892+
Significant revamping of the dataset metadata generation process, resulting in higher quality dataset overall. The "Diamond Law" experiment has been removed as it didn't seem to affect the model output enough to warrant set up complexity.
2893+
Recommended starting point:
2894+
Temperature: 1
2895+
MinP: 0.05~0.1
2896+
DRY: 0.8 1.75 2 0
2897+
At early context, I recommend keeping XTC disabled. Once you hit higher context sizes (10k+), enabling XTC at 0.1 / 0.5 seems to significantly improve the output, but YMMV. If the output drones on and is uninspiring, XTC can be extremely effective.
2898+
General heuristic:
2899+
Lots of slop? Temperature is too low. Raise it, or enable XTC. For early context, temp bump is probably preferred.
2900+
Is the model making mistakes about subtle or obvious details in the scene? Temperature is too high, OR XTC is enabled and/or XTC settings are too high. Lower temp and/or disable XTC.
2901+
overrides:
2902+
parameters:
2903+
model: L3.1-nemotron-sunfall-v0.7.0.i1-Q4_K_M.gguf
2904+
files:
2905+
- filename: L3.1-nemotron-sunfall-v0.7.0.i1-Q4_K_M.gguf
2906+
sha256: f9aa88f3b220e35662a2d62d1f615a3b425e348a8f9e2939f05bf57385119f76
2907+
uri: huggingface://mradermacher/L3.1-nemotron-sunfall-v0.7.0-i1-GGUF/L3.1-nemotron-sunfall-v0.7.0.i1-Q4_K_M.gguf
28862908
- &deepseek
28872909
## Deepseek
28882910
url: "github:mudler/LocalAI/gallery/deepseek.yaml@master"

0 commit comments

Comments
 (0)