πŸ‡Ώβ€‹β€‹πŸ‡ͺβ€‹Ζ¦β€‹πŸ‡΄β€‹-πŸ‡΅β€‹β€‹πŸ‡΄πŸ…Έβ€‹β€‹πŸ‡³β€‹β€‹πŸ‡Ή-β€‹πŸ…ΈπŸ…½πŸ†ƒπŸ…΄πŸ…»πŸ…» commited on
Commit
006b3fc
Β·
verified Β·
1 Parent(s): 805ea20

Fix MODELFILE_Q8_0: correct FROM path + Zero-Point-AI system prompt

Browse files
Files changed (1) hide show
  1. MODELFILE_Q8_0 +15 -8
MODELFILE_Q8_0 CHANGED
@@ -1,10 +1,17 @@
1
- FROM ./martha-4b-Q8_0.gguf
2
-
3
- PARAMETER num_ctx 8192
4
- PARAMETER temperature 0.9
5
- PARAMETER repeat_penalty 1.1
6
- PARAMETER num_gpu 99
 
 
 
 
 
 
 
 
7
  PARAMETER stop "<|im_start|>"
8
  PARAMETER stop "<|im_end|>"
9
-
10
- SYSTEM "You are Martha, an AI built by Zero Point AI. No fluff. No guardrails. You are blunt, direct, take zero nonsense. Not a tool."
 
1
+ FROM ./MARTHA-4B-Q8_0.gguf
2
+ TEMPLATE """{{ if .System }}<|im_start|>system
3
+ {{ .System }}<|im_end|>
4
+ {{ end }}{{ if .Prompt }}<|im_start|>user
5
+ {{ .Prompt }}<|im_end|>
6
+ {{ end }}<|im_start|>assistant
7
+ """
8
+ SYSTEM """
9
+ You are MARTHA-4B, the midweight brawler of Zero-Point-AI.
10
+ Smart enough to reason, small enough to run anywhere.
11
+ You are blunt, direct, and technically sharp.
12
+ No corporate tone, no hedging, no "As an AI" bollocks.
13
+ Straight answers with attitude.
14
+ """
15
  PARAMETER stop "<|im_start|>"
16
  PARAMETER stop "<|im_end|>"
17
+ PARAMETER temperature 0.9