Neo Dim

NeoDim's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in bartowski/starchat2-15b-v0.1-GGUF almost 2 years ago

What is the prompt format?

13

#1 opened almost 2 years ago by

balukumar

New activity in NeoDim/starcoder-GGML over 2 years ago

how did you convert `transformers.PreTrainedTokenizer` to ggml format?

1

#2 opened over 2 years ago by

keunwoochoi

New activity in NeoDim/starchat-alpha-GGML over 2 years ago

demo space

2

#4 opened over 2 years ago by

matthoffner

New activity in NeoDim/starchat-alpha-GGML almost 3 years ago

Looks like the starchat-alpha-ggml-q4_1.bin is broken

8

#3 opened almost 3 years ago by

xhyi

New activity in NeoDim/starcoderbase-GGML almost 3 years ago

missing tok_embeddings.weight error when trying to run with llama.cpp

2

#1 opened almost 3 years ago by

ultra2mh

New activity in NeoDim/starcoder-GGML almost 3 years ago

Cannot run on llama.cpp and koboldcpp

👍 3

3

#1 opened almost 3 years ago by

FenixInDarkSolo

New activity in NeoDim/starchat-alpha-GGML almost 3 years ago

Which inference repo is this quantized for?

3

#2 opened almost 3 years ago by

xhyi

Can the quantized model be loaded in gpu to have faster inference ?

6

#1 opened almost 3 years ago by

MohamedRashad

Can the quantized model be loaded in gpu to have faster inference ?

6

#1 opened almost 3 years ago by

MohamedRashad

New activity in NeoDim/starcoder-GGML almost 3 years ago

Cannot run on llama.cpp and koboldcpp

👍 3

3

#1 opened almost 3 years ago by

FenixInDarkSolo

New activity in NeoDim/starchat-alpha-GGML almost 3 years ago

Can the quantized model be loaded in gpu to have faster inference ?

6

#1 opened almost 3 years ago by

MohamedRashad