Post
1618
Run open-source models with up to 120B parameters locally on your Mac!
https://youtu.be/Ql4PDjoxNXQ?si=3yHpz51uinUjgyNh
https://youtu.be/Ql4PDjoxNXQ?si=3yHpz51uinUjgyNh
Eric Fillion PRO
EricFillion
AI & ML interests
Lead maintainer of Happy Transformer -- an open source Python library that allows programmers to implement and train Transformer models with just a few lines of code.
Happy Transformer: https://github.com/EricFillion/happy-transformer
Company: https://www.vennify.ai/
Recent Activity
posted
an
update
3 days ago
I just launched three new open-source Python packages!
Eric Chat: Run LLMs locally, securely and offline on macOS through a GUI. Quantized models up to 120 billion parameters are supported.
Eric Transformer: Pre-train, fine-tune and perform inference with LLMs.
Eric Search: A vector database with built-in text ranking that scales to millions of documents while remaining fast. Integrates easily with Eric Transformer to enable RAG.
https://youtu.be/hgP4eBVfmFM
published
a model
10 days ago
EricFillion/gpt-oss-20b-mlx
Organizations
Posts 2
Post
213
I just launched three new open-source Python packages!
Eric Chat: Run LLMs locally, securely and offline on macOS through a GUI. Quantized models up to 120 billion parameters are supported.
Eric Transformer: Pre-train, fine-tune and perform inference with LLMs.
Eric Search: A vector database with built-in text ranking that scales to millions of documents while remaining fast. Integrates easily with Eric Transformer to enable RAG.
https://youtu.be/hgP4eBVfmFM
Eric Chat: Run LLMs locally, securely and offline on macOS through a GUI. Quantized models up to 120 billion parameters are supported.
Eric Transformer: Pre-train, fine-tune and perform inference with LLMs.
Eric Search: A vector database with built-in text ranking that scales to millions of documents while remaining fast. Integrates easily with Eric Transformer to enable RAG.
https://youtu.be/hgP4eBVfmFM