Shaping capabilities with token-level data filtering
Paper
ā¢ 2601.21571 ā¢ Published
ā¢ 27
AI & ML interests
This organization is maintained by the transformers team at Hugging Face and contains the historical (pre-"Hub") Facebook AI checkpoints like XLM, RoBERTa, XLM-RoBERTa.
Recent Activity
View all activity
julien-cĀ
submitted a paper to Daily Papers 24 days ago
Post
7948
We're kick-starting the process of Transformers v5, with @ArthurZ and @cyrilvallez !
v5 should be significant: we're using it as a milestone for performance optimizations, saner defaults, and a much cleaner code base worthy of 2025.
Fun fact: v4.0.0-rc-1 came out on Nov 19, 2020, nearly five years ago!
v5 should be significant: we're using it as a milestone for performance optimizations, saner defaults, and a much cleaner code base worthy of 2025.
Fun fact: v4.0.0-rc-1 came out on Nov 19, 2020, nearly five years ago!
- 6 replies
Post
9409
BOOOOM: Today I'm dropping TINY AGENTS
the 50 lines of code Agent in Javascript š„
I spent the last few weeks working on this, so I hope you will like it.
I've been diving into MCP (Model Context Protocol) to understand what the hype was all about.
It is fairly simple, but still quite powerful: MCP is a standard API to expose sets of Tools that can be hooked to LLMs.
But while doing that, came my second realization:
Once you have a MCP Client, an Agent is literally just a while loop on top of it. š¤Æ
ā”ļø read it exclusively on the official HF blog: https://huggingface.co/blog/tiny-agents
the 50 lines of code Agent in Javascript š„
I spent the last few weeks working on this, so I hope you will like it.
I've been diving into MCP (Model Context Protocol) to understand what the hype was all about.
It is fairly simple, but still quite powerful: MCP is a standard API to expose sets of Tools that can be hooked to LLMs.
But while doing that, came my second realization:
Once you have a MCP Client, an Agent is literally just a while loop on top of it. š¤Æ
ā”ļø read it exclusively on the official HF blog: https://huggingface.co/blog/tiny-agents
- 1 reply
Post
4397
Important notice šØ
For Inference Providers who have built support for our Billing API (currently: Fal, Novita, HF-Inference ā with more coming soon), we've started enabling Pay as you go (=PAYG)
What this means is that you can use those Inference Providers beyond the free included credits, and they're charged to your HF account.
You can see it on this view: any provider that does not have a "Billing disabled" badge, is PAYG-compatible.
For Inference Providers who have built support for our Billing API (currently: Fal, Novita, HF-Inference ā with more coming soon), we've started enabling Pay as you go (=PAYG)
What this means is that you can use those Inference Providers beyond the free included credits, and they're charged to your HF account.
You can see it on this view: any provider that does not have a "Billing disabled" badge, is PAYG-compatible.
- 9 replies
Post
8331
SmolVLM-2 and SigLIP-2 are now part of
They're added on top of the v4.49.0 release, and can be installed from the following tags:
This marks a new beginning for the release process of transformers. For the past five years, we've been doing monthly releases featuring many models (v4.49.0, the latest release, features 9 new architectures).
Starting with SmolVLM-2 & SigLIP2, we'll now additionally release tags supporting new models on a stable branch. These models are therefore directly available for use by installing from the tag itself. These tags will continue to be updated with fixes applied to these models.
Going forward, continue expecting software releases following semantic versioning: v4.50.0 will have ~10 new architectures compared to v4.49.0, as well as a myriad of new features, improvements and bug fixes. Accompanying these software releases, we'll release tags offering brand new models as fast as possible, to make them accessible to all immediately.
transformers in dedicated releases!They're added on top of the v4.49.0 release, and can be installed from the following tags:
v4.49.0-SmolVLM-2 and v4.49.0-SigLIP-2.This marks a new beginning for the release process of transformers. For the past five years, we've been doing monthly releases featuring many models (v4.49.0, the latest release, features 9 new architectures).
Starting with SmolVLM-2 & SigLIP2, we'll now additionally release tags supporting new models on a stable branch. These models are therefore directly available for use by installing from the tag itself. These tags will continue to be updated with fixes applied to these models.
Going forward, continue expecting software releases following semantic versioning: v4.50.0 will have ~10 new architectures compared to v4.49.0, as well as a myriad of new features, improvements and bug fixes. Accompanying these software releases, we'll release tags offering brand new models as fast as possible, to make them accessible to all immediately.
- 1 reply
Post
11398
After some heated discussion š„, we clarify our intent re. storage limits on the Hub
TL;DR:
- public storage is free, and (unless blatant abuse) unlimited. We do ask that you consider upgrading to PRO and/or Enterprise Hub if possible
- private storage is paid above a significant free tier (1TB if you have a paid account, 100GB otherwise)
docs: https://huggingface.co/docs/hub/storage-limits
We optimize our infrastructure continuously to scale our storage for the coming years of growth in Machine learning, to the benefit of the community š„
cc: @reach-vb @pierric @victor and the HF team
TL;DR:
- public storage is free, and (unless blatant abuse) unlimited. We do ask that you consider upgrading to PRO and/or Enterprise Hub if possible
- private storage is paid above a significant free tier (1TB if you have a paid account, 100GB otherwise)
docs: https://huggingface.co/docs/hub/storage-limits
We optimize our infrastructure continuously to scale our storage for the coming years of growth in Machine learning, to the benefit of the community š„
cc: @reach-vb @pierric @victor and the HF team
-
- 29 replies
Post
3282
wow š®
INTELLECT-1 is the first collaboratively trained 10 billion parameter language model trained from scratch on 1 trillion tokens of English text and code.
PrimeIntellect/INTELLECT-1-Instruct
INTELLECT-1 is the first collaboratively trained 10 billion parameter language model trained from scratch on 1 trillion tokens of English text and code.
PrimeIntellect/INTELLECT-1-Instruct
Post
5281
Hey it was good meeting you yesterday @MaziyarPanahi š„
thanks @mishig for setting this up
Let's make the Hub as useful as possible for the community ā¤ļø
thanks @mishig for setting this up
Let's make the Hub as useful as possible for the community ā¤ļø
- 1 reply
Post
6970
text-generation-inference (TGI) is now fully open-source again!
Along with text-embeddings-inference.
We just switched both of those repos' license back to Apache 2. š„
Along with text-embeddings-inference.
We just switched both of those repos' license back to Apache 2. š„
Post
3234
Very glad to welcome @josefprusa , pioneer of 3D printing and open source hardware, founder of https://www.prusa3d.com/, to the HF Hub š
AI applied to 3D printing could be big.
AI applied to 3D printing could be big.
- 1 reply
Post
671 authors š¤Æ
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context (2403.05530) Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context (2403.05530) Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
-
- 2 replies
Post
What if you could casually access your remote GPU in HF Spaces from the comfort of your local VSCode š¤Æ
-
-
- 8 replies
lysandreĀ
updated 8 models about 2 years ago
FacebookAI/xlm-roberta-large-finetuned-conll03-german
Token Classification ā¢ Updated
ā¢ 7.36k ā¢ ā¢ 14
FacebookAI/xlm-roberta-large-finetuned-conll03-english
Token Classification ā¢ 0.6B ā¢ Updated
ā¢ 100k ā¢ ā¢ 182
FacebookAI/xlm-roberta-large-finetuned-conll02-spanish
Fill-Mask ā¢ 0.6B ā¢ Updated
ā¢ 134 ā¢ 2
FacebookAI/xlm-roberta-large-finetuned-conll02-dutch
Fill-Mask ā¢ Updated
ā¢ 631 ā¢ 5
FacebookAI/xlm-roberta-large
Fill-Mask ā¢ 0.6B ā¢ Updated
ā¢ 6.05M ā¢ ā¢ 496
FacebookAI/xlm-roberta-base
Fill-Mask ā¢ 0.3B ā¢ Updated
ā¢ 22.8M ā¢ ā¢ 789
FacebookAI/roberta-large-mnli
Text Classification ā¢ 0.4B ā¢ Updated
ā¢ 316k ā¢ ā¢ 207
FacebookAI/roberta-large
Fill-Mask ā¢ 0.4B ā¢ Updated
ā¢ 20.1M ā¢ ā¢ 265