Article
Improving Hugging Face Training Efficiency Through Packing with Flash Attention 2
- +4
•
42
Mayank Mishra
mayank-mishra
AI & ML interests
Large Language Models, Distributed Training and Inference
Recent Activity
updated a model 5 days ago
mayank-mishra/hybrid-mamba2-7b published a model 5 days ago
mayank-mishra/hybrid-mamba2-7b upvoted a collection 6 days ago
M2RNNOrganizations
published an article over 1 year ago
published an article almost 2 years ago
Article
Saving Memory Using Padding-Free Transformer Layers during Finetuning
•
21
published an article almost 2 years ago
Article
Aurora-M: The First Open Source Biden-Harris Executive Order Red teamed Multilingual Language Model
•
7