Parag Ekbote PRO

AINovice2005

https://paragekbote.github.io/

AI & ML interests

ML Engineer passionate about taking models from research to production. 1 year supporting tech startups. Active OSS contributor.

Recent Activity

posted an update 4 days ago

In celebration of the new storage graph feature on the Hub, here's mine 😊 : Post inspired by @ZennyKenny

updated a model 6 days ago

AINovice2005/ModernBERT-base-lora-cicflow-1m-r8

updated a model 6 days ago

AINovice2005/ModernBERT-base-lora-cicflow-1m-r16

View all activity

Organizations

posted an update 4 days ago

Post

3450

In celebration of the new storage graph feature on the Hub, here's mine 😊 :

Post inspired by @ZennyKenny

updated 3 models 6 days ago

posted an update 7 days ago

Post

136

I recently created my first storage bucket to store experiment data of my performance analysis of 15 tokenizers across 20 languages.

The setup is simple enough for a new product and can be scalable depending on the use-case 🤗 .

Bucket: https://huggingface.co/buckets/AINovice2005/tokenizer-benchmark

github gist: https://gist.github.com/ParagEkbote/b3877f667f84cbb9a27bdaca94ba662a

Article: https://medium.com/@paragekbote23/one-sentence-fifteen-tokenizers-a-tokenizer-benchmarking-pipeline-with-hf-storage-buckets-2e59790276fd

posted an update 8 days ago

Post

140

I'm pleased to announce that native trackio support has landed in optuna v.4.8.0.

Now you can store HPO trial data to the 🤗 Hub as a dataset: AINovice2005/toy-optuna-hpo-dataset

or Space: AINovice2005/optuna-dashboard

Article which talks about the integration: https://medium.com/@paragekbote23/designing-and-contributing-an-optuna-integration-that-performs-well-in-practice-21a07d77ec2c

posted an update 12 days ago

Post

Pro tip2: You can treat HF datasets as versioned repos by pinning a specific revision (tag, branch or commit) when downloading files. 🧠

This ensures your data processing pipelines always use the exact dataset state before passing the data to the model. It enables reproducible pipelines and allows for reliable outputs of your ML system.

from huggingface_hub import hf_hub_download

data_path = hf_hub_download(
    repo_id="lysandre/arxiv-nlp",
    filename="train.parquet",
    repo_type="dataset",
    revision="877b84a8f93f2d619faa2a6e514a32beef88ab0a"
)

upvoted an article 12 days ago

Article

Ulysses Sequence Parallelism: Training with Million-Token Contexts

16 days ago

•

reactedto sdiazlor's post with 🚀 12 days ago

Post

2597

More OSS than ever with the latest pruna 0.3.2 release. It extends existing algorithm families, such as compilers, kernels, and pruners, and adds new ones, including decoders, distillers, enhancers, and recoverers. But it's not only a collection of algorithms; instead, you can easily combine them to get the biggest efficiency win.

Read the full blog here: https://huggingface.co/blog/PrunaAI/pruna-0-3-2-open-source-optimization-algorithms