Mohammed Khalil's picture

Mohammed Khalil

mohamed-khalil

·

https://v3xlrm1nOwo1.github.io

AI & ML interests

ML Researcher || NLP || anime

Recent Activity

liked a dataset 2 months ago

reacted to Jaward's post with ❤️ 7 months ago

nanoBLT: Simplified lightweight implementation of a character-level Byte Latent Transformer model (under 500 lines of code). The model is 2x4x2 (n_layers_encoder, n_layers_latent, n_layers_decoder) layer deep trained on ~1M bytes of tiny Shakespeare with a patch size of 4. Code: https://github.com/Jaykef/ai-algorithms/blob/main/byte_latent_transformer.ipynb

upvoted a paper 9 months ago

Large Language Diffusion Models

View all activity

Organizations

mohamed-khalil 's models

None public yet