Note that the 7B models are MoE with 1.1B active parameters and 400M models are dense models
AI & ML interests
None defined yet.
Recent Activity
models 14
open-lm-engine/gdn-7b
7B • Updated • 15 • 1
open-lm-engine/hybrid-gdn-7b
7B • Updated • 13 • 1
open-lm-engine/hybrid-gdn-m2rnn-1l-7b
7B • Updated • 14 • 1
open-lm-engine/hybrid-gdn-m2rnn-5l-7b
7B • Updated • 14 • 1
open-lm-engine/hybrid-m2rnn-7b
7B • Updated • 15 • 1
open-lm-engine/m2rnn-7b
7B • Updated • 14 • 1
open-lm-engine/transformer-7b
7B • Updated • 15 • 1
open-lm-engine/gdn-400m
0.4B • Updated • 13 • 1
open-lm-engine/hybrid-gdn-m2rnn-3l-400m
0.4B • Updated • 14 • 1
open-lm-engine/hybrid-gdn-m2rnn-1l-400m
0.4B • Updated • 15 • 1
datasets 0
None public yet