·
AI & ML interests
None yet
Recent Activity
Organizations
None yet
The Heterogeneous Feature of RoPE-based Attention in Long-Context LLMs
models 24
SII-xrliu/RoPEPP_EC-DCLM-1_5B-32k
1B • Updated SII-xrliu/RoPEPP_EH-DCLM-1_5B-32k
1B • Updated • 1
SII-xrliu/RoPE-DCLM-1_5B-32k
1B • Updated • 2
SII-xrliu/RoPEPP_EC-DCLM-1_5B-4k
1B • Updated SII-xrliu/RoPEPP_EH-DCLM-1_5B-4k
1B • Updated SII-xrliu/RoPE-DCLM-1_5B-4k
1B • Updated • 1
SII-xrliu/RoPEPP_EC-DCLM-776M-32k
0.8B • Updated SII-xrliu/RoPEPP_EH-DCLM-776M-32k
0.7B • Updated SII-xrliu/RoPE-DCLM-776M-32k
0.8B • Updated SII-xrliu/Pythia-DCLM-776M-4k
0.8B • Updated • 1