Hugging Face's logo

robustintelligence
/
pi-mmbert-v3.5

ONNX
Safetensors
multilingual
modernbert
prompt-injection
toxicity-detection
Model card Files
xet
 Community
5
Gerald001 robustdev commited on
Commit
10e00fc
·
1 Parent(s): da62618

Upload TRT model for Nvidia L40S (#2)

Browse files

- Upload TRT model for Nvidia L40S (963697ee01f0703908fc18fb273285dc2adbc17f)


Co-authored-by: Robust Dev <robustdev@users.noreply.huggingface.co>

Files changed (3) hide show
  1. .gitattributes +1 -0
  2. model_l40s_fp16.plan +3 -0
  3. trt_engine_layer_summary_l40s_fp16.txt +243 -0
.gitattributes CHANGED
@@ -34,3 +34,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  tokenizer.json filter=lfs diff=lfs merge=lfs -text
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  tokenizer.json filter=lfs diff=lfs merge=lfs -text
37
+ model_l40s_fp16.plan filter=lfs diff=lfs merge=lfs -text
model_l40s_fp16.plan ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f130e9518d3b77f8286e6e96e52d57b4000669e65ffa4848799661e0528dd5ee
3
+ size 618134820
trt_engine_layer_summary_l40s_fp16.txt ADDED
@@ -0,0 +1,243 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---- Resolved TRT Profile ----
2
+ MIN_BATCH=1
3
+ OPT_BATCH=3
4
+ MAX_BATCH=12
5
+ MIN_SEQ_LEN=1
6
+ OPT_SEQ_LEN=512
7
+ MAX_SEQ_LEN=512
8
+ WORKSPACE_SIZE=24696061952
9
+ BUILDER_OPTIMIZATION_LEVEL=3
10
+ PRECISION=fp16
11
+
12
+ ==== TensorRT Engine ====
13
+ Total Layers: 212
14
+
15
+ ==== Precision Statistics ====
16
+ Half: 696
17
+ Int64: 10
18
+ Float: 5
19
+
20
+ ==== Layer Type Statistics ====
21
+ kgen: 116
22
+ gemm: 89
23
+ reshape: 2
24
+ cast: 2
25
+ shape_call: 1
26
+ fusion: 1
27
+ Reformat: 1
28
+
29
+ ==== Layer List ====
30
+ # Type Precision Name
31
+ ----------------------------------------------------------------------------------------------------
32
+ 0 shape_call - __mye105005_0_myl0_0
33
+ 1 kgen Half __myl_SlicCastReplSubCastIotaCastReshCastReshReshSubAbsEqlLtOrReshNotSeleSele_myl0_1
34
+ 2 kgen Half __myl_MoveMul_myl0_2
35
+ 3 kgen Half __myl_CastGathCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_3
36
+ 4 gemm Half /model/layers_0/attn/Wqkv/MatMul_myl0_4
37
+ 5 reshape Int64 __mye378603_myl0_5
38
+ 6 cast Int64 cast_hvar^378599i64_myl0_6
39
+ 7 reshape Int64 __mye378629_myl0_7
40
+ 8 cast Int64 cast_hvar^378625i64_myl0_8
41
+ 9 kgen Half __myl_ConcSinCosReshReshTranSlicSlicReshMulSlicNegSlicConcMulAddTranSlicReshMulSlicNegSlicConcMulEtc_myl0_9
42
+ 10 kgen Half _gemm_mha_v2_myl0_10
43
+ 11 gemm Half /model/layers_0/attn/Wo/MatMul_myl0_11
44
+ 12 kgen Half __myl_ReshReshTranReshAddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_12
45
+ 13 gemm Half /model/layers_0/mlp/Wi/MatMul_myl0_13
46
+ 14 kgen Half __myl_TranReshSlicSlicDivCastErfCastAddMulMulMul_myl0_14
47
+ 15 gemm Half /model/layers_0/mlp/Wo/MatMul_myl0_15
48
+ 16 kgen Half __myl_TranReshAddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_16
49
+ 17 gemm Half /model/layers_1/attn/Wqkv/MatMul_myl0_17
50
+ 18 kgen Half __myl_ConcSinCosReshReshReshTranReshMoveReshTranSlicSlicReshSlicNegSlicConcMulMulAddTranSlicReshEtc_myl0_18
51
+ 19 kgen Half _gemm_mha_v2_myl0_19
52
+ 20 gemm Half /model/layers_1/attn/Wo/MatMul_myl0_20
53
+ 21 kgen Half __myl_AddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_21
54
+ 22 gemm Half /model/layers_1/mlp/Wi/MatMul_myl0_22
55
+ 23 kgen Half __myl_TranReshSlicSlicDivCastErfCastAddMulMulMul_myl0_23
56
+ 24 gemm Half /model/layers_1/mlp/Wo/MatMul_myl0_24
57
+ 25 kgen Half __myl_TranReshAddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_25
58
+ 26 gemm Half /model/layers_2/attn/Wqkv/MatMul_myl0_26
59
+ 27 kgen Half __myl_ReshTranReshMoveReshTranSlicSlicReshSlicNegSlicConcMulMulAddTranSlicReshSlicNegSlicConcMulEtc_myl0_27
60
+ 28 kgen Half _gemm_mha_v2_myl0_28
61
+ 29 gemm Half /model/layers_2/attn/Wo/MatMul_myl0_29
62
+ 30 kgen Half __myl_AddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_30
63
+ 31 gemm Half /model/layers_2/mlp/Wi/MatMul_myl0_31
64
+ 32 kgen Half __myl_TranReshSlicSlicDivCastErfCastAddMulMulMul_myl0_32
65
+ 33 gemm Half /model/layers_2/mlp/Wo/MatMul_myl0_33
66
+ 34 kgen Half __myl_TranReshAddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_34
67
+ 35 gemm Half /model/layers_3/attn/Wqkv/MatMul_myl0_35
68
+ 36 kgen Half __myl_ReshTranReshMoveReshTranSlicSlicReshSlicNegSlicConcMulMulAddTranSlicReshSlicNegSlicConcMulEtc_myl0_36
69
+ 37 kgen Half _gemm_mha_v2_myl0_37
70
+ 38 gemm Half /model/layers_3/attn/Wo/MatMul_myl0_38
71
+ 39 kgen Half __myl_AddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_39
72
+ 40 gemm Half /model/layers_3/mlp/Wi/MatMul_myl0_40
73
+ 41 kgen Half __myl_TranReshSlicSlicDivCastErfCastAddMulMulMul_myl0_41
74
+ 42 gemm Half /model/layers_3/mlp/Wo/MatMul_myl0_42
75
+ 43 kgen Half __myl_TranReshAddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_43
76
+ 44 gemm Half /model/layers_4/attn/Wqkv/MatMul_myl0_44
77
+ 45 kgen Half __myl_ReshTranReshMoveReshTranSlicSlicReshSlicNegSlicConcMulMulAddTranSlicReshSlicNegSlicConcMulEtc_myl0_45
78
+ 46 kgen Half _gemm_mha_v2_myl0_46
79
+ 47 gemm Half /model/layers_4/attn/Wo/MatMul_myl0_47
80
+ 48 kgen Half __myl_AddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_48
81
+ 49 gemm Half /model/layers_4/mlp/Wi/MatMul_myl0_49
82
+ 50 kgen Half __myl_TranReshSlicSlicDivCastErfCastAddMulMulMul_myl0_50
83
+ 51 gemm Half /model/layers_4/mlp/Wo/MatMul_myl0_51
84
+ 52 kgen Half __myl_TranReshAddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_52
85
+ 53 gemm Half /model/layers_5/attn/Wqkv/MatMul_myl0_53
86
+ 54 kgen Half __myl_ReshTranReshMoveReshTranSlicSlicReshSlicNegSlicConcMulMulAddTranSlicReshSlicNegSlicConcMulEtc_myl0_54
87
+ 55 kgen Half _gemm_mha_v2_myl0_55
88
+ 56 gemm Half /model/layers_5/attn/Wo/MatMul_myl0_56
89
+ 57 kgen Half __myl_AddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_57
90
+ 58 gemm Half /model/layers_5/mlp/Wi/MatMul_myl0_58
91
+ 59 kgen Half __myl_TranReshSlicSlicDivCastErfCastAddMulMulMul_myl0_59
92
+ 60 gemm Half /model/layers_5/mlp/Wo/MatMul_myl0_60
93
+ 61 kgen Half __myl_TranReshAddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_61
94
+ 62 gemm Half /model/layers_6/attn/Wqkv/MatMul_myl0_62
95
+ 63 kgen Half __myl_ReshTranReshMoveReshTranSlicSlicReshSlicNegSlicConcMulMulAddTranSlicReshSlicNegSlicConcMulEtc_myl0_63
96
+ 64 kgen Half _gemm_mha_v2_myl0_64
97
+ 65 gemm Half /model/layers_6/attn/Wo/MatMul_myl0_65
98
+ 66 kgen Half __myl_AddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_66
99
+ 67 gemm Half /model/layers_6/mlp/Wi/MatMul_myl0_67
100
+ 68 kgen Half __myl_TranReshSlicSlicDivCastErfCastAddMulMulMul_myl0_68
101
+ 69 gemm Half /model/layers_6/mlp/Wo/MatMul_myl0_69
102
+ 70 kgen Half __myl_TranReshAddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_70
103
+ 71 gemm Half /model/layers_7/attn/Wqkv/MatMul_myl0_71
104
+ 72 kgen Half __myl_ReshTranReshMoveReshTranSlicSlicReshSlicNegSlicConcMulMulAddTranSlicReshSlicNegSlicConcMulEtc_myl0_72
105
+ 73 kgen Half _gemm_mha_v2_myl0_73
106
+ 74 gemm Half /model/layers_7/attn/Wo/MatMul_myl0_74
107
+ 75 kgen Half __myl_AddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_75
108
+ 76 gemm Half /model/layers_7/mlp/Wi/MatMul_myl0_76
109
+ 77 kgen Half __myl_TranReshSlicSlicDivCastErfCastAddMulMulMul_myl0_77
110
+ 78 gemm Half /model/layers_7/mlp/Wo/MatMul_myl0_78
111
+ 79 kgen Half __myl_TranReshAddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_79
112
+ 80 gemm Half /model/layers_8/attn/Wqkv/MatMul_myl0_80
113
+ 81 kgen Half __myl_ReshTranReshMoveReshTranSlicSlicReshSlicNegSlicConcMulMulAddTranSlicReshSlicNegSlicConcMulEtc_myl0_81
114
+ 82 kgen Half _gemm_mha_v2_myl0_82
115
+ 83 gemm Half /model/layers_8/attn/Wo/MatMul_myl0_83
116
+ 84 kgen Half __myl_AddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_84
117
+ 85 gemm Half /model/layers_8/mlp/Wi/MatMul_myl0_85
118
+ 86 kgen Half __myl_TranReshSlicSlicDivCastErfCastAddMulMulMul_myl0_86
119
+ 87 gemm Half /model/layers_8/mlp/Wo/MatMul_myl0_87
120
+ 88 kgen Half __myl_TranReshAddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_88
121
+ 89 gemm Half /model/layers_9/attn/Wqkv/MatMul_myl0_89
122
+ 90 kgen Half __myl_ReshTranReshMoveReshTranSlicSlicReshSlicNegSlicConcMulMulAddTranSlicReshSlicNegSlicConcMulEtc_myl0_90
123
+ 91 kgen Half _gemm_mha_v2_myl0_91
124
+ 92 gemm Half /model/layers_9/attn/Wo/MatMul_myl0_92
125
+ 93 kgen Half __myl_AddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_93
126
+ 94 gemm Half /model/layers_9/mlp/Wi/MatMul_myl0_94
127
+ 95 kgen Half __myl_TranReshSlicSlicDivCastErfCastAddMulMulMul_myl0_95
128
+ 96 gemm Half /model/layers_9/mlp/Wo/MatMul_myl0_96
129
+ 97 kgen Half __myl_TranReshAddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_97
130
+ 98 gemm Half /model/layers_10/attn/Wqkv/MatMul_myl0_98
131
+ 99 kgen Half __myl_ReshTranReshMoveReshTranSlicSlicReshSlicNegSlicConcMulMulAddTranSlicReshSlicNegSlicConcMulEtc_myl0_99
132
+ 100 kgen Half _gemm_mha_v2_myl0_100
133
+ 101 gemm Half /model/layers_10/attn/Wo/MatMul_myl0_101
134
+ 102 kgen Half __myl_AddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_102
135
+ 103 gemm Half /model/layers_10/mlp/Wi/MatMul_myl0_103
136
+ 104 kgen Half __myl_TranReshSlicSlicDivCastErfCastAddMulMulMul_myl0_104
137
+ 105 gemm Half /model/layers_10/mlp/Wo/MatMul_myl0_105
138
+ 106 kgen Half __myl_TranReshAddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_106
139
+ 107 gemm Half /model/layers_11/attn/Wqkv/MatMul_myl0_107
140
+ 108 kgen Half __myl_ReshTranReshMoveReshTranSlicSlicReshSlicNegSlicConcMulMulAddTranSlicReshSlicNegSlicConcMulEtc_myl0_108
141
+ 109 kgen Half _gemm_mha_v2_myl0_109
142
+ 110 gemm Half /model/layers_11/attn/Wo/MatMul_myl0_110
143
+ 111 kgen Half __myl_AddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_111
144
+ 112 gemm Half /model/layers_11/mlp/Wi/MatMul_myl0_112
145
+ 113 kgen Half __myl_TranReshSlicSlicDivCastErfCastAddMulMulMul_myl0_113
146
+ 114 gemm Half /model/layers_11/mlp/Wo/MatMul_myl0_114
147
+ 115 kgen Half __myl_TranReshAddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_115
148
+ 116 gemm Half /model/layers_12/attn/Wqkv/MatMul_myl0_116
149
+ 117 kgen Half __myl_ReshTranReshMoveReshTranSlicSlicReshSlicNegSlicConcMulMulAddTranSlicReshSlicNegSlicConcMulEtc_myl0_117
150
+ 118 kgen Half _gemm_mha_v2_myl0_118
151
+ 119 gemm Half /model/layers_12/attn/Wo/MatMul_myl0_119
152
+ 120 kgen Half __myl_AddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_120
153
+ 121 gemm Half /model/layers_12/mlp/Wi/MatMul_myl0_121
154
+ 122 kgen Half __myl_TranReshSlicSlicDivCastErfCastAddMulMulMul_myl0_122
155
+ 123 gemm Half /model/layers_12/mlp/Wo/MatMul_myl0_123
156
+ 124 kgen Half __myl_TranReshAddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_124
157
+ 125 gemm Half /model/layers_13/attn/Wqkv/MatMul_myl0_125
158
+ 126 kgen Half __myl_ReshTranReshMoveReshTranSlicSlicReshSlicNegSlicConcMulMulAddTranSlicReshSlicNegSlicConcMulEtc_myl0_126
159
+ 127 kgen Half _gemm_mha_v2_myl0_127
160
+ 128 gemm Half /model/layers_13/attn/Wo/MatMul_myl0_128
161
+ 129 kgen Half __myl_AddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_129
162
+ 130 gemm Half /model/layers_13/mlp/Wi/MatMul_myl0_130
163
+ 131 kgen Half __myl_TranReshSlicSlicDivCastErfCastAddMulMulMul_myl0_131
164
+ 132 gemm Half /model/layers_13/mlp/Wo/MatMul_myl0_132
165
+ 133 kgen Half __myl_TranReshAddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_133
166
+ 134 gemm Half /model/layers_14/attn/Wqkv/MatMul_myl0_134
167
+ 135 kgen Half __myl_ReshTranReshMoveReshTranSlicSlicReshSlicNegSlicConcMulMulAddTranSlicReshSlicNegSlicConcMulEtc_myl0_135
168
+ 136 kgen Half _gemm_mha_v2_myl0_136
169
+ 137 gemm Half /model/layers_14/attn/Wo/MatMul_myl0_137
170
+ 138 kgen Half __myl_AddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_138
171
+ 139 gemm Half /model/layers_14/mlp/Wi/MatMul_myl0_139
172
+ 140 kgen Half __myl_TranReshSlicSlicDivCastErfCastAddMulMulMul_myl0_140
173
+ 141 gemm Half /model/layers_14/mlp/Wo/MatMul_myl0_141
174
+ 142 kgen Half __myl_TranReshAddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_142
175
+ 143 gemm Half /model/layers_15/attn/Wqkv/MatMul_myl0_143
176
+ 144 kgen Half __myl_ReshTranReshMoveReshTranSlicSlicReshSlicNegSlicConcMulMulAddTranSlicReshSlicNegSlicConcMulEtc_myl0_144
177
+ 145 kgen Half _gemm_mha_v2_myl0_145
178
+ 146 gemm Half /model/layers_15/attn/Wo/MatMul_myl0_146
179
+ 147 kgen Half __myl_AddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_147
180
+ 148 gemm Half /model/layers_15/mlp/Wi/MatMul_myl0_148
181
+ 149 kgen Half __myl_TranReshSlicSlicDivCastErfCastAddMulMulMul_myl0_149
182
+ 150 gemm Half /model/layers_15/mlp/Wo/MatMul_myl0_150
183
+ 151 kgen Half __myl_TranReshAddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_151
184
+ 152 gemm Half /model/layers_16/attn/Wqkv/MatMul_myl0_152
185
+ 153 kgen Half __myl_ReshTranReshMoveReshTranSlicSlicReshSlicNegSlicConcMulMulAddTranSlicReshSlicNegSlicConcMulEtc_myl0_153
186
+ 154 kgen Half _gemm_mha_v2_myl0_154
187
+ 155 gemm Half /model/layers_16/attn/Wo/MatMul_myl0_155
188
+ 156 kgen Half __myl_AddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_156
189
+ 157 gemm Half /model/layers_16/mlp/Wi/MatMul_myl0_157
190
+ 158 kgen Half __myl_TranReshSlicSlicDivCastErfCastAddMulMulMul_myl0_158
191
+ 159 gemm Half /model/layers_16/mlp/Wo/MatMul_myl0_159
192
+ 160 kgen Half __myl_TranReshAddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_160
193
+ 161 gemm Half /model/layers_17/attn/Wqkv/MatMul_myl0_161
194
+ 162 kgen Half __myl_ReshTranReshMoveReshTranSlicSlicReshSlicNegSlicConcMulMulAddTranSlicReshSlicNegSlicConcMulEtc_myl0_162
195
+ 163 kgen Half _gemm_mha_v2_myl0_163
196
+ 164 gemm Half /model/layers_17/attn/Wo/MatMul_myl0_164
197
+ 165 kgen Half __myl_AddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_165
198
+ 166 gemm Half /model/layers_17/mlp/Wi/MatMul_myl0_166
199
+ 167 kgen Half __myl_TranReshSlicSlicDivCastErfCastAddMulMulMul_myl0_167
200
+ 168 gemm Half /model/layers_17/mlp/Wo/MatMul_myl0_168
201
+ 169 kgen Half __myl_TranReshAddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_169
202
+ 170 gemm Half /model/layers_18/attn/Wqkv/MatMul_myl0_170
203
+ 171 kgen Half __myl_ReshTranReshMoveReshTranSlicSlicReshSlicNegSlicConcMulMulAddTranSlicReshSlicNegSlicConcMulEtc_myl0_171
204
+ 172 kgen Half _gemm_mha_v2_myl0_172
205
+ 173 gemm Half /model/layers_18/attn/Wo/MatMul_myl0_173
206
+ 174 kgen Half __myl_AddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_174
207
+ 175 gemm Half /model/layers_18/mlp/Wi/MatMul_myl0_175
208
+ 176 kgen Half __myl_TranReshSlicSlicDivCastErfCastAddMulMulMul_myl0_176
209
+ 177 gemm Half /model/layers_18/mlp/Wo/MatMul_myl0_177
210
+ 178 kgen Half __myl_TranReshAddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_178
211
+ 179 gemm Half /model/layers_19/attn/Wqkv/MatMul_myl0_179
212
+ 180 kgen Half __myl_ReshTranReshMoveReshTranSlicSlicReshSlicNegSlicConcMulMulAddTranSlicReshSlicNegSlicConcMulEtc_myl0_180
213
+ 181 kgen Half _gemm_mha_v2_myl0_181
214
+ 182 gemm Half /model/layers_19/attn/Wo/MatMul_myl0_182
215
+ 183 kgen Half __myl_AddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_183
216
+ 184 gemm Half /model/layers_19/mlp/Wi/MatMul_myl0_184
217
+ 185 kgen Half __myl_TranReshSlicSlicDivCastErfCastAddMulMulMul_myl0_185
218
+ 186 gemm Half /model/layers_19/mlp/Wo/MatMul_myl0_186
219
+ 187 kgen Half __myl_TranReshAddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_187
220
+ 188 gemm Half /model/layers_20/attn/Wqkv/MatMul_myl0_188
221
+ 189 kgen Half __myl_ReshTranReshMoveReshTranSlicSlicReshSlicNegSlicConcMulMulAddTranSlicReshSlicNegSlicConcMulEtc_myl0_189
222
+ 190 kgen Half _gemm_mha_v2_myl0_190
223
+ 191 gemm Half /model/layers_20/attn/Wo/MatMul_myl0_191
224
+ 192 kgen Half __myl_AddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_192
225
+ 193 gemm Half /model/layers_20/mlp/Wi/MatMul_myl0_193
226
+ 194 kgen Half __myl_TranReshSlicSlicDivCastErfCastAddMulMulMul_myl0_194
227
+ 195 gemm Half /model/layers_20/mlp/Wo/MatMul_myl0_195
228
+ 196 kgen Half __myl_TranReshAddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_196
229
+ 197 gemm Half /model/layers_21/attn/Wqkv/MatMul_myl0_197
230
+ 198 kgen Half __myl_ReshTranReshMoveReshTranSlicSlicReshSlicNegSlicConcMulMulAddTranSlicReshSlicNegSlicConcMulEtc_myl0_198
231
+ 199 kgen Half _gemm_mha_v2_myl0_199
232
+ 200 gemm Half /model/layers_21/attn/Wo/MatMul_myl0_200
233
+ 201 kgen Half __myl_AddCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_201
234
+ 202 gemm Half /model/layers_21/mlp/Wi/MatMul_myl0_202
235
+ 203 kgen Half __myl_TranReshSlicSlicDivCastErfCastAddMulMulMul_myl0_203
236
+ 204 gemm Half /model/layers_21/mlp/Wo/MatMul_myl0_204
237
+ 205 kgen Float __myl_TranReshAddCastMeanSubMulMean_myl0_205
238
+ 206 kgen Half __myl_CastAddSqrtDivMulCastMulAddMoveReshTranReshMoveReshMulSum_myl0_206
239
+ 207 kgen Half __myl_SumCastReshDivMul_myl0_207
240
+ 208 fusion Half __myl_Fc_myl0_208
241
+ 209 kgen Half __myl_CastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl0_209
242
+ 210 gemm Half /classifier/Gemm_myl0_210
243
+ 211 Reformat Float Reformatting CopyNode for Output Tensor 0 to {ForeignNode[/model/Unsqueeze_1 + /model/Unsqueeze_2...(Unnamed Layer* 6506) [ElementWise]]}