We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 189e9d5 commit 78222baCopy full SHA for 78222ba
src/llmcompressor/observers/base.py
@@ -142,7 +142,8 @@ def get_qparams(
142
) # shape of [num_key_value_heads * head_dim]
143
else:
144
# weight or input
145
- # assume observed is transposed, because its the output, hence use dim 0
+ # assume observed is transposed,
146
+ # because its the output, hence use dim 0
147
self._scale, self._zero_point = self.get_qparams_along_dim(
148
observed, 0
149
)
0 commit comments