Skip to content

Commit

Permalink
fix group dim (#2308)
Browse files Browse the repository at this point in the history
  • Loading branch information
Sara Adkins authored May 29, 2024
1 parent 1fcec3f commit bea67b3
Showing 1 changed file with 0 additions and 5 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -195,11 +195,6 @@ def fasterprune(
quant_scheme.weights,
)
else: # strategy == QuantizationStrategy.GROUP
# TODO: for grouped quantization its always 3d but the last
# dim is always 1. Can we just make it 2d instead and avoid?
scale = scale[:, :, 0]
zero_point = zero_point[:, :, 0]

# get the group index for the current column
column_idx = i1 + i
input_dim_group = (
Expand Down

0 comments on commit bea67b3

Please sign in to comment.