Skip to content

Commit

Permalink
auto to float
Browse files Browse the repository at this point in the history
Signed-off-by: Qubitium <[email protected]>
  • Loading branch information
Qubitium committed Mar 2, 2025
1 parent 4684c2e commit cdf9308
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions gptqmodel_ext/exllama_eora/eora/q_gemm.cu
Original file line number Diff line number Diff line change
Expand Up @@ -335,8 +335,8 @@ __global__ void gemm_half_q_half_gptq_4bit_kernel_eora(
for (int j = 0; j < 4; ++j) {
#pragma unroll
for (int m = 0; m < m_count; m++) {
auto a1 = __half2float(*(Ax_.item_ptr(offset_m + m, r)));
auto a2 = __half2float(*(eora_b_.item_ptr(r, n + j)));
float a1 = __half2float(*(Ax_.item_ptr(offset_m + m, r)));
float a2 = __half2float(*(eora_b_.item_ptr(r, n + j)));
float product = a1 * a2;
block_c[m][j] = block_c[m][j] + product;
}
Expand Down

0 comments on commit cdf9308

Please sign in to comment.