Search results

automatic batch size fallback

Status: Open.

#517 In intel/auto-round;

· wenhuach21 opened on Apr 15, 2025

improve gguf packing speed

Status: Open.

#516 In intel/auto-round;

· wenhuach21 opened on Apr 15, 2025

can I quantize lmhead only use auto-round format, but I can't use the model

Status: Open.

#503 In intel/auto-round;

· xjz-ai opened on Apr 10, 2025

W4AFP8 fallback to unit scale if without calibration data for moe

Status: Open.

#488 In intel/auto-round;

· wenhuach21 opened on Apr 1, 2025

support float zp for gguf q41

Status: Open.

#479 In intel/auto-round;

· wenhuach21 opened on Mar 27, 2025

unstable results of qwen-72b-instruct on IFEVAL?

Status: Open.

#476 In intel/auto-round;

· wenhuach21 opened on Mar 20, 2025

[workaround provided]tuning microsoft/Phi-4-multimodal-instruct exception

Status: Open.

#463 In intel/auto-round;

· wenhuach21 opened on Mar 11, 2025

device specification error

Status: Open.

#452 In intel/auto-round;

· n1ck-guo opened on Mar 4, 2025

Support q2-k to q4-k

Status: Open.

#434 In intel/auto-round;

· wenhuach21 opened on Feb 12, 2025

support max_shard_size in gguf exporing

Status: Open.

#426 In intel/auto-round;

· wenhuach21 opened on Jan 28, 2025

consolidate device and device_map

Status: Open.

#418 In intel/auto-round;

· wenhuach21 opened on Jan 17, 2025

add a comprehensive and unified pre-quantization checker

Status: Open.

#410 In intel/auto-round;

· wenhuach21 opened on Jan 13, 2025