Search results

refactor: separate mlu and cuda version Qwen model implementation.

Status: Open (in progress).

jd-opensource/xllmnumber 468

#468 In jd-opensource/xllm;

· XuZhang99 opened on Dec 1, 2025

feat: determine device type automatically except npu device.

Status: Open (in progress).

jd-opensource/xllmnumber 467

#467 In jd-opensource/xllm;

· XuZhang99 opened on Dec 1, 2025

feat: add NPU process group initialization and management.

Status: Open (in progress).

jd-opensource/xllmnumber 456

#456 In jd-opensource/xllm;

· yingxudeng opened on Nov 29, 2025

feat: implement chunked prefill and prefix cache for Qwen3 MoE.

Status: Open (in progress).

jd-opensource/xllmnumber 455

#455 In jd-opensource/xllm;

· yingxudeng opened on Nov 29, 2025

feat: support deepseek mtp on mlu.

Status: Open (in progress).

jd-opensource/xllmnumber 454

#454 In jd-opensource/xllm;

· a120092009 opened on Nov 28, 2025

refactor: replace decode_seq_range with batch_forward_type.

Status: Open (in progress).

jd-opensource/xllmnumber 451

#451 In jd-opensource/xllm;

· RobbieLeung opened on Nov 27, 2025

feat: support qwen2_5_vl/qwen3_vl/qwen3_vl_moe on mlu device.

Status: Open (in progress).

jd-opensource/xllmnumber 450

#450 In jd-opensource/xllm;

· a120092009 opened on Nov 27, 2025

refactor: optimize unique token count preparation of batch input builder.

Status: Open (in progress).

jd-opensource/xllmnumber 449

#449 In jd-opensource/xllm;

· RobbieLeung opened on Nov 27, 2025

refactor: move draft input preparation of decode batch from worker to batch builder.

Status: Open (in progress).

jd-opensource/xllmnumber 448

#448 In jd-opensource/xllm;

· RobbieLeung opened on Nov 27, 2025

[WIP] feat: support loading model weights and forward overlap.

Status: Open (in progress).

jd-opensource/xllmnumber 441

#441 In jd-opensource/xllm;

· Clement-Wang26 opened on Nov 26, 2025

feat: add rec proto,serivce and utils for rec framework[2/6].

Status: Open (in progress).

jd-opensource/xllmnumber 440

#440 In jd-opensource/xllm;

· DragonFive opened on Nov 26, 2025

feat: enhance Qwen3-MoE to support TP settings beyond 4.

Status: Open (in progress).

jd-opensource/xllmnumber 427

#427 In jd-opensource/xllm;

· yingxudeng opened on Nov 24, 2025