Skip to content

Fix HybridEngineRollout KV caches under autocast when keys and values differ in dtype - #9124

Open
ArchanaChetan07 wants to merge 1 commit into
deepspeedai:masterfrom
ArchanaChetan07:fix/9102-rollout-autocast-cache-dtype
Open

ArchanaChetan07 wants to merge 1 commit into
deepspeedai:masterfrom
ArchanaChetan07:fix/9102-rollout-autocast-cache-dtype

Commits

  1. Commits on Nov 19, 2026