Skip to content

[Unity] PagedKVCache supporting on-the-fly RoPE calculation - #16396

Merged
tqchen merged 1 commit into
apache:unityfrom
MasterJH5574:unity-dev/2024-01-13-kv-cache-rope
Jan 15, 2024
Merged

[Unity] PagedKVCache supporting on-the-fly RoPE calculation#16396
tqchen merged 1 commit into
apache:unityfrom
MasterJH5574:unity-dev/2024-01-13-kv-cache-rope

Commits

Commits on Jan 14, 2024