perf: Enable CUDA graphs when attention DP is used and active requests on different GPUs are uneven - #3010

perf: Enable CUDA graphs when attention DP is used and active requests on different GPUs are uneven#3010

jinyangyuan-nvidia merged 2 commits into

NVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom

jinyangyuan-nvidia:dev/perf_dp_cuda_graphjinyangyuan-nvidia/TensorRT-LLM:dev/perf_dp_cuda_graphCopy head branch name to clipboard