[CUDA] Add cuDNN-free ArgMax/ArgMin/ReduceSum and fix LogSoftmax on plugin EP

[Tianlei Wu (tianleiwu)]

Summary

Phase 2 of the CUDA plugin execution provider "no-cuDNN" work. It lets single last-axis ArgMax/ArgMin run through a small custom CUDA kernel instead of cuDNN, fixes LogSoftmax classification in the plugin adapter, and adds a non-throwing cuDNN handle accessor so reduction kernels can fall back gracefully when cuDNN is disabled.

Key Changes

Area	Change
reduction_functions.cu / .h	New arg_min_max_last_axis<TIn, IsArgMax> kernel (instantiated for half, float, double) that computes ArgMax/ArgMin indices over the last dimension of a row-major matrix without cuDNN.
reduction_ops.cc	In ReduceComputeCore, route a single last-axis ArgMax/ArgMin (CUDNN_REDUCE_TENSOR_FLATTENED_INDICES) to the custom kernel when shapes fit int; otherwise fall through to the existing cuDNN path. ReduceKernel::ComputeImpl now uses TryGetCudnnHandle.
cuda_kernel.h (native) / cuda_kernel_adapter.h (plugin)	Add TryGetCudnnHandle, which returns the cuDNN handle when available and nullptr otherwise (instead of throwing at handle acquisition).
softmax.h	Detect LogSoftmax from node.OpType() instead of info.GetKernelDef().OpName(), so the plugin EP adapter classifies it correctly.
test_cuda_plugin_ep.py	Add LogSoftmax and ArgMin tests; drop the @requires_cudnn gate from ArgMax, ReduceMean, ReduceSum; reduce over the last axis to exercise the cuDNN-free paths.
docs/cuda_plugin_ep/QUICK_START.md	Drop ArgMax and reductions from the list of ops that still require cuDNN.

Correctness Notes

• select_last_index == 1 is already rejected on the CUDA EP, so the kernel keeping the first matching index (strict > / <) is spec-correct for the supported case.
• The custom path guards n > 0, returns early for m == 0, computes the row offset in int64_t, and only engages when m and n fit in int (gsl::narrow_cast); larger tensors fall back to cuDNN.

Testing

• python -m pytest onnxruntime/test/python/transformers/test_cuda_plugin_ep.py -k "log_softmax or argmax or argmin or reduce_mean or reduce_sum"
• Plugin no-cuDNN validation: bash .env/cuda_130_plugin_no_cudnn.sh --build --test_plugin
• onnxruntime_provider_test --gtest_filter='*Reduce*:*ArgM*'

[Copilot]

Pull request overview

This PR is phase 2 of the CUDA Plugin EP “no-cuDNN” effort: it adds a cuDNN-free last-axis ArgMax/ArgMin path, fixes LogSoftmax detection for the plugin adapter, and introduces a non-throwing cuDNN handle accessor so kernels can run/fall back when cuDNN is disabled.

Changes:

• Added a custom CUDA kernel (arg_min_max_last_axis) for last-axis ArgMax/ArgMin indices (half/float/double) and routed eligible cases to it.
• Switched reduction kernels to use TryGetCudnnHandle (nullable) instead of throwing at handle acquisition, and fixed LogSoftmax classification using node.OpType().
• Expanded CUDA plugin EP Python tests (LogSoftmax, ArgMin) and adjusted reduction tests to exercise last-axis non-cuDNN paths; updated plugin quick-start docs accordingly.

Reviewed changes

Copilot reviewed 8 out of 8 changed files in this pull request and generated 2 comments.

Show a summary per file

File	Description
onnxruntime/test/python/transformers/test_cuda_plugin_ep.py	Adds LogSoftmax/ArgMin tests and updates ArgMax/Reduce* tests to run without cuDNN and exercise last-axis paths.
onnxruntime/core/providers/cuda/reduction/reduction_ops.cc	Routes last-axis ArgMax/ArgMin to the new kernel and switches reduction execution to use TryGetCudnnHandle.
onnxruntime/core/providers/cuda/reduction/reduction_functions.h	Declares the new last-axis ArgMin/ArgMax helper.
onnxruntime/core/providers/cuda/reduction/reduction_functions.cu	Implements and instantiates the cuDNN-free last-axis ArgMin/ArgMax kernel.
onnxruntime/core/providers/cuda/plugin/cuda_kernel_adapter.h	Adds TryGetCudnnHandle for the plugin adapter.
onnxruntime/core/providers/cuda/math/softmax.h	Fixes LogSoftmax detection using node.OpType() for correct plugin classification.
onnxruntime/core/providers/cuda/cuda_kernel.h	Adds TryGetCudnnHandle (nullable) to native CUDA kernels.
docs/cuda_plugin_ep/QUICK_START.md	Updates the list of ops requiring cuDNN for plugin no-cuDNN validation.

[Copilot]

Pull request overview

Copilot reviewed 9 out of 9 changed files in this pull request and generated 1 comment.

[Tianlei Wu (tianleiwu)]

@microsoft-github-policy-service rerun