Skip to content

benchmark: Make nighthawk more reproducible and add agentgateway - #1628

Draft
Keith Mattix II (keithmattix) wants to merge 3 commits into
agent-substrate:mainfrom
keithmattix:nighthawk-agentgateway
Draft

Keith Mattix II (keithmattix) wants to merge 3 commits into
agent-substrate:mainfrom
keithmattix:nighthawk-agentgateway

Conversation

@keithmattix

@keithmattix Keith Mattix II (keithmattix) commented Sep 12, 2026

Copy link
Copy Markdown
Collaborator

Add AgentGateway support to the Nighthawk ingress-capacity benchmark and make the comparison reproducible on GKE. Stacked on top of #1598.

  • Tests pass
  • Appropriate changes to documentation are included in the PR

Signed-off-by: Keith Mattix II <keithmattix2@gmail.com>
Signed-off-by: Keith Mattix II <keithmattix2@gmail.com>

@EItanya Eitan Yarmush (EItanya) left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Update: The ingress-contract portion of this review and three related inline comments have been moved to #1598, where those changes originate. The benchmark-specific questions remain here. The CI matrix suggestion is already addressed in #1598.

Original review:

Overall adding these changes make sense to me but I have some clarifying questions about some language and about what the actual ingress contract is since there are definitely dataplane specific checks in the tests

Comment thread benchmarking/nighthawk-ingress/output.py
Comment thread .github/workflows/pr-workflow.yaml
dataplane = nh["dataplane"]
cpu_key = "envoyCpu" if dataplane == "envoy" else "agentgatewayCpu"
cpu = str(nh[cpu_key])
if dataplane == "agentgateway":

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Switch statement here, does python even have one? 😆

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Very very recently according to Google; I've never used it though

Comment thread benchmarking/automation/testtypes/nighthawk_ingress.py
Comment thread benchmarking/nighthawk-ingress/output.py
Comment thread benchmarking/nighthawk-ingress/run-dev.sh
Comment thread internal/e2e/suites/networking/grpcingress_test.go
Comment thread internal/e2e/suites/parking/parking_test.go
Comment thread internal/e2e/suites/parking/parking_test.go
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants