Skip to content

Add tool call & some other params support for llms api - #117

Merged
sammuti merged 3 commits into
developfrom
bugfix/support-tool-calls-llm
Oct 16, 2025
Merged

Add tool call & some other params support for llms api#117
sammuti merged 3 commits into
developfrom
bugfix/support-tool-calls-llm

Conversation

@sammuti

@sammuti sammuti commented Oct 8, 2025

Copy link
Copy Markdown
Contributor

Add tool call support for llms api

@sammuti
sammuti requested review from bradhe and Copilot October 8, 2025 15:41
@github-actions

github-actions Bot commented Oct 8, 2025

Copy link
Copy Markdown
Contributor

⚠️ WARNING: This PR targets main instead of develop

This PR is targeting main which will trigger a production deployment when merged.

If this is a regular feature/fix PR, please change the base branch to develop.
If this is intentional (e.g., hotfix), you can ignore this warning.

Current base: main
Recommended base: develop

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR adds tool call support to the LLMs API, enabling function calling capabilities for both Ollama and Hugging Face Hub inference routers.

  • Extended the complete_chat method to accept additional parameters via **kwargs including tool definitions
  • Modified return types to support both string responses and full response objects when tools are involved
  • Updated both Ollama and Hugging Face Hub implementations to handle tool calls and return appropriate response formats

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

Comment thread src/tower/_llms.py Outdated
Comment thread src/tower/_llms.py Outdated
Comment thread src/tower/_llms.py Outdated
@sammuti sammuti changed the title Add tool call support for llms api Add tool call 7 some other params support for llms api Oct 8, 2025
@sammuti
sammuti changed the base branch from main to develop October 8, 2025 15:45
@sammuti sammuti changed the title Add tool call 7 some other params support for llms api Add tool call & some other params support for llms api Oct 8, 2025
@tower tower deleted a comment from github-actions Bot Oct 8, 2025

@bradhe bradhe left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, let's ship it.

@sammuti
sammuti merged commit e8683e7 into develop Oct 16, 2025
5 checks passed
@sammuti
sammuti deleted the bugfix/support-tool-calls-llm branch October 16, 2025 09:17
bradhe pushed a commit that referenced this pull request Nov 2, 2025
Add tool call & some other params support for llms api
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants