r5.2-image-composition

What's Changed

• fix fork conversation by @iceljc in #1082
• fix realtime toolcall by @iceljc in #1087
• refine side car states by @iceljc in #1089
• temp revert by @iceljc in #1090
• revert by @iceljc in #1091
• optimize twilio by @yileicn in #1092
• detour rate limit by @iceljc in #1094
• Refine realtime and twilio by @iceljc in #1093
• refine chat stream with initial states by @iceljc in #1095
• Add hook to handle locate element for PlayWright by @visagang in #1096
• fix #1097 SqlDriver: Database type mssql is not supported by @yuguoqiang in #1098
• refine chat stream request by @iceljc in #1099
• Add default result by @iceljc in #1100
• refine message states by @iceljc in #1101
• Filter conversation by agent ids by @iceljc in #1102
• add channel to the instruct controller by @visagang in #1105
• Features/refine agent template link by @iceljc in #1106
• update router instruction by @iceljc in #1107
• update router instruction by @iceljc in #1108
• add invoke source by @iceljc in #1103
• upgrade openai by @iceljc in #1109
• add logging in twilio stream by @iceljc in #1111
• Features/init reactive x by @iceljc in #1084
• add default return by @iceljc in #1112
• feat(playwright): handle dropdowns in DropDown action by @ywang1110 in https://github.com//pull/1113 fix concurrent issue by @JackJiang1234 in https://github.com//pull/1104 add option agents by @iceljc in https://github.com//pull/1115 optimize ConvertToString by @yileicn in https://github.com//pull/1116 fix missing params by @iceljc in https://github.com//pull/1117 refine indication by @iceljc in https://github.com//pull/1114 add chart handler by @iceljc in https://github.com//pull/1085 sending json data by @iceljc in https://github.com//pull/1118 fix chart handler by @iceljc in https://github.com//pull/1119 Update IRealtimeHook by @hchen2020 in https://github.com//pull/1121 add end time by @leonleonyu in https://github.com//pull/1120 Add function to get browser url for Playwright by @visagang in https://github.com//pull/1122 Features/refine vector store by @iceljc in https://github.com//pull/1123 add reasoning effort level by @iceljc in https://github.com//pull/1126 add reasoning settings by @iceljc in https://github.com//pull/1127 use session in twilio stream by @iceljc in https://github.com//pull/1110 Features/refine conv filter by @leonleonyu in https://github.com//pull/1129 Add agent function visibility and init web search by @iceljc in https://github.com//pull/1128 Update dropdown selection based on PressKey by @visagang in https://github.com//pull/1130 add vector payload value operator by @iceljc in https://github.com//pull/1131 revert code by @iceljc in https://github.com//pull/1132 add vector payload by @iceljc in https://github.com//pull/1133 fix vector collection data issue by @iceljc in https://github.com//pull/1135 refine web search model select by @iceljc in https://github.com//pull/1136 optimize GetAgents by @yileicn in https://github.com//pull/1134 fix datetime convert by @iceljc in https://github.com//pull/1137 refine instruction by @iceljc in https://github.com//pull/1138 add chart handler setting by @iceljc in https://github.com//pull/1139 refine chart plot instruction by @iceljc in https://github.com//pull/1140 Fix potential null reference by @iceljc in https://github.com//pull/1141 refine chart plot template by @iceljc in https://github.com//pull/1142 temp model for image reading by @iceljc in https://github.com//pull/1143 update chart prompt by @Joannall in https://github.com//pull/1144 add report_summary to PlotChart by @Joannall in https://github.com//pull/1146 refine chart handler instruction & allow sending multiple messages by @iceljc in https://github.com//pull/1147 refine naming by @iceljc in https://github.com//pull/1148 add chart data and code endpoints by @iceljc in https://github.com//pull/1149 allow sending indication by @iceljc in https://github.com//pull/1151 reset message wrapper and fix path error by @iceljc in https://github.com//pull/1152 add message label by @iceljc in https://github.com//pull/1153 add message wrapper to chat response by @iceljc in https://github.com//pull/1154 fix missing message label by @iceljc in https://github.com//pull/1155 Update distributed lock for cronservice by @visagang in https://github.com//pull/1156 add crontab debug config by @yileicn in https://github.com//pull/1157 add reasoning effort in chart plot by @iceljc in https://github.com//pull/1158 minor change by @Joannall in https://github.com//pull/1160 refine chart plot prompt by @iceljc in https://github.com//pull/1161 add chat context by @iceljc in https://github.com//pull/1162 Features/refine model settings by @iceljc in https://github.com//pull/1145 Features/refine model settings by @iceljc in https://github.com//pull/1164 fix audio and excel by @iceljc in https://github.com//pull/1165 minor change by @Joannall in https://github.com//pull/1166 Features/refine model settings by @iceljc in https://github.com//pull/1167 Features/refine model settings by @iceljc in https://github.com//pull/1168 Features/refine model settings by @iceljc in https://github.com//pull/1169 refine routing context by @iceljc in https://github.com//pull/1170 Fix Twilio dispose issue. by @hchen2020 in https://github.com//pull/1171 fix chat stream and websocket close by @iceljc in https://github.com//pull/1172 fix template rendering by states by @iceljc in https://github.com//pull/1173 add realtime options by @iceljc in https://github.com//pull/1174 Add IWebElementLocator by @hchen2020 in https://github.com//pull/1175 Features/refine py interpreter by @iceljc in https://github.com//pull/1176 refine running py code script by @iceljc in https://github.com//pull/1177 Features/refine py interpreter by @iceljc in https://github.com//pull/1178 fix typo by @iceljc in https://github.com//pull/1179 skip file selection if there is only 1 image. by @hchen2020 in https://github.com//pull/1180 add Alignment for ButtonTemplateMessage by @yileicn in https://github.com//pull/1182 optimize RoleContent by @yileicn in https://github.com//pull/1183 sql select support mongodb by @yileicn in https://github.com//pull/1184 Features/add image llm config by @iceljc in https://github.com//pull/1181 rename image handler utilities by @iceljc in https://github.com//pull/1185 fix missing agent file by @iceljc in https://github.com//pull/1186 Refine file llm processor by @iceljc in https://github.com//pull/1188 Delay one second inside LockAsync in crontab watcher by @adenchen123 in https://github.com//pull/1187 fix namespace by @iceljc in https://github.com//pull/1189 instruct log optimize by @yileicn in https://github.com//pull/1191 hotfix IBotSharpRepository.cs(201,43): error CS0246 by @yileicn in https://github.com//pull/1192 Reapply "Handling redis timeout in RedisSubscriber" by @adenchen123 in https://github.com//pull/1190 optimize DistributedLocker by @yileicn in https://github.com//pull/1193 refine by @iceljc in https://github.com//pull/1194 fileOptions add to states by @yileicn in https://github.com//pull/1195 New Contributors @yuguoqiang made their first contribution in https://github.com//pull/1098 @leonleonyu made their first contribution in https://github.com//pull/1120 Full Changelog: https://github.com/SciSharp/BotSharp/compare/r5....

r5.1-utility-improment

What's Changed

• feat: Added Google Multimodal Live APIs by @gunpal5 in #993
• Clean code for GeminiLive by @hchen2020 in #997
• realtime-hub-refactor by @Oceania2018 in #999
• Add InterruptResponse in RealtimeModelSettings by @hchen2020 in #1000
• InputAudioTranscribe by @hchen2020 in #1001
• rename WaveStreamChannel by @yileicn in #1003
• Update Microsoft.Extensions.AI version to 9.4.0-preview.1.25207.5 by @MackinnonBuck in #1002
• Fix conversation states before loading agent for init-outbound-call by @hchen2020 in #1004
• function log by @hchen2020 in #1005
• Features/debug local realtime by @iceljc in #1006
• Features/debug local realtime by @iceljc in #1007
• add default func by @iceljc in #1008
• fix: Google realtime communication by @gunpal5 in #1009
• fix init state by @iceljc in #1011
• Test/realtime test by @iceljc in #1010
• refine init mcp by @iceljc in #1012
• PEOL-187 hotfix System object Disposed Exception: Cannot access a dis… by @yileicn in #1013
• revert set state by @iceljc in #1014
• fix init states by @iceljc in #1015
• ResponseDoneStatusDetail by @hchen2020 in #1017
• Remove unnecessary agent load by @hchen2020 in #1018
• Add webdriver hook to support file uploads by @visagang in #1016
• Optimize realtime route_to_agent by @hchen2020 in #1019
• Add agent routing mode by @hchen2020 in #1020
• Twilio SpeechModel by @hchen2020 in #1021
• optimize naming, ConfigureAwait by @yileicn in #1022
• Allow settings to disable audio generation. by @hchen2020 in #1023
• Features/refactor llm cost by @iceljc in #1024
• Add Triggers property to SqlDriverCrontabHook class by @adenchen123 in #1026
• GenerateEndingAudio by @hchen2020 in #1027
• Refactor Triggered method to return conversation IDs by @adenchen123 in #1028
• Support reconnect in Twilio by @hchen2020 in #1029
• response_to_user by @hchen2020 in #1030
• Flag realtime feature in Labels. by @hchen2020 in #1031
• optimize by @hchen2020 in #1032
• Fix the issue of UserIdentity loss by @yileicn in #1033
• optimize ITwilioCallStatusHook by @yileicn in #1036
• Adding inbound call recording. by @hchen2020 in #1038
• Update AgentService.GetAgents.cs by @JackJiang1234 in #1040
• Track phone call success state in application by @adenchen123 in #1041
• Update AgentService.GetAgents.cs by @JackJiang1234 in #1042
• Revert "Track phone call success state in application" by @adenchen123 in #1043
• add function util-crontab-task_wait by @ChenGong-lessen in #1039
• Test/realtime chat by @iceljc in #1034
• Update Microsoft.Extensions.AI version to 9.4.3-preview.1.25230.7 by @MackinnonBuck in #1045
• Optimize InstructLoop by @hchen2020 in #1046
• optimize HooKEmitter by @yileicn in #1037
• Twilio.GetHints by @hchen2020 in #1047
• Avoid duplicated utility templates. by @hchen2020 in #1048
• Refine/refine project dep by @iceljc in #1049
• refine global stats by @iceljc in #1050
• Enhance Twilio hook execution with conditional logic by @adenchen123 in #1054
• Add hook execution options to Twilio controllers by @adenchen123 in #1055
• optimize AgentHook,IInstructHook by @yileicn in #1056
• Update Microsoft.Extensions.AI version to 9.4.4-preview.1.25259.16 by @MackinnonBuck in #1053
• Refactor InvokeFunction code by @geffzhang in #1044
• optimize hook by @yileicn in #1058
• Test/google realtime by @iceljc in #1057
• Update to Microsoft.Extensions.AI stable release by @stephentoub in #1059
• Production by @yileicn in #1061
• add session reconnect by @iceljc in #1060
• refine http headers by @iceljc in #1062
• Fix IndexOutOfRangeException caused by CheckArgType concurrency by @yileicn in #1063
• add gemini file content by @iceljc in #1064
• optimize CheckArgType by @yileicn in #1065
• hotfix agent instruction cache question by @yileicn in #1067
• hotfix AddDefaultInstruction by @yileicn in #1069
• optimize summary by @yileicn in #1070
• add utility visibility expression by @iceljc in #1066
• add mission category by @iceljc in #1071
• hotfix summary by @yileicn in #1072
• Features/refine file instruct by @iceljc in #1068
• Update locating element log level to warning by @visagang in #1073
• Refactor SQL Driver Plugin and Update Database Handling by @Joannall in #1074
• fix user permission by @iceljc in #1075
• fix new user login error by @JackJiang1234 in #1076
• Update webdriver upload files method by @visagang in #1077
• modify LocateElement logger level by @yileicn in #1078
• Adding message context to Error by @yileicn in #1080

New Contributors

• @MackinnonBuck made their first contribution in #1002
• @JackJiang1234 made their first contribution in #1040

Full Changelog: r5.0-mcp...r5.1-utility-improment

r5.0-mcp

What's Changed

• util-twilio-transfer_phone_call by @hchen2020 in #948
• hotfix twilio stream conversationId is null by @yileicn in #950
• add missing template by @iceljc in #951
• Hang up phone with audio by @hchen2020 in #952
• Update web driver functionalities by @visagang in #953
• Append dialogs into model context by @hchen2020 in #954
• util-twilio-leave_voicemail by @hchen2020 in #955
• Update web driver to handle mutiple tasks per agent by @visagang in #956
• Update code to singleton for WebBrowsing settings by @visagang in #957
• realtime model not suppot v1/chat/completions by @yileicn in #959
• Add agent-id for all phone endpoints. by @hchen2020 in #960
• Fixed agent label bug by @GreenShadeZhang in #958
• refine instruction log settings by @iceljc in #961
• Update default timeout for web driver by @visagang in #962
• call dummy func by @iceljc in #943
• add additional llm cost by @iceljc in #963
• IAudioSynthesis by @hchen2020 in #964
• merge to botsharp by @geffzhang in #966
• feat(Gemini): Added Text Embedding Model by @gunpal5 in #969
• update function param desc by @iceljc in #970
• Update webdriver code by @visagang in #971
• Updated readme to add deepseek v3 introduction by @GreenShadeZhang in #972
• Add Twilio realtime transcribe. by @hchen2020 in #973
• Modelcontextprotocol by @geffzhang in #968
• Update webdriver to handle fileupload and dropdown selection by @visagang in #976
• refine instruction and mcp by @iceljc in #978
• fix file selection by @iceljc in #979
• Add UrlAfterAction into Content by @evan-cao-wb in #980
• OnCallBusyStatus by @hchen2020 in #981
• Dev fix pizza Demo by @GreenShadeZhang in #975
• add mcp service by @iceljc in #982
• add wait time for webdriver by @visagang in #983
• fix json by @iceljc in #984
• optimize twilio by @hchen2020 in #985
• Change to modelType when getting realtime model. by @hchen2020 in #986
• Fix output endpoint. by @hchen2020 in #987
• fix Dialogs is null by @hchen2020 in #988
• Fix conversation id in HangupPhoneCallFn by @hchen2020 in #989
• fix gemini function call by @iceljc in #990
• SetMessageId by @hchen2020 in #991
• Add route_to_agent log by @hchen2020 in #992
• feat：upgrade modelcontextprotocol 0.1.0-preview.5 by @geffzhang in #994
• Model response timeout by @hchen2020 in #995
• add read content to locate element utility by @visagang in #996

New Contributors

• @gunpal5 made their first contribution in #969

Full Changelog: r4.1-realtime...r5.0-mcp

v4.1-Realtime

What's Changed

• revert open ai client by @iceljc in #812
• Update README.md Add LiteDBStorage Link by @GreenShadeZhang in #813
• add agent event rule by @iceljc in #814
• add http request hook by @iceljc in #815
• rename by @iceljc in #817
• add criteria by @iceljc in #818
• remove fields by @iceljc in #819
• X-Twilio-BotSharp by @hchen2020 in #820
• refine agent load by @iceljc in #821
• refine idle conv by @iceljc in #823
• ignore case by @iceljc in #824
• add conv append by @iceljc in #825
• Generate Indication from LLM by @hchen2020 in #822
• append list by @iceljc in #826
• enable answering machine detection by @wcao-lessen in #827
• refine prompt by @iceljc in #829
• fix gemini function call by @iceljc in #832
• refine gemini function parameter by @iceljc in #833
• ICrontabSource by @hchen2020 in #834
• add data by @iceljc in #835
• Update M.E.AI to 9.1.0-preview.1.25064.3 by @stephentoub in #831
• clean code of sql planner by @Oceania2018 in #836
• refactor cache by @yileicn in #838
• refine side car attribute by @iceljc in #839
• optimize RedisCache by @yileicn in #840
• add global stats by @iceljc in #842
• refine by @iceljc in #843
• hang up after maximum gather attempts by @wcao-lessen in #841
• refine sidecar async by @iceljc in #845
• Features/add deep seek by @iceljc in #846
• Support distributed crontab workers by @hchen2020 in #844
• rename by @iceljc in #847
• refine global stats by @iceljc in #848
• Allow append states in RuleTrigger. by @hchen2020 in #849
• relocate by @iceljc in #850
• fix cost calculation by @iceljc in #851
• add entry agent id by @iceljc in #853
• Make name readonly by @hchen2020 in #854
• Refactor Agemt Task by @hchen2020 in #855
• Features/refine agent filter by @iceljc in #856
• Features/refine agent filter by @iceljc in #857
• Features/refine agent filter by @iceljc in #859
• Add IsRealTime Flag by @hchen2020 in #858
• revert by @iceljc in #861
• Revert by @iceljc in #862
• fix by @iceljc in #863
• add routing dialogs by @iceljc in #864
• WebUtility improvement by @hchen2020 in #865
• revert by @iceljc in #866
• refine statistics by @iceljc in #867
• refine global stats by @iceljc in #868
• support input password by @hchen2020 in #869
• add max output token by @iceljc in #871
• add search user logic. by @Oceania2018 in #872
• Centralized package version for some projects by @kerryjiang in #860
• Revert "Centralized package version for some projects" by @iceljc in #873
• ignore extra mongo elements by @iceljc in #876
• twilio stream by @hchen2020 in #875
• refine state search by @iceljc in #878
• sort by @iceljc in #879
• rename and add cache by @iceljc in #881
• fix import by @iceljc in #883
• docs: update README.md by @eltociear in #877
• Add audio transcript by @hchen2020 in #880
• Remove obsolete nuget packages for BotSharp.Abstraction by @GreenShadeZhang in #885
• Tried to add github action build pipeline by @kerryjiang in #889
• Added aspire in the github action build by @kerryjiang in #890
• Fixed the dir of BotSharp.Plugin.SemanticKernel.UnitTests in the build pipeline by @kerryjiang in #891
• Revert "Remove obsolete nuget packages for BotSharp.Abstraction" by @GreenShadeZhang in #893
• send by group by @iceljc in #887
• Code style adjustment and partial optimization by @zfchai in #884
• Update Microsoft.Extensions.AI to 9.3.0-preview.1.25114.11 by @stephentoub in #892
• add agent id as ref by @iceljc in #886
• add cpvm by @iceljc in #874
• move data to WebStarter by @Oceania2018 in #888
• refine state by @iceljc in #894
• refine llm completion log by @iceljc in #895
• add instruction page by @iceljc in #896
• 增加智能体知识库的查询Add Agent query Knowledge function by @AaronWar in #870
• add confidence by @iceljc in #900
• remove limit by @iceljc in #901
• routing utility by @hchen2020 in #902
• catch chathub error by @iceljc in #903
• Use ManagePackageVersionsCentrally for more projects by @kerryjiang in #897
• Upgrade package by @hchen2020 in #904
• OnSessionUpdated log by @hchen2020 in #906
• add agent id in resource key by @iceljc in #905
• rollback reset states by @hchen2020 in #907
• Refine global stats lock key by @iceljc in #908
• remove dialog data by @iceljc in #909
• add welcome for realtime by @hchen2020 in #910
• Output input audio transcript. by @hchen2020 in #911
• Mak initial audio is not interruptable by @hchen2020 in #913
• hotfix timestamp,mark and interruption handling by @yileicn in #914
• Use ManagePackageVersionsCentrally for more projects by @kerryjiang in #912
• refactor realtime code. by @hchen2020 in #915
• Features/add latest state by @iceljc in #916
• optimize realtime by @yileicn in #917
• Seperate realtime in a new project by @hchen2020 in #919
• refine instruction log by @iceljc in #918
• refine document by @iceljc in #920
• rename by @iceljc in #921
• refine menu by @iceljc in #923
• Return instruction for realtime response.create. by @hchen2020 in #924
• add instruction log setting and state search by @iceljc in #926
• refine state key search by @iceljc in #928
• Hang-up if waiting AI Response Timeout by @hchen2020 in #927
• refine agent task by @iceljc in #930
• Update headless setting for Playwright by @visagang in #929
• get template name from state by @iceljc in #931
• Update to M.E.AI 9.3.0-preview.1.25161.3 by @stephentoub in #932
• Update timeout for ...

r4.0-sidecar

What's Changed

• fix vector db by @iceljc in #672
• Features/add notification by @iceljc in #673
• remove params by @iceljc in #674
• minor fix by @Joannall in #675
• Upgrade Anthropic.SDK to v4 by @hchen2020 in #676
• add processor by @iceljc in #679
• Add Refined Knowledge memorize and search. Update Planner terms by @Joannall in #680
• Bump System.Text.Json from 8.0.4 to 8.0.5 in /src/Infrastructure/BotSharp.Abstraction by @dependabot in #678
• add message update by @iceljc in #681
• optimize sql driver by @Oceania2018 in #682
• Bump Microsoft.Extensions.Caching.Memory from 8.0.0 to 8.0.1 in /src/Infrastructure/BotSharp.Core by @dependabot in #683
• Miscellaneous improvements by @Oceania2018 in #685
• Add attachment example and refine dictionary lookup by @Joannall in #684
• Skip refine if tables is empty by @hchen2020 in #686
• Add knowledge generation refinement by @Joannall in #687
• add instruct by @iceljc in #688
• minor fix by @iceljc in #689
• Voice copilot support postback by @yileicn in #690
• add comments by @iceljc in #691
• fix routing context by @iceljc in #693
• support assistant message payload by @yileicn in #692
• Add relevant knowledge to Summary Plan by @Joannall in #694
• minor change by @Joannall in #695
• add tags by @iceljc in #696
• support assistant message playload by @yileicn in #697
• Docs: Typo Fix by @Chaitanya110703 in #700
• add default by @iceljc in #701
• Docs: Typo Fix by @Chaitanya110703 in #699
• Fix model by @iceljc in #702
• create conv with tags by @iceljc in #703
• add text field in generic element by @iceljc in #704
• Add drop tmp table, Refined kg search by @Joannall in #705
• Code Driver init by @hchen2020 in #706
• Add a ChannelId column to the ConversationDocument by @yileicn in #698
• support intent in welcome webhook by @wcao-lessen in #711
• naming change-domain knowledge by @Joannall in #710
• fix states query parameter by @wcao-lessen in #713
• Add BotSharp.Plugin.MicrosoftExtensionsAI by @stephentoub in #707
• formatter update by @Joannall in #715
• Add Database Hook by @Joannall in #717
• minor change by @Joannall in #719
• Fix planner issue of Claude output array is not stable by @hchen2020 in #718
• WebDriver improvement by @Oceania2018 in #716
• Features/add user management by @iceljc in #720
• fix create agent issue by @iceljc in #722
• add chat file download by @iceljc in #723
• init conv side car by @iceljc in #712
• Remove AffiliateId by @Oceania2018 in #724
• Phone NullReferenceException by @Oceania2018 in #725
• Selector multiple by @jizh4635 in #721
• add knowledge menu roles by @iceljc in #727
• filter plugin by names by @iceljc in #728
• excel handler - drop tmp table before create by @Joannall in #729
• refine sidecar by @iceljc in #730
• refine side car by @iceljc in #731
• Fix dictionary lookup by @hchen2020 in #732
• Add default utilities for Planner by @Joannall in #733
• add missing flag by @iceljc in #734
• init conv simulation by @iceljc in #735
• refine stop condition by @iceljc in #736
• refine prompt by @iceljc in #737
• update knowledge generation prompt by @Joannall in #739
• Move DBHelpPlanningHook to SQL Driver by @Joannall in #740
• resolve conflict by @iceljc in #741
• Features/add evaluation by @iceljc in #743
• ITwilioHook by @hchen2020 in #742
• Add Sql Validator by @Joannall in #744
• minor update by @Joannall in #745
• Fix Twilio CallbackPath path by @hchen2020 in #747
• Update Microsoft.Extensions.AI.Abstractions to 9.0.0-preview.9.24556.5 by @stephentoub in #746
• Twilio optimize by @hchen2020 in #748
• Features/add role by @iceljc in #749
• add similar search by @iceljc in #750
• minor changes by @iceljc in #751
• add exclude roles by @iceljc in #752
• add plugin provider vertexai by @danijerez in #738
• update sql validator by @Joannall in #753
• Redis Event by @Oceania2018 in #754
• add twilio outbound phone call utility by @wcao-lessen in #755
• refine twilio outbound by @iceljc in #756
• Fix validate_sql removing comments in sql. by @hchen2020 in #757
• update prompt by @Joannall in #764
• Update M.E.AI to 9.0.1-preview.1.24570.5 by @stephentoub in #763
• Features/dashboard by @ChenGong-lessen in #762
• Refactor reasoner and planner by @hchen2020 in #765
• Features/merge origin agent by @iceljc in #761
• set UserId from conversation states for new conversation creation by @adenchen123 in #766
• Fix sql_select dbtype by @hchen2020 in #768
• add agent utility doc by @iceljc in #770
• change doc by @iceljc in #771
• add json by @iceljc in #772
• add index by @iceljc in #773
• Fix duplicate function loaded OnAgentUtilityLoaded by @hchen2020 in #775
• add OnSourceCodeGenerated Hook by @Joannall in #776
• Redis Event by @Oceania2018 in #769
• Fix Mongo version issue. by @hchen2020 in #777
• add comments by @iceljc in #774
• relocate by @iceljc in #778
• Fix GetReasoner. by @Oceania2018 in #779
• fix typo by @iceljc in #780
• refine utility name by @iceljc in #781
• add common agent hook by @iceljc in #783
• rename by @iceljc in #784
• crontab by @hchen2020 in #782
• add crontab storage by @iceljc in #786
• Support multi-planner. by @hchen2020 in #788
• Feature/refine cronttab by @iceljc in #789
• Feature/refine cronttab by @iceljc in #790
• init dialog in side car by @iceljc in #791
• refine doc by @iceljc in #792
• crontab only allow 1 minute. by @hchen2020 in https://github.com/Sc...

r3.0-two-staging-planning

What's Changed

• fix db name by @iceljc in #560
• refine json format in log by @iceljc in #559
• fix text-completion by @hchen2020 in #561
• Features/refine json format by @iceljc in #562
• refine file selection prompt by @iceljc in #563
• support xhr response. by @Oceania2018 in #564
• TwostagePlanner practice by @hchen2020 in #565
• add audio service to transcribe local mp3/wav file by @evan-cao-wb in #566
• Add Tencent Cloud object storage support by @GreenShadeZhang in #567
• Add new email reader utility to read emails using IMAP. by @visagang in #568
• Add WaitTime to ElementActionArgs by @Oceania2018 in #570
• fix audio range request by @iceljc in #572
• use 4o-mini by @iceljc in #574
• optimize paramter type check by @yileicn in #573
• Features/refine file select by @iceljc in #578
• use select file option by @iceljc in #579
• get file bytes by @iceljc in #580
• Features/refine file select by @iceljc in #581
• Features/refine knowledge base by @iceljc in #576
• fix string join by @iceljc in #583
• Twilioplugin draft by @seplz in #582
• resolve conflict by @iceljc in #584
• fix typo by @iceljc in #585
• remove from form by @iceljc in #586
• Add ExcludeResponseUrls to PageActionArgs by @Oceania2018 in #587
• add knowledge collections by @iceljc in #590
• Features/add prompt by channel by @iceljc in #591
• relocate instructions by @iceljc in #592
• add default collection by @iceljc in #594
• unite knowledge search model by @iceljc in #596
• update twilioPlugin by @seplz in #593
• python interpreter by @hchen2020 in #595
• Features/add graph search by @iceljc in #597
• 1. split knowledge menu by @iceljc in #598
• change menu name by @iceljc in #599
• change menu name by @iceljc in #600
• Added conversation update. by @GreenShadeZhang in #601
• add document by @evan-cao-wb in #571
• minor changes by @seplz in #604
• Update Two Stage Planner by @Joannall in #603
• AddTwilioRequestValidation by @hchen2020 in #605
• Features/add embedding dim setting by @iceljc in #606
• complete text2speech in queue service by @seplz in #607
• Speech + Digits by @hchen2020 in #608
• fix bug of twilio by @hchen2020 in #610
• improve the workflow by @wcao-lessen in #611
• adjust two stage planner. by @hchen2020 in #612
• AgentExecuting by @hchen2020 in #613
• bugfix by @wcao-lessen in #615
• Add EnableResponseCallback by @Oceania2018 in #617
• Fix router history dialogs. by @hchen2020 in #618
• add DDL to Planner by @Joannall in #619
• Features/refine audio handler by @iceljc in #616
• global knowledge by @hchen2020 in #620
• refine email sender and image generator prompt by @iceljc in #621
• Improve Primary Planning by @Joannall in #622
• minor change by @iceljc in #623
• minor change by @iceljc in #624
• relocate by @iceljc in #625
• refine file dir by @iceljc in #626
• Hints by @hchen2020 in #627
• support dialCSR by @wcao-lessen in #628
• remove duplicate by @iceljc in #629
• add exclude agent ids by @iceljc in #630
• support reply hints by @wcao-lessen in #631
• SQL Driver by @hchen2020 in #632
• Features/add knowledge docs by @iceljc in #633
• use binary data by @iceljc in #634
• Optimize the implementation of conversation progress by @yileicn in #635
• fix read knowledge doc by @iceljc in #636
• add vector data source by @iceljc in #637
• optimize indication by @yileicn in #638
• update data assistant - DDL and execution hook by @Joannall in #639
• refine knowledge doc by @iceljc in #640
• remove web url for now by @iceljc in #641
• fix welcome message by @iceljc in #642
• refine knowledge doc by @iceljc in #644
• add web url in file meta by @iceljc in #645
• ExecuteSqlSelectAutonomous by @Oceania2018 in #646
• Features/add knowledge docs by @iceljc in #647
• Skip if agent if null by @hchen2020 in #648
• delete all points in a collection by @iceljc in #649
• Features/add knowledge docs by @iceljc in #652
• refine knowledge doc filter by @iceljc in #653
• use map by @iceljc in #654
• improvement by @Oceania2018 in #655
• Add sql dictionary lookup utility by @Joannall in #656
• add collection exist by @iceljc in #657
• sqlite version for excel handler by @evan-cao-wb in #658
• Update dictionary look up by @Joannall in #659
• refine sql by @iceljc in #660
• refine code by @iceljc in #661
• sql output formatting. by @hchen2020 in #662
• return not found if no records. by @Oceania2018 in #663
• upgrade open ai by @iceljc in #664
• Redis backplane for SignalR by @hchen2020 in #665
• initial version for mysqldriver by @evan-cao-wb in #666
• optimize excel handler by @hchen2020 in #667
• clean comments by @iceljc in #668
• improve data dictionary lookup and plan summary by @Joannall in #670
• TranslationResponseModel by @Oceania2018 in #671

New Contributors

• @GreenShadeZhang made their first contribution in #567
• @wcao-lessen made their first contribution in #611

Full Changelog: r2.0-agent-utility...r3.0-two-staging-planning

r2.0-agent-utility

What's Changed

• merge latest code by @geffzhang in #370
• merge latest code by @geffzhang in #389
• user avatar by @iceljc in #466
• Features/add conversation summary by @iceljc in #471
• Features/add agent user role by @iceljc in #457
• summarize multiple conversations by @iceljc in #474
• WebDriver improvement by @Oceania2018 in #475
• add Pagination size default value by @yileicn in #477
• clean file controller by @iceljc in #476
• hdong:keep same logic with name. by @YouWeiDH in #478
• Features/add http handler by @iceljc in #480
• fix user issue by @iceljc in #481
• fix user cache by @iceljc in #482
• fix user profile by @iceljc in #483
• fix conv file delete issue by @iceljc in #484
• remove conversation header by @iceljc in #485
• refine summary prompt by @iceljc in #486
• refine prompt by @iceljc in #490
• GLM-4 series: Open Multilingual Multimodal Chat LMs by @Oceania2018 in #487
• Features/add pdf upload by @iceljc in #491
• Fix WebDriver locator issue. by @Oceania2018 in #492
• Bugfix/fix agent conv edge cases by @iceljc in #494
• Fix compile error. by @hchen2020 in #496
• Bugfix/fix agent conv edge cases by @iceljc in #497
• fix login by @iceljc in #498
• allow router menu item by @iceljc in #499
• Update TranslationService.cs by @yileicn in #500
• append image analysis prompt by @iceljc in #503
• refine load attachment by @iceljc in #504
• fix file save by @iceljc in #505
• Bugfix/fix file save by @iceljc in #506
• flush to disk by @iceljc in #507
• Bugfix/fix file save by @iceljc in #508
• refine message files by @iceljc in #509
• Add email conversation as part of channel by @visagang in #511
• Features/add translation memory by @iceljc in #501
• add image generation by @iceljc in #510
• WebDriver improvements. by @Oceania2018 in #512
• Features/upgrade open ai by @iceljc in #513
• upgrade by @iceljc in #514
• fix ref error by @iceljc in #515
• add open ai text completion by @iceljc in #516
• add translation memory setting by @iceljc in #518
• add pdf converter by @iceljc in #519
• User reset password by @Oceania2018 in #520
• add text embedding by @iceljc in #521
• Features/refine image generation by @iceljc in #522
• Aspire support by @geffzhang in #517
• add default embed dimen by @iceljc in #523
• change to agent utility by @iceljc in #524
• Features/add image generator utility by @iceljc in #525
• simplify image generate by @iceljc in #526
• refine message file save by @iceljc in #527
• Change to read_file by @iceljc in #528
• refine message file loading by @iceljc in #529
• Bump System.Text.Json from 8.0.3 to 8.0.4 in /src/Infrastructure/BotSharp.Abstraction by @dependabot in #532
• EnumHelper.cs by @Oceania2018 in #535
• add open ai plugin by @iceljc in #533
• fix user log in by @iceljc in #534
• Add new email handler utility by @visagang in #536
• refine chat image reading by @iceljc in #537
• refine http handler by @iceljc in #538
• Fix route to agent. by @hchen2020 in #539
• Code cleanup for EmailHandle Plugin by @visagang in #540
• fix routing to agent handler by @iceljc in #542
• remove function return appended to dialogs. by @hchen2020 in #544
• add sql executor utility by @iceljc in #543
• Features/add file handler by @iceljc in #545
• Features/add file handler by @iceljc in #546
• minor fix by @Oceania2018 in #547
• extend email with attachments by @iceljc in #548
• knowledge learner by @hchen2020 in #549
• fix compile issue by @iceljc in #550
• move generate image to file handler by @iceljc in #551
• relocate email handler settings by @iceljc in #552
• Features/add image edit by @iceljc in #553
• Features/add image edit by @iceljc in #554
• add image mask edit by @iceljc in #555
• Bugfix/get mongo db name by @iceljc in #558

New Contributors

• @YouWeiDH made their first contribution in #478

Full Changelog: r1.5-sse...r2.0-agent-utility

r1.5-server-side-event

What's Changed

• add chat files by @iceljc in #454
• Features/add conversation user by @iceljc in #456
• prevent send event if it is not conversation by @iceljc in #458
• Fix llm selection bug. by @hchen2020 in #459
• add default model by @iceljc in #460
• refine log in by @iceljc in #461
• Improve translation. by @hchen2020 in #462
• translation improvement. by @hchen2020 in #463
• Fix SSE response format. by @hchen2020 in #465
• Update TranslationService.cs by @yileicn in #467
• optimize translation prompt by @yileicn in #468
• Update TranslationService.cs by @yileicn in #469
• fix api controller json serilizer by @iceljc in #470
• optimize UpdateBreakPoint by @yileicn in #472

Full Changelog: r1.4-mutl-languages...r1.5-sse

r1.4-multi-languages

What's Changed

• Update args definition for router agent by @jli238 in #404
• add visible property by @iceljc in #403
• refine agent refresh by @iceljc in #405
• add log in agent refresh by @iceljc in #406
• fix "talk to ppl" issue by @sylviachency in #408
• add repository enum by @iceljc in #410
• Optimize WebDriver with context id. by @Oceania2018 in #411
• fix file serialization by @iceljc in #412
• refine save state by args by @iceljc in #414
• Features/add secondary language by @iceljc in #415
• Refactor human intervention needed. by @hchen2020 in #416
• update human customer service agent by @sylviachency in #418
• Update agent.json by @sylviachency in #419
• Features/add translation by @iceljc in #420
• translation prompt. by @hchen2020 in #421
• Update language prompt. by @hchen2020 in #422
• Fix localization return issue. by @hchen2020 in #423
• update language. by @hchen2020 in #424
• refine multilanguage log by @iceljc in #425
• update language detection by @Joannall in #426
• minor change by @iceljc in #427
• Return reason from HasMissingRequiredField. by @hchen2020 in #428
• refine type check by @iceljc in #429
• Fix language detection. by @hchen2020 in #430
• Increase MaxInputLengthPerRequest to 512. by @hchen2020 in #431
• SeleniumWebDriver by @Oceania2018 in #417
• Server-sent Events. by @hchen2020 in #432
• add chat indication by @iceljc in #433
• Anthropic AI by @hchen2020 in #436
• Features/add attachment by @iceljc in #437
• add payload by @iceljc in #438
• Fallback Agent. by @hchen2020 in #439
• refactor file dialog structure by @iceljc in #440
• Only show playload to AI. by @hchen2020 in #441
• Template [Translate] by @Oceania2018 in #442
• unite json serializer by @iceljc in #443
• fix json log by @iceljc in #444
• optimize translation by @yileicn in #445
• optimize translation by @yileicn in #446
• Fix translation plugin. by @hchen2020 in #447
• Fix translator. by @hchen2020 in #448
• add agent template update endpoint by @iceljc in #449
• Bugfix/fix log order by @iceljc in #450
• fix invoke function by @iceljc in #451
• minor fix by @iceljc in #452
• fix truncate breakpoint by @iceljc in #453
• Fix translation issue. by @hchen2020 in #455

New Contributors

• @jli238 made their first contribution in #404
• @sylviachency made their first contribution in #408
• @yileicn made their first contribution in #445

Full Changelog: v1.3-stable-tag...r1.4-mutl-languages

v1.3.2 refresh agent improvement

What's Changed

• Update args definition for router agent by @jli238 in #404
• add visible property by @iceljc in #403
• refine agent refresh by @iceljc in #405
• add log in agent refresh by @iceljc in #406
• fix "talk to ppl" issue by @sylviachency in #408
• add repository enum by @iceljc in #410
• Optimize WebDriver with context id. by @Oceania2018 in #411

New Contributors

• @jli238 made their first contribution in #404
• @sylviachency made their first contribution in #408

Full Changelog: v1.3-stable-tag...v1.3.2-release