Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

[agent-sdk-j2s] agent-server runtime LLM switching#1544

Draft
enyst wants to merge 10 commits intoOpenHands:agent-sdk-26-llm-switch from
enyst:llm-server-switch
Draft

[agent-sdk-j2s] agent-server runtime LLM switching #1544
enyst wants to merge 10 commits intoOpenHands:agent-sdk-26-llm-switch from
enyst:llm-server-switch

Conversation

@enyst
Copy link
Collaborator

@enyst enyst commented Dec 29, 2025
edited
Loading

Implements runtime LLM switching end-to-end for remote clients (VS Code extension) without agent immutability/diff enforcement.

Key changes:

  • Agent is componentized: restore-time + runtime swaps (LLM, tools, context) are allowed; no diff-based enforcement.
  • Conversation persistence remains durable (base_state + events); LLM selection persists across restart; runtime secrets override persisted secrets on restore.
  • Agent-server REST: POST /api/conversations/{id}/llm (profile_id or inline llm) and POST /api/conversations/{id}/llm/switch.
  • Tests: agent-server wsproto integration covers large event history + restore + runtime LLM switching.

Docs: docs/llm_switching.md
Example: examples/02_remote_agent_server/07_llm_switch_and_restore.py

Docs: check-examples uses matching OpenHands/docs branches; docs PR OpenHands/docs#219 is optional follow-up for landing docs on main.
Beads: agent-sdk-j2s

@enyst enyst force-pushed the agent-sdk-26-llm-switch branch from e6574f6 to a7a9326 Compare December 29, 2025 22:41
@enyst enyst force-pushed the agent-sdk-26-llm-switch branch from a7a9326 to 90d0456 Compare December 29, 2025 22:45
@enyst enyst force-pushed the llm-server-switch branch 2 times, most recently from 7b3f8f0 to ff31fd7 Compare December 29, 2025 23:11
@enyst enyst force-pushed the agent-sdk-26-llm-switch branch from bec3c43 to fe9f0c7 Compare December 29, 2025 23:40
Copy link
Collaborator Author

enyst commented Dec 29, 2025

Rebased onto updated agent-sdk-26-llm-switch (which now includes latest upstream/main via profile branch). Only remaining failing check is check-examples, pending OpenHands/docs#219.

@enyst enyst force-pushed the agent-sdk-26-llm-switch branch from fe9f0c7 to 31ddf42 Compare December 29, 2025 23:54
@enyst enyst force-pushed the agent-sdk-26-llm-switch branch from 31ddf42 to e475956 Compare December 29, 2025 23:56
@enyst enyst requested a review from xingyaoww December 30, 2025 00:06
@enyst enyst force-pushed the agent-sdk-26-llm-switch branch from 6eb0d14 to dba84fb Compare December 30, 2025 00:31
enyst added 9 commits December 30, 2025 01:31
Copy link
Collaborator

[Automatic Post]: It has been a while since there was any activity on this PR. @enyst, are you still working on it? If so, please go ahead, if not then please request review, close it, or request that someone else follow up.

Copy link
Collaborator

[Automatic Post]: It has been a while since there was any activity on this PR. @enyst, are you still working on it? If so, please go ahead, if not then please request review, close it, or request that someone else follow up.

1 similar comment
Copy link
Collaborator

[Automatic Post]: It has been a while since there was any activity on this PR. @enyst, are you still working on it? If so, please go ahead, if not then please request review, close it, or request that someone else follow up.

@enyst enyst added behavior-initiative This is related to the system prompt sections and LLM steering. and removed behavior-initiative This is related to the system prompt sections and LLM steering. labels Feb 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@xingyaoww xingyaoww Awaiting requested review from xingyaoww

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Comments

AltStyle によって変換されたページ (->オリジナル) /