Commitc78ab07

committed

feat(chat): add LLM request cancellation support#394

Implement proper cancellation for chat coding service by adding support for LLMProvider2 cancellation and ensuring cleanup when stopping or clearing sessions. Addresses issue#394.

1 parentf09d66a commitc78ab07Copy full SHA for c78ab07

File tree

1 file changed

+11

-0

lines changed

core/src/main/kotlin/cc/unitmesh/devti/gui/chat
- ChatCodingService.kt

1 file changed

+11

-0

lines changed

`‎core/src/main/kotlin/cc/unitmesh/devti/gui/chat/ChatCodingService.kt‎`

Lines changed: 11 additions & 0 deletions

Original file line number	Diff line number	Diff line change
`@@ -9,6 +9,7 @@ import cc.unitmesh.devti.custom.compile.CustomVariable`
`9`	`9`	`importcc.unitmesh.devti.gui.chat.message.ChatActionType`
`10`	`10`	`importcc.unitmesh.devti.gui.chat.message.ChatContext`
`11`	`11`	`importcc.unitmesh.devti.gui.chat.message.ChatRole`
	`12`	`+importcc.unitmesh.devti.llm2.LLMProvider2`
`12`	`13`	`importcc.unitmesh.devti.llms.LlmFactory`
`13`	`14`	`importcc.unitmesh.devti.llms.custom.Message`
`14`	`15`	`importcc.unitmesh.devti.provider.ContextPrompter`
`@@ -28,9 +29,18 @@ class ChatCodingService(var actionType: ChatActionType, val project: Project) {`
`28`	`29`	`fungetLabel():String="$actionType Code"`
`29`	`30`
`30`	`31`	`funstop() {`
	`32`	`+// Cancel the coroutine job`
`31`	`33`	`currentJob?.cancel()`
	`34`	`+`
	`35`	`+// Also cancel the underlying LLM provider if it supports cancellation`
	`36`	`+if (llmProviderisLLMProvider2) {`
	`37`	`+ (llmProviderasLLMProvider2).cancelCurrentRequestSync()`
	`38`	`+ }`
	`39`	`+`
	`40`	`+ currentJob=null`
`32`	`41`	`}`
`33`	`42`
	`43`	`+`
`34`	`44`	`privatevar isLastAgent:Boolean=false`
`35`	`45`
`36`	`46`	`funhandlePromptAndResponse(`
`@@ -130,6 +140,7 @@ class ChatCodingService(var actionType: ChatActionType, val project: Project) {`
`130`	`140`
`131`	`141`	`funclearSession() {`
`132`	`142`	`// recreate session to make sure the history is cleared`
	`143`	`+ stop()`
`133`	`144`	`llmProvider=LlmFactory.create(project)`
`134`	`145`	`}`
`135`	`146`

0 commit comments

Comments

(0)

Movatterモバイル変換

Navigation Menu

Search code, repositories, users, issues, pull requests...

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Commitc78ab07

File tree

1 file changed

1 file changed

`‎core/src/main/kotlin/cc/unitmesh/devti/gui/chat/ChatCodingService.kt‎`

0 commit comments