Commit2914c6a

authored and

yufeiwu-nv

committed

[None][fix] Add Lock to protect mReqeustToSession (NVIDIA#8085)

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>Co-authored-by: Xianjie Qiao <5410381+qiaoxj07@users.noreply.github.com>Signed-off-by: yufeiwu-nv <230315618+yufeiwu-nv@users.noreply.github.com>

1 parentcf83567 commit2914c6aCopy full SHA for 2914c6a

File tree

1 file changed

-1

lines changed

cpp/tensorrt_llm/batch_manager
- dataTransceiver.cpp

1 file changed

-1

lines changed

`‎cpp/tensorrt_llm/batch_manager/dataTransceiver.cpp‎`

Lines changed: 2 additions & 1 deletion

Original file line number	Diff line number	Diff line change
`@@ -291,8 +291,9 @@ class CacheSender::Impl`
`291`	`291`	`mSelfState.setCommState(std::move(commState));`
`292`	`292`	`}`
`293`	`293`
`294`		`- [[nodiscard]]size_tgetCounterpartsCount(LlmRequest::RequestIdType requestId)const`
	`294`	`+ [[nodiscard]]size_tgetCounterpartsCount(LlmRequest::RequestIdType requestId)`
`295`	`295`	`{`
	`296`	`+ std::unique_lock<std::mutex>lock(mMtxForMap);`
`296`	`297`	`auto it =mRequestToSession.find(requestId);`
`297`	`298`	`TLLM_CHECK(it !=mRequestToSession.end());`
`298`	`299`	`return it->second.getConnections().size();`

0 commit comments

Comments

(0)

Movatterモバイル変換

Navigation Menu

Search code, repositories, users, issues, pull requests...

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Commit2914c6a

File tree

1 file changed

1 file changed

`‎cpp/tensorrt_llm/batch_manager/dataTransceiver.cpp‎`

0 commit comments