Movatterモバイル変換


[0]ホーム

URL:


Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

Commitcda8053

Browse files
committed
add_lock_to_protect mReqeustToSession
Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>
1 parent20e6cd3 commitcda8053

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

‎cpp/tensorrt_llm/batch_manager/dataTransceiver.cpp‎

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -291,8 +291,9 @@ class CacheSender::Impl
291291
mSelfState.setCommState(std::move(commState));
292292
}
293293

294-
[[nodiscard]]size_tgetCounterpartsCount(LlmRequest::RequestIdType requestId)const
294+
[[nodiscard]]size_tgetCounterpartsCount(LlmRequest::RequestIdType requestId)
295295
{
296+
std::unique_lock<std::mutex>lock(mMtxForMap);
296297
auto it =mRequestToSession.find(requestId);
297298
TLLM_CHECK(it !=mRequestToSession.end());
298299
return it->second.getConnections().size();

0 commit comments

Comments
 (0)

[8]ページ先頭

©2009-2025 Movatter.jp