- Notifications
You must be signed in to change notification settings - Fork13.9k
security : add note about RPC and server functionality#13061
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.
Already on GitHub?Sign in to your account
Uh oh!
There was an error while loading.Please reload this page.
Conversation
ngxson commentedApr 22, 2025 • edited
Loading Uh oh!
There was an error while loading.Please reload this page.
edited
Uh oh!
There was an error while loading.Please reload this page.
Maybe it also worth printing a line on |
rgerganov commentedApr 22, 2025
we already do this:https://github.com/ggml-org/llama.cpp/blob/master/examples/rpc/rpc-server.cpp#L268-L276 |
slaren left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others.Learn more.
I would add the same note about the llama-server.
ab47dec intomasterUh oh!
There was an error while loading.Please reload this page.
* security : add note about RPC functionality* security : add note about llama-server
We are generally aware that the RPC backend and
rpc-serverare vulnerable to all sorts of attack vectors. At some point we added a notice in the README to avoid usage of the RPC functionality in sensitive environments:https://github.com/ggml-org/llama.cpp/tree/master/examples/rpcHowever, we keep receiving security advisories about the RPC backend that we don't have the capacity to act upon privately. It makes more sense for the time being to resolve such vulnerabilities publicly, so that the community can help in the process.
With this change to the security policy, we categorize such issues as known vulnerabilities and recommend to skip the advisory process. My suggestion is this to be in effect until we feel more confident about the security of the RPC implementation.