Movatterモバイル変換


[0]ホーム

URL:


Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

gh-143308: fix UAF when PickleBuffer is concurrently mutated in a callback#143312

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.

Already on GitHub?Sign in to your account

Merged
picnixz merged 13 commits intopython:mainfroma12k:fix-picklebuffer-uaf
Jan 3, 2026
Merged
Show file tree
Hide file tree
Changes fromall commits
Commits
Show all changes
13 commits
Select commitHold shift + click to select a range
1e4c48f
Fix Use-After-Free in _pickle by incrementing PickleBuffer exports
Dec 31, 2025
f359533
Remove trailing whitespace in test_pickle.py
Dec 31, 2025
4129734
Edit NEWS.d with better description of changes
Dec 31, 2025
a6a5713
Refactor and migrate tests from test_pickle to pickletester
Dec 31, 2025
a6a3a91
Add back deleted space between functions
Dec 31, 2025
b2117f5
Slight refactoring of tests; simplifying some logic
Dec 31, 2025
ec61e9c
Hardcoding pickle.HIGHEST_PROTOCOL in test
Dec 31, 2025
47396ab
Hardcoding pickle.HIGHEST_PROTOCOL in test slightly cleaner
Dec 31, 2025
fbc62c5
Add clickable issue ref to comment
a12kDec 31, 2025
334cc62
Merge branch 'python:main' into fix-picklebuffer-uaf
a12kDec 31, 2025
0d70297
Move NEWS entry for issue 143308 from Core_and_Builtins to Library se…
a12kDec 31, 2025
fc01ce1
Refactor save_picklebuffer to use PyObject_GetBuffer on PickleBuffer …
Jan 3, 2026
170b73f
A couple minor line alignments
Jan 3, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view

Some comments aren't visible on the classic Files Changed page.

29 changes: 29 additions & 0 deletionsLib/test/pickletester.py
View file
Open in desktop
Original file line numberDiff line numberDiff line change
Expand Up@@ -4261,6 +4261,35 @@ def check_array(arr):
# 2-D, non-contiguous
check_array(arr[::2])

def test_concurrent_mutation_in_buffer_with_bytearray(self):
def factory():
s = b"a" * 16
return bytearray(s), s
self.do_test_concurrent_mutation_in_buffer_callback(factory)

def test_concurrent_mutation_in_buffer_with_memoryview(self):
def factory():
obj = memoryview(b"a" * 32)[10:26]
sub = b"a" * len(obj)
return obj, sub
self.do_test_concurrent_mutation_in_buffer_callback(factory)

def do_test_concurrent_mutation_in_buffer_callback(self, factory):
# See: https://github.com/python/cpython/issues/143308.
class R:
def __bool__(self):
buf.release()
return True

for proto in range(5, pickle.HIGHEST_PROTOCOL + 1):
obj, sub = factory()
buf = pickle.PickleBuffer(obj)
buffer_callback = lambda _: R()

with self.subTest(proto=proto, obj=obj, sub=sub):
res = self.dumps(buf, proto, buffer_callback=buffer_callback)
self.assertIn(sub, res)

def test_evil_class_mutating_dict(self):
# https://github.com/python/cpython/issues/92930
from random import getrandbits
Expand Down
View file
Open in desktop
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
:mod:`pickle`: fix use-after-free crashes when a :class:`~pickle.PickleBuffer`
is concurrently mutated by a custom buffer callback during pickling.
Patch by Bénédikt Tran and Aaron Wieczorek.
38 changes: 23 additions & 15 deletionsModules/_pickle.c
View file
Open in desktop
Original file line numberDiff line numberDiff line change
Expand Up@@ -2636,53 +2636,61 @@ save_picklebuffer(PickleState *st, PicklerObject *self, PyObject *obj)
"PickleBuffer can only be pickled with protocol >= 5");
return -1;
}
constPy_buffer* view = PyPickleBuffer_GetBuffer(obj);
if (view == NULL) {
Py_buffer view;
if (PyObject_GetBuffer(obj, &view, PyBUF_FULL_RO) != 0) {
return -1;
}
if (view->suboffsets != NULL || !PyBuffer_IsContiguous(view, 'A')) {
if (view.suboffsets != NULL || !PyBuffer_IsContiguous(&view, 'A')) {
PyErr_SetString(st->PicklingError,
"PickleBuffer can not be pickled when "
"pointing to a non-contiguous buffer");
Comment on lines 2645 to 2646
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

Out of curiosity, but do we have a test for this?

a12k reacted with eyes emoji
Copy link
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

Neither of the tests added test for non-contiguous, but should be straightforward to add a test against a buffer with strides...

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

I just wanted to be sure that this branch was covered by existing tests or by other tests. We can increase the coverage in a follow-up PR.

a12k reacted with thumbs up emoji
return -1;
goto error;
}

int rc = 0;
int in_band = 1;
if (self->buffer_callback != NULL) {
PyObject *ret = PyObject_CallOneArg(self->buffer_callback, obj);
if (ret == NULL) {
return -1;
goto error;
}
in_band = PyObject_IsTrue(ret);
Py_DECREF(ret);
if (in_band == -1) {
return -1;
goto error;
}
}
if (in_band) {
/* Write data in-band */
if (view->readonly) {
return_save_bytes_data(st, self, obj, (const char *)view->buf,
view->len);
if (view.readonly) {
rc =_save_bytes_data(st, self, obj, (const char *)view.buf,
view.len);
}
else {
return_save_bytearray_data(st, self, obj, (const char *)view->buf,
view->len);
rc =_save_bytearray_data(st, self, obj, (const char *)view.buf,
view.len);
}
}
else {
/* Write data out-of-band */
const char next_buffer_op = NEXT_BUFFER;
if (_Pickler_Write(self, &next_buffer_op, 1) < 0) {
return -1;
goto error;
}
if (view->readonly) {
if (view.readonly) {
const char readonly_buffer_op = READONLY_BUFFER;
if (_Pickler_Write(self, &readonly_buffer_op, 1) < 0) {
return -1;
goto error;
}
}
}
return 0;

PyBuffer_Release(&view);
return rc;

error:
PyBuffer_Release(&view);
return -1;
}

/* A copy of PyUnicode_AsRawUnicodeEscapeString() that also translates
Expand Down
Loading

[8]ページ先頭

©2009-2026 Movatter.jp