gh-144569: Avoid creating temporary objects in `BINARY_SLICE` for list, tuple, and unicode by cocolato · Pull Request #144590 · python/cpython

cocolato · 2026-02-08T08:16:33Z

When the tier 2 optimizer can determine the type of the container being sliced, _BINARY_SLICE can be replaced with a specialized micro-op that bypasses the PySliceObject allocation entirely.

This PR implements scalar replacement of BINARY_SLICE by add new tier2 op _BINARY_SLICE_LIST, _BINARY_SLICE_TUPLE, and _BINARY_SLICE_UNICODE.

Issue: Avoid creating temporary objects in BINARY_SLICE #144569

cocolato · 2026-02-08T09:08:37Z

I think the tests failure that occurred is unrelated to the PR.

Fidget-Spinner

Pretty close, thanks!

Lib/test/test_capi/test_opt.py

Python/bytecodes.c

Fidget-Spinner · 2026-02-08T11:21:22Z

You forgot to add the new recorder to BINARY_SLICE macro op

Python/bytecodes.c

Fidget-Spinner

lgtm just one comment and add news please

Fidget-Spinner · 2026-02-08T12:20:23Z

Python/bytecodes.c

+                PySlice_AdjustIndices(PyUnicode_GET_LENGTH(container_o), &istart, &istop, 1);
+                res_o = PyUnicode_Substring(container_o, istart, istop);
+            }
+            DECREF_INPUTS();


We should split this into the POP_TOP POP_TOP form, can you please do that in a follow up PR?

Fidget-Spinner · 2026-02-08T12:27:05Z

Actually I've changed my mind. Can you please open a PR to convert BINARY_SLICE to the POP_TOP form please? Then after we merge that PR we can update this one

Fidget-Spinner

Let's leave the DECREF_INPUTS alone for now and try to remove it in a future PR.

The code has repeated instances that should be factored out to a micro-op

Python/bytecodes.c

Python/optimizer_bytecodes.c

Misc/NEWS.d/next/Core_and_Builtins/2026-02-08-13-14-00.gh-issue-144569.pjlJVe.rst

…e-144569.pjlJVe.rst

Python/bytecodes.c

Fidget-Spinner · 2026-02-08T16:44:48Z

This is pretty close, I'm going to push some changes in, then wait a day to see if Mark has any objections tomorrow.

cocolato · 2026-02-08T16:48:45Z

Thanks for your guidance!

1. We cannot exit after unpacking indices, as the stack contains tagged ints now which may lead to a crash. We must insert a guard for the type before unpacking indices. 2. It is possible for an indice to not fit in a tagged int, in which case we must deopt. 3. Recorded values do not always mean that that's the actual type we will see at runtime. So we must guard on that as well.

Fidget-Spinner · 2026-02-08T17:15:09Z

@cocolato please check out the latest commit and the extended commit message for the bugs fixed. Thanks!

Fidget-Spinner · 2026-02-08T17:25:15Z

add_int.py

def testfunc(n):
    data = [1, 2, 3, 4, 5]
    a, b = 1, 3
    for _ in range(n):
        x = data[a:b]
    return x

testfunc(50000000)

Results using hyperfine:

Summary
  PYTHON_JIT=1 ./python ../add_int.py ran
    1.12 ± 0.02 times faster than PYTHON_JIT=0 ./python ../add_int.py

So we made it >10% faster. Nice!

cocolato · 2026-02-09T03:10:04Z

@cocolato please check out the latest commit and the extended commit message for the bugs fixed. Thanks!

LGTM! Thanks again for the fix, I learned a lot from it.

Results using hyperfine:

This is my first time learning about this tool, and it looks great. In the past, when I needed to run benchmarks locally, timeit was somewhat inaccurate, and pyperformance was a bit too heavy.

cocolato · 2026-02-09T03:20:16Z

At the same time, I've noticed that when set PYTHON_OPT_DEBUG=5 is enabled, DUMP_UOP currently only outputs the first ADDED uop. I'll fix this in other PR.

markshannon

Thanks for doing this.
This looks sound, but there are some inefficiencies.

Beware the size of uops. They will be converted to machine code, so keeping code size down is important for performance.

Lib/test/test_capi/test_opt.py

Python/optimizer_bytecodes.c

Python/bytecodes.c

markshannon · 2026-02-09T17:46:53Z

Python/optimizer_bytecodes.c

        }
    }

+    op(_UNPACK_INDICES, (container, start, stop -- container, sta, sto)) {


start and stop may well be constants. Slices like [:n] and [n:] are quite common, so this can be optimized, popping the None and replacing it with tagged(0) for start, or tagged(MAX) for the end.

If both values are constant we can eliminate the _UNPACK_INDICES. If only one is constant, then we can replace _UNPACK_INDICES with a non-negative compact int guard and tagging.

I believe this should be implemented after #144569 (comment). I will open other PR to do this.

Python/optimizer_bytecodes.c

bedevere-app · 2026-02-09T17:51:55Z

A Python core developer has requested some changes be made to your pull request before we can consider merging it. If you could please address their requests along with any other requests in other reviews from core developers that would be appreciated.

Once you have made the requested changes, please leave a comment on this pull request containing the phrase I have made the requested changes; please review again. I will then notify any core developers who have left a review that you're ready for them to take another look at this pull request.

cocolato · 2026-02-10T16:03:52Z

Thank you for your review and corrections! I have made the requested changes; please review again.

bedevere-app · 2026-02-10T16:03:58Z

Thanks for making the requested changes!

@markshannon: please review the changes made to this pull request.

Scalar replacement of BINARY_SLICE for list, tuple, and unicode

6ada5ed

cocolato requested review from Fidget-Spinner, markshannon, savannahostrowski and tomasr8 as code owners February 8, 2026 08:16

bedevere-app bot added the awaiting review label Feb 8, 2026

bedevere-app bot mentioned this pull request Feb 8, 2026

Avoid creating temporary objects in BINARY_SLICE #144569

Open

Fidget-Spinner reviewed Feb 8, 2026

View reviewed changes

Lib/test/test_capi/test_opt.py Outdated Show resolved Hide resolved

Python/bytecodes.c Outdated Show resolved Hide resolved

add _RECORD_3OS_TYPE

2b5e88c

cocolato commented Feb 8, 2026

View reviewed changes

Python/bytecodes.c Show resolved Hide resolved

Fidget-Spinner reviewed Feb 8, 2026

View reviewed changes

Python/bytecodes.c Outdated Show resolved Hide resolved

Python/optimizer_bytecodes.c Show resolved Hide resolved

📜🤖 Added by blurb_it.

3faaac9

Fidget-Spinner reviewed Feb 8, 2026

View reviewed changes

Misc/NEWS.d/next/Core_and_Builtins/2026-02-08-13-14-00.gh-issue-144569.pjlJVe.rst Outdated Show resolved Hide resolved

Fidget-Spinner and others added 2 commits February 8, 2026 13:23

Update Misc/NEWS.d/next/Core_and_Builtins/2026-02-08-13-14-00.gh-issu…

6290916

…e-144569.pjlJVe.rst

add _UNPACK_INDICES

3dd3f3a

cocolato commented Feb 8, 2026

View reviewed changes

Python/bytecodes.c Show resolved Hide resolved

move AdjustIndices to _UNPACK_INDICES

b47e3fc

markshannon requested changes Feb 9, 2026

View reviewed changes

bedevere-app bot removed the awaiting review label Feb 9, 2026

bedevere-app bot added the awaiting changes label Feb 9, 2026

cocolato changed the title ~~gh-144569: Scalar replacement of BINARY_SLICE for list, tuple, and unicode~~ gh-144569: Avoid creating temporary objects in BINARY_SLICE for list, tuple, and unicode Feb 10, 2026

cocolato added 3 commits February 10, 2026 23:22

fix bugs && add tests

56960c4

Merge branch 'main' into optimize/BINARY_SLICE

6b1c605

regen cases

c8a8f6f

bedevere-app bot added awaiting change review and removed awaiting changes labels Feb 10, 2026

bedevere-app bot requested a review from markshannon February 10, 2026 16:04

Uh oh!

Conversation

cocolato commented Feb 8, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

cocolato commented Feb 8, 2026

Uh oh!

Fidget-Spinner left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Fidget-Spinner commented Feb 8, 2026

Uh oh!

Uh oh!

Fidget-Spinner left a comment

Choose a reason for hiding this comment

Uh oh!

Fidget-Spinner Feb 8, 2026

Choose a reason for hiding this comment

Uh oh!

Fidget-Spinner commented Feb 8, 2026

Uh oh!

Fidget-Spinner left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Fidget-Spinner commented Feb 8, 2026

Uh oh!

cocolato commented Feb 8, 2026

Uh oh!

Fidget-Spinner commented Feb 8, 2026

Uh oh!

Fidget-Spinner commented Feb 8, 2026

Uh oh!

cocolato commented Feb 9, 2026

Uh oh!

cocolato commented Feb 9, 2026

Uh oh!

markshannon left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

markshannon Feb 9, 2026

Choose a reason for hiding this comment

Uh oh!

cocolato Feb 10, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

bedevere-app bot commented Feb 9, 2026

Uh oh!

cocolato commented Feb 10, 2026

Uh oh!

bedevere-app bot commented Feb 10, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

cocolato commented Feb 8, 2026 •

edited

Loading