Introduce pytest integration out of the box

[aignas]

Currently users need to know about pytest-bazel or other ways to integrate rules_python with bazel.

Ideally the discovery and onboarding of new users should be as easy as we can make it to be without making rules_python unclude everything and the kitchen sink.

Some ideas how we could do this:

• Implement the default pypi hub idea Support a default hub repo concept in bzlmod #2094
• pre-declare the pytest and pytest-bazel dependencies, where we would generate entries in the hub repo with aliases. Maybe we could define a particular default version for everything to work out of the box.
• create a pytest_test rule where we are using the declared deps.
• the users can override the pytest and other included deps.
• use the main_module attribute to launch pytest-bazel. If pytest is not there users would get an error that it could not be imported.

Open questions:

• can we default to pytest-bazel in all py_test invocations if there is no main or main_module defined?
• Is "pypi" a good name to reserve as the default hub repo? How does the predeclaring work? We just accept the same args as whl_library but all optional?
• Who can pre-declare deps and if multiple versions are declared, which one do we chose? We have version marker parsing in rules_python and we can even do resolution based on version ranges, e.g. users declare that they need pytest 7.1 or above and we get the lowest available version that satisfies the conditions. We can also do this by python version since we have marker expression evaluation support.

Design goals

• no overhead in the number of targets, hence usage of main_module.
• little maintenance in rules_python.
• better out of the box experience. How would the users discover the feature?

[aignas]

@rickeylev anything to add? @keith, any requests as a user that we should think about?

[rickeylev]

default py_test to use pytest if there's no main/main_module

Oh, that's clever. Maybe? Eh. Well. I don't see how to do so without it being considered a breaking change. Today, you have to put if name == main: call_your_main(), so if we invoke it in a way where it isn't name==main, then its breaking.

I was more thinking, as step one, we introduce a pytest_test rule, then figure out how to transition.

is pypi a good name to reserve as the default hub repo

That's what I was thinking, yes. I'm pretty sure we can do so in a non-intrusive enough way.

Who can pre-declare deps

Anyone. The basic design I had in mind was: you call pip.dep(name), which makes @pypi//name available. If no name is seen, then it maps to a target that gives an error at execution phase saying "no implementation registered"

if multiple versions are declared, which one do we chose?

Yeah, it gets murky here. I was thinking something simple, e.g. order of pip.parse calls, after accounting for the more statically set platform settings (e.g. python_verison).