[Feature Request]: Beam compat test suites should create compatible environments that installs Beam and Test environment dependencies

[tvalentyn]

What would you like to happen?

Current compat test suites first install test environment dependencies

beam/sdks/python/tox.ini

Line 406 in 76710e8

428: transformers>=4.28.0,<4.29.0

, then install Beam, then run tests.

This can create incompatible environments, since pip doesn't resolve dependencies for all packages that are installed simultaneously, see:
#30852
and
tox-dev/tox#2386 (comment)

We should see if we can install dependencies and Beam in the same command, that would reflect how people install beam together with other dependencies, withing the same requriements file or same pip install command.

Issue Priority

Priority: 3 (nice-to-have improvement)

Issue Components

• Component: Python SDK
• Component: Java SDK
• Component: Go SDK
• Component: Typescript SDK
• Component: IO connector
• Component: Beam YAML
• Component: Beam examples
• Component: Beam playground
• Component: Beam katas
• Component: Website
• Component: Spark Runner
• Component: Flink Runner
• Component: Samza Runner
• Component: Twister2 Runner
• Component: Hazelcast Jet Runner
• Component: Google Cloud Dataflow Runner

[derrickaw]

fixed via #37047