Fix various CI failures + enable pytest-related Ruff inspections

[Dev-iL]

Attempting to fix CI + Enable Ruff PT006 and PT007.

Changes

• Remove tests for pre-3.9 types (Dict, Tuple) - these types are deprecated and should not be used.
• Standardize @pytest.mark.parametrize parameters as tuples of strings instead of a stringified-lists, according to Ruff's PT006 & PT007.
• Replace the numpy < 2 pin with pyspark >= 4.0.0
• Update the vaex ci tasks to run with python <= 3.12 (instead of just 3.10)
• Include Skip ray tests on Python 3.14 #1473

How I tested this

All modified test files were evaluated on a local py3.14 venv.

Notes

Feel free to cherry pick into individual PRs if it makes more sense.

Checklist

• PR has an informative and human-readable title (this will be pulled into the release notes)
• Changes are limited to a single goal (no scope creep)
• Code passed the pre-commit check & code is left cleaner/nicer than when first encountered.
• Any change in functionality is tested
• New functions are documented (with a description, list of inputs, and expected output)
• Placeholder code is flagged / future TODOs are captured in comments
• Project documentation has been updated if adding/changing functionality.