Adding dispatcher architecture

[vidyasagar-amd]

Proposed changes

This PR introduces new dispatching infrastructure for CK Tile, building on prior Tile Engine work, allowing users to isolate and run specific kernels using C++ and Python APIs for GEMMs (universal, preshuffle and multi-D variants). It also adds unified code-generation tools, GPU architecture based kernel filtering, a kernel registry handling mechanism, and a set of examples on how to integrate with other frameworks (C++/Python) together with basic unit and integration tests.

Checklist

Please put an x into the boxes that apply. You can also fill these out after creating the PR. If you're not sure, please don't hesitate to ask.

• I have added tests relevant to the introduced functionality, and the unit tests are passing locally
• I have added the test to REGRESSION_TESTS list defined at the top of CMakeLists.txt in tests/CMakeLists.txt, IF the test takes more than 30 seconds to run.
• I have added inline documentation which enables the maintainers with understanding the motivation
• I have removed the stale documentation which is no longer relevant after this pull request
• (If this change is user-facing) I have added release notes which provide the end users with a brief summary of the improvement from this pull request
• I have run clang-format on all changed files
• Any dependent changes have been merged

Discussion

If this is a relatively large or complex change, feel free to start a discussion by explaining why you chose the solution you did and what alternatives you considered

[spolifroni-amd]

The readmes etc look fine. I can't tell if this is supposed to be used internally for those contributing to the project, or for anyone using the library. If it's for anyone, then a changelog entry is needed to talk about arch_specs.json. Otherwise this is fine.

[afagaj]

It's worth adding a CHANGELOG.md entry to announce this change.

[Copilot]

Pull request overview

Introduce CK Tile Dispatcher architecture with new C++ and Python APIs, codegen tooling, kernel registry, and comprehensive GEMM/Conv examples, plus basic validation and benchmarking.

• Add GEMM and Convolution examples in Python and C++ demonstrating registry/dispatcher usage, validation, and benchmarking.
• Provide shared Python utilities for convolution (conv_utils.py) and codegen assets (requirements, scripts).
• Expand documentation (READMEs) for quick start and example overviews.

Reviewed changes

Copilot reviewed 74 out of 160 changed files in this pull request and generated 8 comments.

Show a summary per file

File	Description
dispatcher/examples/gemm/python/README.md	Adds quick start and Python GEMM examples overview and usage.
dispatcher/examples/gemm/python/01_basic_gemm.py	Basic GEMM example showing manual workflow (config, codegen, registry, dispatch).
dispatcher/examples/gemm/python/02_batch_gemm.py	Demonstrates running batches of GEMM problems with padding support.
dispatcher/examples/gemm/python/03_benchmark.py	Adds benchmarking script with warmup and TFLOPS reporting.
dispatcher/examples/gemm/python/04_validation.py	Validates GPU GEMM outputs against NumPy references with tolerances.
dispatcher/examples/gemm/python/05_numpy_integration.py	NumPy integration wrapper (GPUMatmul) and small demos.
dispatcher/examples/gemm/python/06_json_export.py	Exports registry/kernels metadata to JSON (and consumes C++ JSON if present).
dispatcher/examples/gemm/python/07_preshuffle.py	Preshuffle pipeline example with larger tiles and intrawave scheduler.
dispatcher/examples/gemm/python/08_multi_d.py	Multi-D fused GEMM example with CPU simulation and GPU base op timing.
dispatcher/examples/gemm/python/09_multi_registry.py	Multiple registries for compute/memory/latency optimized workloads.
dispatcher/examples/gemm/cpp/README.md	Adds C++ GEMM examples quick start and overview of example set.
dispatcher/examples/gemm/cpp/01_basic_gemm.cpp	Declarative kernel set example and simple GEMM run/verify.
dispatcher/examples/gemm/cpp/02_multi_size.cpp	Runs multiple problem sizes and reports TFLOPS.
dispatcher/examples/gemm/cpp/03_benchmark.cpp	Benchmark runner with stats (min/median/mean).
dispatcher/examples/gemm/cpp/04_validation.cpp	CPU reference and validation against GPU results.
dispatcher/examples/gemm/cpp/05_heuristics.cpp	Custom heuristic-based kernel selection demonstration.
dispatcher/examples/gemm/cpp/06_json_export.cpp	Registry JSON export and kernel set declarations.
dispatcher/examples/gemm/cpp/07_preshuffle.cpp	Preshuffle GEMM example with verification.
dispatcher/examples/gemm/cpp/08_multi_d.cpp	Multi-D fused concept demo using standard GEMM run.
dispatcher/examples/gemm/cpp/09_multi_registry.cpp	Multiple registries and dispatchers plus summary pattern.
dispatcher/examples/conv/python/conv_utils.py	Core Python utilities for conv signature/algorithm/arch, codegen, runners, and validation.
dispatcher/examples/conv/python/README.md	Adds Python Conv examples quick start and detailed guide.
dispatcher/examples/conv/python/02_conv2d_fwd.py	2D forward conv example with optional CPU verification and GPU run.
dispatcher/examples/conv/python/03_conv3d_fwd.py	3D forward conv example with CPU reference and GPU run.
dispatcher/examples/conv/python/04_conv2d_bwd_data.py	2D backward data conv with CPU reference and optional GPU execution.
dispatcher/examples/conv/python/05_conv2d_bwd_weight.py	2D backward weight conv with CPU reference and optional GPU execution.
dispatcher/examples/conv/python/06_benchmark.py	Conv benchmarking across small problems; optional CPU reference.
dispatcher/examples/conv/python/07_validation.py	Conv validation suite vs CPU with detailed analysis.
dispatcher/examples/conv/python/08_json_export.py	Export conv registry to JSON with basic stats and examples.
dispatcher/examples/conv/python/09_multi_registry.py	Multiple registries for conv workloads with selection heuristics.
dispatcher/examples/conv/python/10_conv3d_forward.py	3D forward conv GPU runner with timing and TFLOPS.
dispatcher/examples/conv/python/11_bwd_data.py	Backward data API demo with runners (note: codegen in progress).
dispatcher/examples/conv/python/12_bwd_weight.py	Backward weight API demo with dedicated runner (separate lib).
dispatcher/codegen/requirements.txt	Adds Python deps for codegen and optional tooling.
dispatcher/codegen/minimal_test_config.json	Minimal tile/trait config for test kernel generation.
dispatcher/codegen/generate_test_kernels.sh	Shell script to generate a minimal set of CK Tile kernels.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[tenpercent]

Thanks! A few notes while I'm just starting to look -

• all cmake flags seem to be necessary, otherwise it quietly completes the build without building the examples, which is a bit surprising
• maybe use Ninja instead of GNU Make if we want to encourage that
• There is a fair number of legit warnings when you build the C++ example. Consider adding -Werror to the default clang flags
• make sure the binaries and python scripts correctly process --help flag and output useful info
• make conv example consistent with gemm
• for the functionality you don't want to be broken by changes in CK APIs, add building and testing to the CI
• at least all instructions in READMEs need to be manually verified

[tenpercent]

I think some time around rocm 6.4 we were encouraged to switch from hipcc to clang bundled with the ROCm distribution

[tenpercent]

make sure this is consistent with the examples. I think currently the printed messages are about gfx11

[vidyasagar-amd]

added gfx11

[tenpercent]

one more good practice to encourage - use uv venv for creating virtual environments and uv pip for the packages

[vidyasagar-amd]

added note