Track: Track1; Team name: howyadoin; Model: Neural Sheaf Propagation#326
Open
lapry34 wants to merge 3 commits into
Open
Track: Track1; Team name: howyadoin; Model: Neural Sheaf Propagation#326lapry34 wants to merge 3 commits into
lapry34 wants to merge 3 commits into
Conversation
|
Check out this pull request on See visual diffs & provide feedback on Jupyter Notebooks. Powered by ReviewNB |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Track
Track 1 — Graph Neural Networks (GNNs)
Team Name
howyadoin
Model
Neural Sheaf Propagation (NSP)
Status
Ready for review
Summary
Track
Track 1 — Graph Neural Networks (GNNs)
Team Name
howyadoin
Model
Neural Sheaf Propagation (NSP)
Status
Ready for review
Summary
This PR contributes a TopoBench-native implementation of Neural Sheaf Propagation (NSP), a generalization of GNNs to cellular sheaves inspired by "Neural Sheaf Diffusion" (Bodnar et al., 2022) and "Surfing on the Neural Sheaf" (Suk et al., 2024). NSP learns representations by propagating signals over a learned sheaf structure where each edge carries a
d x drestriction map (diagonal, orthogonal, or general). The model employs a second-order discrete propagation scheme that generalizes standard GNN updates to the sheaf-theoretic setting.The implementation reuses the
nsd_utilsecosystem for sheaf learning, orthogonal parameterization, and Laplacian construction. It introduces three new inductive propagation models (diag, bundle, and general) and a dedicatedNSPEncoderwrapper that plugs into the TopoBench pipeline. The bundle variant with orthogonal restriction maps and normalized Laplacians is the default configuration, ensuring stable and expressive transport of signals across the graph.Implementation
topobench/nn/backbones/graph/nsd_utils/inductive_discrete_propagation_models.py).NSPEncoderwrapper integrated into the TBModel pipeline, providing a consistent API for graph and node-level tasks (topobench/nn/backbones/graph/nsp.py).configs/model/graph/nsp.yaml) with paper-faithful defaults and support for hyperparameter sweeps (sheaf_type=bundle,d=3,num_layers=2).graph/nspadded to the end-to-end pipeline tests intest/pipeline/test_pipeline.py.2026_tdl_challenge/run_evaluation.ipynb) verified with NSP across the GraphUniverse benchmark, with results included in the challenge submission.Reference
Bodnar, Di Giovanni, Chamberlain, Liò, Bronstein, "Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNs," NeurIPS 2022.
Suk, Giusti, Hemo, Lopez, Barmpas, Bodnar, "Surfing on the Neural Sheaf" NeurIPS Workshop on Symmetry and Geometry in Neural Representations 2022.