Enhanced Soups for Graph Neural Networks
Joseph Zuber, Aishwarya Sarkar, Joseph Jennings, Ali Jannesari
GrAPL @ IPDPS 2025
A gradient-based "souping" method that merges independently trained GNNs into a single model, reducing training memory by 76% and achieving a 24.5× speedup with a 1.2% accuracy improvement on OGB benchmarks.
Mixing weights α are learned on validation data instead of grid-searched; the partitioned variant soups parameter slices to scale to large graphs (ogbn-products, GraphSAGE).