arXiv Analytics

Sign in

arXiv:2409.10263 [cs.LG]AbstractReferencesReviewsResources

MDL-Pool: Adaptive Multilevel Graph Pooling Based on Minimum Description Length

Jan von Pichowski, Christopher Blöcker, Ingo Scholtes

Published 2024-09-16, updated 2025-05-14Version 2

Graph pooling compresses graphs and summarises their topological properties and features in a vectorial representation. It is an essential part of deep graph representation learning and is indispensable in graph-level tasks like classification or regression. Current approaches pool hierarchical structures in graphs by iteratively applying shallow pooling operators up to a fixed depth. However, they disregard the interdependencies between structures at different hierarchical levels and do not adapt to datasets that contain graphs with different sizes that may require pooling with various depths. To address these issues, we propose MDL-Pool, a pooling operator based on the minimum description length (MDL) principle, whose loss formulation explicitly models the interdependencies between different hierarchical levels and facilitates a direct comparison between multiple pooling alternatives with different depths. MDP-Pool builds on the map equation, an information-theoretic objective function for community detection, which naturally implements Occam's razor and balances between model complexity and goodness-of-fit via the MDL. We demonstrate MDL-Pool's competitive performance in an empirical evaluation against various baselines across standard graph classification datasets.

Related articles: Most relevant | Search more
arXiv:1906.09536 [cs.LG] (Published 2019-06-23)
Inferring Latent dimension of Linear Dynamical System with Minimum Description Length
arXiv:2206.06124 [cs.LG] (Published 2022-06-10)
Causal Discovery in Hawkes Processes by Minimum Description Length
arXiv:1005.2364 [cs.LG] (Published 2010-05-13, updated 2010-05-14)
A Short Introduction to Model Selection, Kolmogorov Complexity and Minimum Description Length (MDL)