February 17, 2024
Conference Paper

Comparing Mapper Graphs of Artificial Neuron Activations

Abstract

The mapper graph is a popular tool from topological data analysis that provides a graphical summary of point cloud data. It has been used to study data from cancer research, sports analytics, neurosciences, and machine learning. In particular, mapper graphs have been used recently to visualize the topology of high-dimensional artificial neural activations from convolutional neural networks and large language models. However, a key question that arises from using mapper graphs across applications is how to compare mapper graphs to study their structural differences. In this paper, we introduce a distance between mapper graphs using tools from optimal transport. We demonstrate the utility of such a distance by studying the topological changes of neural activations across convolutional layers in deep learning, as well as by capturing the loss of structural information for multiscale mapper.

Published: February 17, 2024

Citation

Zhou Y., H. Jenne, D.R. Brown, M.R. Shapiro, B.A. Jefferson, C.A. Joslyn, and G. Roek, et al. 2023. Comparing Mapper Graphs of Artificial Neuron Activations. In Topological Data Analysis and Visualization (TopoInVis 2023), October 22-23, 2023, Melbourne, Australia, 41-50. Los Alamitos, California:IEEE Computer Society. PNNL-SA-186740. doi:10.1109/TopoInVis60193.2023.00011