91°µÍø

In this seminar, we present an interpretable graph representation through a learning-based approach to predict if a model is worth training or not. We use an example of spiking neural network models for reinforcement learning in autonomous vehicle usage. Among variants of neural network models, spiking neural network models are widely used in neuromorphic computing and are more flexible than other variants of neural network models with respect to the connectivity between neurons, which makes them more suitable for a graph-based approach. In this study, we represent neural network models as graphs, use the Weisfeiler-Lehman graph kernel to map the graph-represented neural network in a vector space, and perform classification to classify graphs in the vector space. The advantages of our approach are: 1) interpretable -- able to identify influential motifs or substructure of neural network models to achieve the desired level of model performance; 2) intuitive -- able to perform visual and interactive analysis to organize the neural network model instances; and 3) task-independent -- able to flexibly choose downstream machine learning algorithms to further analyze model instances on top of their vector representation. In our evaluation with 5,000 spiking neural network models, we achieved 82% of testing accuracy to classify if an unseen model owns the potential to achieve the desired level of fitness score, based on the connectivity of neurons and their hyperparameters. This study shows a novel direction in interpreting black-box neural network models beyond traditional interpretability methods, such as feature importance analysis, allowing us to systematically compose new models beyond current neural architecture search and hyperparameter optimization techniques.