{ "id": "2011.03043", "version": "v1", "published": "2020-11-05T21:26:03.000Z", "updated": "2020-11-05T21:26:03.000Z", "title": "Identifying and interpreting tuning dimensions in deep networks", "authors": [ "Nolan S. Dey", "J. Eric Taylor", "Bryan P. Tripp", "Alexander Wong", "Graham W. Taylor" ], "comment": "14 pages, 12 figures, Shared Visual Representations in Human & Machine Intelligence NeurIPS Workshop 2020", "categories": [ "cs.LG", "cs.AI", "cs.CV" ], "abstract": "In neuroscience, a tuning dimension is a stimulus attribute that accounts for much of the activation variance of a group of neurons. These are commonly used to decipher the responses of such groups. While researchers have attempted to manually identify an analogue to these tuning dimensions in deep neural networks, we are unaware of an automatic way to discover them. This work contributes an unsupervised framework for identifying and interpreting \"tuning dimensions\" in deep networks. Our method correctly identifies the tuning dimensions of a synthetic Gabor filter bank and tuning dimensions of the first two layers of InceptionV1 trained on ImageNet.", "revisions": [ { "version": "v1", "updated": "2020-11-05T21:26:03.000Z" } ], "analyses": { "keywords": [ "deep networks", "interpreting tuning dimensions", "synthetic gabor filter bank", "deep neural networks", "activation variance" ], "note": { "typesetting": "TeX", "pages": 14, "language": "en", "license": "arXiv", "status": "editable" } } }