[R] Individual differences among deep neural network models

6 Steps to Create an Eye-Catching Instagram Aesthetic for Your Brand
January 11, 2020
Tim Ferriss: #403: Tony Fadell — On Building the iPod, iPhone, Nest, and a Life of Curiosity
January 11, 2020

[R] Individual differences among deep neural network models


Hi everyone,

we just posted a preprint in which we report and closely analyse differences in DNN representations that result from a minimal intervention: changing the random seed for the weights prior training. While the resulting network performances are more or less identical, the networks exhibit drastic differences in their internal representations (especially in intermediate and higher DNN layers).

https://www.biorxiv.org/content/10.1101/2020.01.08.898288v1

The tool we use for the analyses can also be used to investigate how representations change across layers, different networks, and learning trajectories. Our background is in computational neuroscience, but we hope that the technique and results will be of use to ML researchers, too.

I have written a short summary on twitter: https://twitter.com/TimKietzmann/status/1215620270679044096

submitted by /u/sigh_ence
[link] [comments]

Source

Leave a Reply

Your email address will not be published. Required fields are marked *