arXiv Analytics

Sign in

arXiv:2106.05710 [stat.ML]AbstractReferencesReviewsResources

DNN-Based Topology Optimisation: Spatial Invariance and Neural Tangent Kernel

Benjamin Dupuis, Arthur Jacot

Published 2021-06-10Version 1

We study the SIMP method with a density field generated by a fully-connected neural network, taking the coordinates as inputs. In the large width limit, we show that the use of DNNs leads to a filtering effect similar to traditional filtering techniques for SIMP, with a filter described by the Neural Tangent Kernel (NTK). This filter is however not invariant under translation, leading to visual artifacts and non-optimal shapes. We propose two embeddings of the input coordinates, which lead to (approximate) spatial invariance of the NTK and of the filter. We empirically confirm our theoretical observations and study how the filter size is affected by the architecture of the network. Our solution can easily be applied to any other coordinates-based generation method.

Related articles: Most relevant | Search more
arXiv:1905.12173 [stat.ML] (Published 2019-05-29)
On the Inductive Bias of Neural Tangent Kernels
arXiv:2005.11879 [stat.ML] (Published 2020-05-25)
Spectra of the Conjugate Kernel and Neural Tangent Kernel for linear-width neural networks
arXiv:2007.05864 [stat.ML] (Published 2020-07-11)
Bayesian Deep Ensembles via the Neural Tangent Kernel