arXiv Analytics

Sign in

arXiv:2205.07050 [cs.IT]AbstractReferencesReviewsResources

Generalization error bounds for DECONET: a deep unfolded network for analysis Compressive Sensing

Vasiliki Kouni

Published 2022-05-14Version 1

In this paper, we propose a new deep unfolding neural network -- based on a state-of-the-art optimization algorithm -- for analysis Compressed Sensing. The proposed network called Decoding Network (DECONET) implements a decoder that reconstructs vectors from their incomplete, noisy measurements. Moreover, DECONET jointly learns a redundant analysis operator for sparsification, which is shared across the layers of DECONET. We study the generalization ability of DECONET. Towards that end, we first estimate the Rademacher complexity of the hypothesis class consisting of all the decoders that DECONET can implement. Then, we provide generalization error bounds, in terms of the aforementioned estimate. Finally, we present numerical experiments which confirm the validity of our theoretical results.

Related articles: Most relevant | Search more
arXiv:1912.01439 [cs.IT] (Published 2019-12-01)
Generalization Error Bounds Via Rényi-, $f$-Divergences and Maximal Leakage
arXiv:2004.09148 [cs.IT] (Published 2020-04-20)
Generalization Error Bounds via $m$th Central Moments of the Information Density
arXiv:2001.06399 [cs.IT] (Published 2020-01-14)
Robust Generalization via $α$-Mutual Information