<> <http://www.w3.org/2000/01/rdf-schema#comment> "The repository administrator has not yet configured an RDF license."^^<http://www.w3.org/2001/XMLSchema#string> . <> <http://xmlns.com/foaf/0.1/primaryTopic> <https://discovery.ucl.ac.uk/id/eprint/1561645> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://purl.org/ontology/bibo/AcademicArticle> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://purl.org/ontology/bibo/Article> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://purl.org/dc/terms/title> "Robust Large Margin Deep Neural Networks"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://purl.org/ontology/bibo/abstract> "The generalization error of deep neural networks via their classification margin is studied in this paper. Our approach is based on the Jacobian matrix of a deep neural network and can be applied to networks with arbitrary nonlinearities and pooling layers, and to networks with different architectures such as feed forward networks and residual networks. Our analysis leads to the conclusion that a bounded spectral norm of the network's Jacobian matrix in the neighbourhood of the training samples is crucial for a deep neural network of arbitrary depth and width to generalize well. This is a significant improvement over the current bounds in the literature, which imply that the generalization error grows with either the width or the depth of the network. Moreover, it shows that the recently proposed batch normalization and weight normalization reparametrizations enjoy good generalization properties, and leads to a novel network regularizer based on the network's Jacobian matrix. The analysis is supported with experimental results on the MNIST, CIFAR-10, LaRED, and ImageNet datasets."^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://purl.org/dc/terms/date> "2017-08-15" . <https://discovery.ucl.ac.uk/id/document/510822> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://purl.org/ontology/bibo/Document> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://purl.org/ontology/bibo/volume> "65" . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://purl.org/ontology/bibo/issue> "16" . <https://discovery.ucl.ac.uk/id/org/ext-4c94d0aceeb2a95adfe4f5c34c9a49c3> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://xmlns.com/foaf/0.1/Organization> . <https://discovery.ucl.ac.uk/id/org/ext-4c94d0aceeb2a95adfe4f5c34c9a49c3> <http://xmlns.com/foaf/0.1/name> "IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://purl.org/dc/terms/publisher> <https://discovery.ucl.ac.uk/id/org/ext-4c94d0aceeb2a95adfe4f5c34c9a49c3> . <https://discovery.ucl.ac.uk/id/publication/ext-19410476> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://purl.org/ontology/bibo/Collection> . <https://discovery.ucl.ac.uk/id/publication/ext-19410476> <http://xmlns.com/foaf/0.1/name> "IEEE Transactions on Signal Processing"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://purl.org/dc/terms/isPartOf> <https://discovery.ucl.ac.uk/id/publication/ext-19410476> . <https://discovery.ucl.ac.uk/id/publication/ext-19410476> <http://www.w3.org/2002/07/owl#sameAs> <urn:issn:19410476> . <https://discovery.ucl.ac.uk/id/publication/ext-19410476> <http://purl.org/ontology/bibo/issn> "19410476" . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://purl.org/ontology/bibo/status> <http://purl.org/ontology/bibo/status/published> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://purl.org/dc/terms/creator> <https://discovery.ucl.ac.uk/id/person/ext-7ab5aa08f32404079a3b55abc76239b9> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://purl.org/ontology/bibo/authorList> <https://discovery.ucl.ac.uk/id/eprint/1561645#authors> . <https://discovery.ucl.ac.uk/id/eprint/1561645#authors> <http://www.w3.org/1999/02/22-rdf-syntax-ns#_1> <https://discovery.ucl.ac.uk/id/person/ext-7ab5aa08f32404079a3b55abc76239b9> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://purl.org/dc/terms/creator> <https://discovery.ucl.ac.uk/id/person/ext-6071904bab50177d9b5402dbd3749bcf> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://purl.org/ontology/bibo/authorList> <https://discovery.ucl.ac.uk/id/eprint/1561645#authors> . <https://discovery.ucl.ac.uk/id/eprint/1561645#authors> <http://www.w3.org/1999/02/22-rdf-syntax-ns#_2> <https://discovery.ucl.ac.uk/id/person/ext-6071904bab50177d9b5402dbd3749bcf> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://purl.org/dc/terms/creator> <https://discovery.ucl.ac.uk/id/person/ext-80afc46cf4c5247b3cc1f3c2c28e3e1a> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://purl.org/ontology/bibo/authorList> <https://discovery.ucl.ac.uk/id/eprint/1561645#authors> . <https://discovery.ucl.ac.uk/id/eprint/1561645#authors> <http://www.w3.org/1999/02/22-rdf-syntax-ns#_3> <https://discovery.ucl.ac.uk/id/person/ext-80afc46cf4c5247b3cc1f3c2c28e3e1a> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://purl.org/dc/terms/creator> <https://discovery.ucl.ac.uk/id/person/ext-9a84bd349ff089e24f63dd8c15a26e2c> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://purl.org/ontology/bibo/authorList> <https://discovery.ucl.ac.uk/id/eprint/1561645#authors> . <https://discovery.ucl.ac.uk/id/eprint/1561645#authors> <http://www.w3.org/1999/02/22-rdf-syntax-ns#_4> <https://discovery.ucl.ac.uk/id/person/ext-9a84bd349ff089e24f63dd8c15a26e2c> . <https://discovery.ucl.ac.uk/id/person/ext-80afc46cf4c5247b3cc1f3c2c28e3e1a> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://xmlns.com/foaf/0.1/Person> . <https://discovery.ucl.ac.uk/id/person/ext-80afc46cf4c5247b3cc1f3c2c28e3e1a> <http://xmlns.com/foaf/0.1/givenName> "G"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/person/ext-80afc46cf4c5247b3cc1f3c2c28e3e1a> <http://xmlns.com/foaf/0.1/familyName> "Sapiro"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/person/ext-80afc46cf4c5247b3cc1f3c2c28e3e1a> <http://xmlns.com/foaf/0.1/name> "G Sapiro"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/person/ext-6071904bab50177d9b5402dbd3749bcf> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://xmlns.com/foaf/0.1/Person> . <https://discovery.ucl.ac.uk/id/person/ext-6071904bab50177d9b5402dbd3749bcf> <http://xmlns.com/foaf/0.1/givenName> "R"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/person/ext-6071904bab50177d9b5402dbd3749bcf> <http://xmlns.com/foaf/0.1/familyName> "Giryes"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/person/ext-6071904bab50177d9b5402dbd3749bcf> <http://xmlns.com/foaf/0.1/name> "R Giryes"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/person/ext-9a84bd349ff089e24f63dd8c15a26e2c> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://xmlns.com/foaf/0.1/Person> . <https://discovery.ucl.ac.uk/id/person/ext-9a84bd349ff089e24f63dd8c15a26e2c> <http://xmlns.com/foaf/0.1/givenName> "MRD"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/person/ext-9a84bd349ff089e24f63dd8c15a26e2c> <http://xmlns.com/foaf/0.1/familyName> "Rodrigues"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/person/ext-9a84bd349ff089e24f63dd8c15a26e2c> <http://xmlns.com/foaf/0.1/name> "MRD Rodrigues"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/person/ext-7ab5aa08f32404079a3b55abc76239b9> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://xmlns.com/foaf/0.1/Person> . <https://discovery.ucl.ac.uk/id/person/ext-7ab5aa08f32404079a3b55abc76239b9> <http://xmlns.com/foaf/0.1/givenName> "J"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/person/ext-7ab5aa08f32404079a3b55abc76239b9> <http://xmlns.com/foaf/0.1/familyName> "Sokolic"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/person/ext-7ab5aa08f32404079a3b55abc76239b9> <http://xmlns.com/foaf/0.1/name> "J Sokolic"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://eprints.org/ontology/EPrint> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://eprints.org/ontology/ArticleEPrint> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://purl.org/dc/terms/isPartOf> <https://discovery.ucl.ac.uk/id/repository> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://eprints.org/ontology/hasDocument> <https://discovery.ucl.ac.uk/id/document/510822> . <https://discovery.ucl.ac.uk/id/document/510822> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://eprints.org/ontology/Document> . <https://discovery.ucl.ac.uk/id/document/510822> <http://www.w3.org/2000/01/rdf-schema#label> "Robust Large Margin Deep Neural Networks (Text)"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://purl.org/dc/elements/1.1/hasVersion> <https://discovery.ucl.ac.uk/id/document/510822> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://eprints.org/ontology/hasPublished> <https://discovery.ucl.ac.uk/id/document/510822> . <https://discovery.ucl.ac.uk/id/document/510822> <http://eprints.org/ontology/hasFile> <https://discovery.ucl.ac.uk/id/eprint/1561645/1/Rodrigues_07934087.pdf> . <https://discovery.ucl.ac.uk/id/document/510822> <http://purl.org/dc/terms/hasPart> <https://discovery.ucl.ac.uk/id/eprint/1561645/1/Rodrigues_07934087.pdf> . <https://discovery.ucl.ac.uk/id/eprint/1561645/1/Rodrigues_07934087.pdf> <http://www.w3.org/2000/01/rdf-schema#label> "Rodrigues_07934087.pdf"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://eprints.org/ontology/hasDocument> <https://discovery.ucl.ac.uk/id/document/510823> . <https://discovery.ucl.ac.uk/id/document/510823> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://eprints.org/ontology/Document> . <https://discovery.ucl.ac.uk/id/document/510823> <http://www.w3.org/2000/01/rdf-schema#label> "Robust Large Margin Deep Neural Networks (Other)"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/document/510823> <http://eprints.org/relation/isVersionOf> <https://discovery.ucl.ac.uk/id/document/510822> . <https://discovery.ucl.ac.uk/id/document/510823> <http://eprints.org/relation/isVolatileVersionOf> <https://discovery.ucl.ac.uk/id/document/510822> . <https://discovery.ucl.ac.uk/id/document/510823> <http://eprints.org/relation/islightboxThumbnailVersionOf> <https://discovery.ucl.ac.uk/id/document/510822> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://eprints.org/ontology/hasDocument> <https://discovery.ucl.ac.uk/id/document/510824> . <https://discovery.ucl.ac.uk/id/document/510824> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://eprints.org/ontology/Document> . <https://discovery.ucl.ac.uk/id/document/510824> <http://www.w3.org/2000/01/rdf-schema#label> "Robust Large Margin Deep Neural Networks (Other)"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/document/510824> <http://eprints.org/relation/isVersionOf> <https://discovery.ucl.ac.uk/id/document/510822> . <https://discovery.ucl.ac.uk/id/document/510824> <http://eprints.org/relation/isVolatileVersionOf> <https://discovery.ucl.ac.uk/id/document/510822> . <https://discovery.ucl.ac.uk/id/document/510824> <http://eprints.org/relation/ispreviewThumbnailVersionOf> <https://discovery.ucl.ac.uk/id/document/510822> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://eprints.org/ontology/hasDocument> <https://discovery.ucl.ac.uk/id/document/510825> . <https://discovery.ucl.ac.uk/id/document/510825> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://eprints.org/ontology/Document> . <https://discovery.ucl.ac.uk/id/document/510825> <http://www.w3.org/2000/01/rdf-schema#label> "Robust Large Margin Deep Neural Networks (Other)"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/document/510825> <http://eprints.org/relation/isVersionOf> <https://discovery.ucl.ac.uk/id/document/510822> . <https://discovery.ucl.ac.uk/id/document/510825> <http://eprints.org/relation/isVolatileVersionOf> <https://discovery.ucl.ac.uk/id/document/510822> . <https://discovery.ucl.ac.uk/id/document/510825> <http://eprints.org/relation/ismediumThumbnailVersionOf> <https://discovery.ucl.ac.uk/id/document/510822> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://eprints.org/ontology/hasDocument> <https://discovery.ucl.ac.uk/id/document/510826> . <https://discovery.ucl.ac.uk/id/document/510826> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://eprints.org/ontology/Document> . <https://discovery.ucl.ac.uk/id/document/510826> <http://www.w3.org/2000/01/rdf-schema#label> "Robust Large Margin Deep Neural Networks (Other)"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/document/510826> <http://eprints.org/relation/isVersionOf> <https://discovery.ucl.ac.uk/id/document/510822> . <https://discovery.ucl.ac.uk/id/document/510826> <http://eprints.org/relation/isVolatileVersionOf> <https://discovery.ucl.ac.uk/id/document/510822> . <https://discovery.ucl.ac.uk/id/document/510826> <http://eprints.org/relation/issmallThumbnailVersionOf> <https://discovery.ucl.ac.uk/id/document/510822> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://eprints.org/ontology/hasDocument> <https://discovery.ucl.ac.uk/id/document/510833> . <https://discovery.ucl.ac.uk/id/document/510833> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://eprints.org/ontology/Document> . <https://discovery.ucl.ac.uk/id/document/510833> <http://www.w3.org/2000/01/rdf-schema#label> "Robust Large Margin Deep Neural Networks (Other)"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/document/510833> <http://eprints.org/relation/isVersionOf> <https://discovery.ucl.ac.uk/id/document/510822> . <https://discovery.ucl.ac.uk/id/document/510833> <http://eprints.org/relation/isVolatileVersionOf> <https://discovery.ucl.ac.uk/id/document/510822> . <https://discovery.ucl.ac.uk/id/document/510833> <http://eprints.org/relation/isIndexCodesVersionOf> <https://discovery.ucl.ac.uk/id/document/510822> . <https://discovery.ucl.ac.uk/id/document/510833> <http://eprints.org/ontology/hasFile> <https://discovery.ucl.ac.uk/id/eprint/1561645/6/indexcodes.txt> . <https://discovery.ucl.ac.uk/id/document/510833> <http://purl.org/dc/terms/hasPart> <https://discovery.ucl.ac.uk/id/eprint/1561645/6/indexcodes.txt> . <https://discovery.ucl.ac.uk/id/eprint/1561645/6/indexcodes.txt> <http://www.w3.org/2000/01/rdf-schema#label> "indexcodes.txt"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/eprint/1561645> <http://www.w3.org/2000/01/rdf-schema#seeAlso> <https://discovery.ucl.ac.uk/id/eprint/1561645/> . <https://discovery.ucl.ac.uk/id/eprint/1561645/> <http://purl.org/dc/elements/1.1/title> "HTML Summary of #1561645 \n\nRobust Large Margin Deep Neural Networks\n\n" . <https://discovery.ucl.ac.uk/id/eprint/1561645/> <http://purl.org/dc/elements/1.1/format> "text/html" . <https://discovery.ucl.ac.uk/id/eprint/1561645/> <http://xmlns.com/foaf/0.1/primaryTopic> <https://discovery.ucl.ac.uk/id/eprint/1561645> .