<> <http://www.w3.org/2000/01/rdf-schema#comment> "The repository administrator has not yet configured an RDF license."^^<http://www.w3.org/2001/XMLSchema#string> . <> <http://xmlns.com/foaf/0.1/primaryTopic> <https://discovery.ucl.ac.uk/id/eprint/10192916> . <https://discovery.ucl.ac.uk/id/eprint/10192916> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://purl.org/ontology/bibo/Thesis> . <https://discovery.ucl.ac.uk/id/eprint/10192916> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://purl.org/ontology/bibo/Article> . <https://discovery.ucl.ac.uk/id/eprint/10192916> <http://purl.org/dc/terms/title> "Learned Reconstruction and Generation of Face Images Built with Computer Graphics Scaffolding"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/eprint/10192916> <http://purl.org/ontology/bibo/abstract> "Generating a photorealistic, faithful, animated likeness of the human face is a challenging problem in computer vision. We explore different ways in which concepts from computer graphics can be combined with machine learning and optimisation approaches to reduce the amount of real image data required for this task. In contrast to other work idealistic about the availability of training data, labelling effort, or privacy implications, we focus on practical applications. This leads us to discover several surprising synergies between computer graphics, machine learning, and optimisation. We find that low fidelity renders of faces can be used to increase the diversity of samples from generative models, that raytracing hardware can be repurposed to accelerate Neural Radiance Fields in terms of empty-space skipping as well as animation, and that traditional morphable models of the face can be extended to the 3D volumetric case. Specific regions of the face are often challenging in isolation. We first build a dataset of the human eye, demonstrating issues of working with real data. This motivates our aim of using as little real image data as possible. Focusing on our main goal, we develop a zero-shot appearance transfer model capable of increasing the realism of low fidelity renders. This reduces the required enrolment data for creating a digital likeness to a single image at the expensive of training a generative model on a moderately-sized corpus of data. Reducing the need for training data even further, and to obtain 3D consistency at interactive framerates, we subsequently develop a real-time rendering approach inspired by optimisations in classical volume rendering such as empty space skipping and ray tracing. This approach is completed by a fast and generalisable deformation model built on the principles of finite elements. Using explicit tetrahedral geometry affords us fine-grained and interpretable control over deformation. Put together, these advances enable us to generate 3D consistent, animated scenes of human faces from limited data"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/eprint/10192916> <http://purl.org/dc/terms/date> "2024-05-28" . <https://discovery.ucl.ac.uk/id/document/1748437> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://purl.org/ontology/bibo/Document> . <https://discovery.ucl.ac.uk/id/org/ext-a64c3df5861c6582807add1abaadf2af> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://xmlns.com/foaf/0.1/Organization> . <https://discovery.ucl.ac.uk/id/org/ext-a64c3df5861c6582807add1abaadf2af> <http://xmlns.com/foaf/0.1/name> "UCL (University College London)"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/eprint/10192916> <http://purl.org/dc/terms/issuer> <https://discovery.ucl.ac.uk/id/org/ext-a64c3df5861c6582807add1abaadf2af> . <https://discovery.ucl.ac.uk/id/org/ext-8f7ed5b3450912d77936e05323506a1f> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://xmlns.com/foaf/0.1/Organization> . <https://discovery.ucl.ac.uk/id/org/ext-8f7ed5b3450912d77936e05323506a1f> <http://xmlns.com/foaf/0.1/name> "Computer Science, UCL (University College London)"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/org/ext-8f7ed5b3450912d77936e05323506a1f> <http://purl.org/dc/terms/isPartOf> <https://discovery.ucl.ac.uk/id/org/ext-a64c3df5861c6582807add1abaadf2af> . <https://discovery.ucl.ac.uk/id/eprint/10192916> <http://purl.org/dc/terms/issuer> <https://discovery.ucl.ac.uk/id/org/ext-8f7ed5b3450912d77936e05323506a1f> . <https://discovery.ucl.ac.uk/id/org/ext-a64c3df5861c6582807add1abaadf2af> <http://purl.org/dc/terms/hasPart> <https://discovery.ucl.ac.uk/id/org/ext-8f7ed5b3450912d77936e05323506a1f> . <https://discovery.ucl.ac.uk/id/eprint/10192916> <http://purl.org/ontology/bibo/status> <http://purl.org/ontology/bibo/status/unpublished> . <https://discovery.ucl.ac.uk/id/eprint/10192916> <http://purl.org/dc/terms/creator> <https://discovery.ucl.ac.uk/id/person/ext-4cbd38d444d7ecec35bb625de09036e6> . <https://discovery.ucl.ac.uk/id/eprint/10192916> <http://purl.org/ontology/bibo/authorList> <https://discovery.ucl.ac.uk/id/eprint/10192916#authors> . <https://discovery.ucl.ac.uk/id/eprint/10192916#authors> <http://www.w3.org/1999/02/22-rdf-syntax-ns#_1> <https://discovery.ucl.ac.uk/id/person/ext-4cbd38d444d7ecec35bb625de09036e6> . <https://discovery.ucl.ac.uk/id/person/ext-4cbd38d444d7ecec35bb625de09036e6> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://xmlns.com/foaf/0.1/Person> . <https://discovery.ucl.ac.uk/id/person/ext-4cbd38d444d7ecec35bb625de09036e6> <http://xmlns.com/foaf/0.1/givenName> "Stephan Joachim"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/person/ext-4cbd38d444d7ecec35bb625de09036e6> <http://xmlns.com/foaf/0.1/familyName> "Garbin"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/person/ext-4cbd38d444d7ecec35bb625de09036e6> <http://xmlns.com/foaf/0.1/name> "Stephan Joachim Garbin"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/eprint/10192916> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://eprints.org/ontology/EPrint> . <https://discovery.ucl.ac.uk/id/eprint/10192916> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://eprints.org/ontology/ThesisEPrint> . <https://discovery.ucl.ac.uk/id/eprint/10192916> <http://purl.org/dc/terms/isPartOf> <https://discovery.ucl.ac.uk/id/repository> . <https://discovery.ucl.ac.uk/id/eprint/10192916> <http://eprints.org/ontology/hasDocument> <https://discovery.ucl.ac.uk/id/document/1748437> . <https://discovery.ucl.ac.uk/id/document/1748437> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://eprints.org/ontology/Document> . <https://discovery.ucl.ac.uk/id/document/1748437> <http://www.w3.org/2000/01/rdf-schema#label> "Learned Reconstruction and Generation of Face Images Built with Computer Graphics Scaffolding (Text)"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/document/1748437> <http://eprints.org/ontology/hasFile> <https://discovery.ucl.ac.uk/id/eprint/10192916/7/Garbin_10192916_Thesis.pdf> . <https://discovery.ucl.ac.uk/id/document/1748437> <http://purl.org/dc/terms/hasPart> <https://discovery.ucl.ac.uk/id/eprint/10192916/7/Garbin_10192916_Thesis.pdf> . <https://discovery.ucl.ac.uk/id/eprint/10192916/7/Garbin_10192916_Thesis.pdf> <http://www.w3.org/2000/01/rdf-schema#label> "Garbin_10192916_Thesis.pdf"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/eprint/10192916> <http://eprints.org/ontology/hasDocument> <https://discovery.ucl.ac.uk/id/document/1748438> . <https://discovery.ucl.ac.uk/id/document/1748438> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://eprints.org/ontology/Document> . <https://discovery.ucl.ac.uk/id/document/1748438> <http://www.w3.org/2000/01/rdf-schema#label> "Learned Reconstruction and Generation of Face Images Built with Computer Graphics Scaffolding (Other)"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/document/1748438> <http://eprints.org/relation/isVersionOf> <https://discovery.ucl.ac.uk/id/document/1748437> . <https://discovery.ucl.ac.uk/id/document/1748438> <http://eprints.org/relation/isVolatileVersionOf> <https://discovery.ucl.ac.uk/id/document/1748437> . <https://discovery.ucl.ac.uk/id/document/1748438> <http://eprints.org/relation/isIndexCodesVersionOf> <https://discovery.ucl.ac.uk/id/document/1748437> . <https://discovery.ucl.ac.uk/id/eprint/10192916> <http://eprints.org/ontology/hasDocument> <https://discovery.ucl.ac.uk/id/document/1748439> . <https://discovery.ucl.ac.uk/id/document/1748439> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://eprints.org/ontology/Document> . <https://discovery.ucl.ac.uk/id/document/1748439> <http://www.w3.org/2000/01/rdf-schema#label> "Learned Reconstruction and Generation of Face Images Built with Computer Graphics Scaffolding (Other)"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/document/1748439> <http://eprints.org/relation/isVersionOf> <https://discovery.ucl.ac.uk/id/document/1748437> . <https://discovery.ucl.ac.uk/id/document/1748439> <http://eprints.org/relation/isVolatileVersionOf> <https://discovery.ucl.ac.uk/id/document/1748437> . <https://discovery.ucl.ac.uk/id/document/1748439> <http://eprints.org/relation/islightboxThumbnailVersionOf> <https://discovery.ucl.ac.uk/id/document/1748437> . <https://discovery.ucl.ac.uk/id/eprint/10192916> <http://eprints.org/ontology/hasDocument> <https://discovery.ucl.ac.uk/id/document/1748440> . <https://discovery.ucl.ac.uk/id/document/1748440> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://eprints.org/ontology/Document> . <https://discovery.ucl.ac.uk/id/document/1748440> <http://www.w3.org/2000/01/rdf-schema#label> "Learned Reconstruction and Generation of Face Images Built with Computer Graphics Scaffolding (Other)"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/document/1748440> <http://eprints.org/relation/isVersionOf> <https://discovery.ucl.ac.uk/id/document/1748437> . <https://discovery.ucl.ac.uk/id/document/1748440> <http://eprints.org/relation/isVolatileVersionOf> <https://discovery.ucl.ac.uk/id/document/1748437> . <https://discovery.ucl.ac.uk/id/document/1748440> <http://eprints.org/relation/ispreviewThumbnailVersionOf> <https://discovery.ucl.ac.uk/id/document/1748437> . <https://discovery.ucl.ac.uk/id/eprint/10192916> <http://eprints.org/ontology/hasDocument> <https://discovery.ucl.ac.uk/id/document/1748441> . <https://discovery.ucl.ac.uk/id/document/1748441> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://eprints.org/ontology/Document> . <https://discovery.ucl.ac.uk/id/document/1748441> <http://www.w3.org/2000/01/rdf-schema#label> "Learned Reconstruction and Generation of Face Images Built with Computer Graphics Scaffolding (Other)"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/document/1748441> <http://eprints.org/relation/isVersionOf> <https://discovery.ucl.ac.uk/id/document/1748437> . <https://discovery.ucl.ac.uk/id/document/1748441> <http://eprints.org/relation/isVolatileVersionOf> <https://discovery.ucl.ac.uk/id/document/1748437> . <https://discovery.ucl.ac.uk/id/document/1748441> <http://eprints.org/relation/ismediumThumbnailVersionOf> <https://discovery.ucl.ac.uk/id/document/1748437> . <https://discovery.ucl.ac.uk/id/eprint/10192916> <http://eprints.org/ontology/hasDocument> <https://discovery.ucl.ac.uk/id/document/1748442> . <https://discovery.ucl.ac.uk/id/document/1748442> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://eprints.org/ontology/Document> . <https://discovery.ucl.ac.uk/id/document/1748442> <http://www.w3.org/2000/01/rdf-schema#label> "Learned Reconstruction and Generation of Face Images Built with Computer Graphics Scaffolding (Other)"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/document/1748442> <http://eprints.org/relation/isVersionOf> <https://discovery.ucl.ac.uk/id/document/1748437> . <https://discovery.ucl.ac.uk/id/document/1748442> <http://eprints.org/relation/isVolatileVersionOf> <https://discovery.ucl.ac.uk/id/document/1748437> . <https://discovery.ucl.ac.uk/id/document/1748442> <http://eprints.org/relation/issmallThumbnailVersionOf> <https://discovery.ucl.ac.uk/id/document/1748437> . <https://discovery.ucl.ac.uk/id/eprint/10192916> <http://www.w3.org/2000/01/rdf-schema#seeAlso> <https://discovery.ucl.ac.uk/id/eprint/10192916/> . <https://discovery.ucl.ac.uk/id/eprint/10192916/> <http://purl.org/dc/elements/1.1/title> "HTML Summary of #10192916 \n\nLearned Reconstruction and Generation of Face Images Built with Computer Graphics Scaffolding\n\n" . <https://discovery.ucl.ac.uk/id/eprint/10192916/> <http://purl.org/dc/elements/1.1/format> "text/html" . <https://discovery.ucl.ac.uk/id/eprint/10192916/> <http://xmlns.com/foaf/0.1/primaryTopic> <https://discovery.ucl.ac.uk/id/eprint/10192916> .