Image Representations in Deep Neural Networks and their Applications to Neural Data Modelling

DSpace Repository

Show simple item record

dc.contributor.advisor Bethge, Matthias (Prof. Dr.) Ustyuzhaninov, Ivan 2022-12-19T10:47:43Z 2022-12-19T10:47:43Z 2022-12-19
dc.identifier.uri de_DE
dc.description.abstract Over the last decade, deep neural networks (DNNs) have become a standard tool in computer vision, allowing us to tackle a variety of problems from classifying objects in natural images to generating new images to predicting brain activity. Such a wide applicability of DNNs is something that these models have in common with the human vision, and exploring some of these similarities is the goal of this thesis. DNNs much like human vision are hierarchical models that process an input scene with a series of sequential computations. It has been shown that typically only a few final computations in this hierarchy are problem-specific, while the rest of them are quite general and applicable to a number of problems. The results of intermediate computations in the DNN are often referred to as image representations and their generality is another similarity to human vision which also has general visual areas (e.g. primary visual cortex) projecting further to the specialised ones solving specific visual tasks. We focus on studying DNN image representations with the goal of understanding what makes them so useful for a variety of visual problems. To do so, we discuss DNNs solving a number of specific computer vision problems and analyse similarities and differences of their image representations. Moreover, we discuss how to build DNNs providing image representations with specific properties which enables us to build a "digital twin" of the mouse primary visual system to be used as a tool for studying the computations in the brain. Taking these results together, we concluded that in general we are still lacking a good understanding of DNN representations. Despite the progress on some specific problems, it still remains largely an open question how the image information is organised in these representations and how to use it for solving arbitrary visual problems. However, we also argue that thinking of DNNs as "digital twins" might be a promising framework for addressing these issues in the future DNN research as they allow us to study image representations by means of computational experiments rather than rely on a priori ideas of how these representations are structured which has proven to be quite challenging. en
dc.language.iso en de_DE
dc.publisher Universität Tübingen de_DE
dc.rights ubt-podok de_DE
dc.rights.uri de_DE
dc.rights.uri en
dc.subject.classification Maschinelles Lernen , Neurowissenschaften , Neuronales Netz de_DE
dc.subject.ddc 004 de_DE
dc.subject.ddc 570 de_DE
dc.subject.other Machine Learning en
dc.subject.other Deep Learning en
dc.subject.other Representation Learning en
dc.subject.other Neural Information Processing en
dc.title Image Representations in Deep Neural Networks and their Applications to Neural Data Modelling en
dc.type PhDThesis de_DE
dcterms.dateAccepted 2022-12-01
utue.publikation.fachbereich Informatik de_DE
utue.publikation.fakultaet 7 Mathematisch-Naturwissenschaftliche Fakultät de_DE
utue.publikation.noppn yes de_DE


This item appears in the following Collection(s)

Show simple item record