Sinteza novih pogleda na predmet iz dvodimenzionalnih slika korištenjem neuronskih mreža

master's thesis

• Title (english): Generating new perspectives of an object from two-dimensional images using neural networks
• Author: Iva Hrastnik
• Mentor: Matko Orsag (mentor)
• Committee member: Matko Orsag (član povjerenstva)
• Committee member: Tamara Petrović (član povjerenstva)
• Committee member: Frano Petric (član povjerenstva)
• Granter: University of Zagreb; Faculty of Electrical Engineering and Computing; Zagreb
• Defense date and country: 2024-02-27, Croatia

Abstract

Provedeno je istraživanje Neural Radiance Fields metode i pixelNeRF okvira za učenje
koji korištenjem neuronskih mreža provodi sintezu novih pogleda na predmet iz jedne
ili nekoliko ulaznih slika. Korišten je PixelNeRF model treniran na ShapeNet skupu slika
automobila prilagođen ulazu stvarnih fotografija automobila. Provedeno je testiranje
modela s jednom do nekoliko ulaznih slika koristeći fotografije različitih automobila, kao
i sintetički generiran skup slika. Kvaliteta novih pogleda na predmet očekivano raste s
povećanjem broja ulaznih slika automobila, no već odlične rezultate prezentira i sinteza
pogleda iz dvije te četiri ulazne fotografije.

Abstract (english)

Research was conducted on the Neural Radiance Fields method and the pixelNeRF
learning framework, which uses neural networks to synthesize new views of the subject
using one or several input images. A PixelNeRF model trained on a ShapeNet set of car
images and adapted to the input of real car photos was used. The model was tested with
one to several input images using photos of different cars as well as a synthetically generated
set of images. As expected, the quality of new views of the subject increases with
the number of input car images, but excellent results are also presented by the synthesis
of views from only two or four input photos.

• Keywords: Neuronska polja zračenja; NeRF; PixelNeRF; Neuronska mreža; Sinteza novih pogleda; Računalni vid; Pozicija kamere; 3D rekonstrukcija; Osvjetljenje; 3D Model; Rezolucija slike
• Keywords (english): Neural radiance fields; NeRF; PixelNeRF; Neural network; Synthesis of new views; Computer vision; Camera pose; 3D reconstruction; Illumination; 3D Model; Image resolution
• Language: croatian
• URN:NBN: urn:nbn:hr:168:677019
• Study programme: Title: Information and Communication Technology; Study programme type: university; Study level: graduate; Academic / professional title: magistar/magistra inženjer/inženjerka informacijske i komunikacijske tehnologije (magistar/magistra inženjer/inženjerka informacijske i komunikacijske tehnologije)
• Type of resource: Text
• File origin: Born digital
• Access conditions: Open access
• Created on: 2024-03-28 07:47:14