Artify: prijenos stila slike u stvarnom vremenu s dubokim učenjem

master's thesis

• Title (english): Artify: Real-time Image Style Transfer with Deep Learning
• Author: Lovre Petešić
• Mentor: Marina Bagić Babac (mentor)
• Committee member: Marina Bagić Babac (predsjednik povjerenstva)
• Committee member: Mirjana Domazet-Lošo (član povjerenstva)
• Committee member: Marko Horvat (član povjerenstva)
• Granter: University of Zagreb; Faculty of Electrical Engineering and Computing; Zagreb
• Defense date and country: 2023-07-10, Croatia
• Scientific / art field, discipline and subdiscipline: TECHNICAL SCIENCES; Computing

Abstract

Implementirana su dva modela dubokog učenja, od kojih jedan nije uspio biti treniran jer je set za treniranje bio loše odabran. Iz dijelova propalog modela se pokazalo da se maska za isključivanje piksela može izvesti jednostavnije nego što je navedeno u proučenoj literaturi, uz cijenu dodatnog hiperparametra.Pokazalo se i da je TVR gubitak jako osjetljiv na hiperparametre te da je ispravan odabir podataka jedan od ključnih dijelova treniranja neuronskih mreža. Nad uspješnim modelom, modificirali su se parametri poput broja kanala, epoha treniranja i slično. Pokazalo se da je TVR manje potreban ako se ne koristi transponirana konvolucija, već interpolacija za uvećavanje rezolucije slike. Interpolacija sprječava pojavu šahovničkih uzoraka u pikselima pri uvećavanju slike.

Abstract (english)

Two deep learning models were implemented, of which one was unable to be properly trained because the training datased was poorly picked. From parts of the failed model, it was shown that the disocclusion mask can be calculated more easily than shown in researched literature, albeit at a cost of an extra hyperparameter- It was also shown that the TVR loss i svery sensitive to hiperparameters and that attention to correct dana collection and processing is one of the most important aspects of training any neural network. Over the successful model modifications were made like changing the channel size, epochs etc. It was shown that the TVR loss is less needed if one does not use transposed convolution, but interpolation upscaling instead. Interpolation prevents the appearance of checkerboard patterns when upscaling.

• Keywords: NST; neuronske mreže; duboko učenje; umjetnost
• Keywords (english): NST; deep learning; neural networks; art
• Language: english
• URN:NBN: urn:nbn:hr:168:270943
• Study programme: Title: Computing; Study programme type: university; Study level: graduate; Academic / professional title: magistar/magistra inženjer/inženjerka računarstva (magistar/magistra inženjer/inženjerka računarstva)
• Type of resource: Text
• File origin: Born digital
• Access conditions: Closed access
• Created on: 2023-10-11 10:07:53