Postupci pretraživanja slika matematičkih zadataka po sličnosti

master's thesis

• Title (english): Methods for Searching Mathematical Problems Images by Similarity
• Author: Vlado Galić
• Mentor: Tomislav Hrkać (mentor)
• Committee member: Tomislav Hrkać (predsjednik povjerenstva)
• Committee member: Zoran Kalafatić (član povjerenstva)
• Committee member: Jan Šnajder (član povjerenstva)
• Granter: University of Zagreb; Faculty of Electrical Engineering and Computing; Zagreb
• Defense date and country: 2021-07-02, Croatia
• Scientific / art field, discipline and subdiscipline: TECHNICAL SCIENCES; Computing

Abstract

Pretraživanje slika matematičkih zadataka po sličnosti je prilično zahtjevan i kom-
pleksan problem. Mogli bismo ga usporediti s jednim poznatim problemom kao što
je dohvat slike (engl. Image retrieval). Problem dohvata slike predstavlja izazov u ra-
čunarskoj znanosti već dosta vremena i još nemamo neku generalnu metodu koja će
raditi odlično za sve probleme dohvata slike. U ovom radu smo predložili metodu
koja kombinira tekst i sliku, te smo pomoću suvremenih modela za enkodiranje slike i
teksta uspjeli objediniti najbolje iz oba svijeta i stvoriti model koji jako dobro rješava
problem pronalaska sličnih matematičkih zadataka.

Abstract (english)

Searching images of mathematical problems by similarity is a rather demanding
and complex problem. We could compare it to a well-known problem such as image
retrieval. The problem of image retrieval has been a challenge in computer science for
quite some time and we do not yet have any general method that will work great for
all image retrieval problems. In this paper, we proposed a method that combines text
and image, and with the help of contemporary models for encoding image and text
we were able to combine the best from both worlds and create a model that solves the
problem of finding similar mathematical problems.

• Keywords: Transformer; BERT; RoBERTa; ResNet; FAISS; ImageRetrival
• Keywords (english): Transformer; BERT; RoBERTa; ResNet; FAISS; ImageRetrival
• Language: croatian
• URN:NBN: urn:nbn:hr:168:055983
• Study programme: Title: Computing; Study programme type: university; Study level: graduate; Academic / professional title: magistar/magistra inženjer/inženjerka računarstva (magistar/magistra inženjer/inženjerka računarstva)
• Type of resource: Text
• File origin: Born digital
• Access conditions: Closed access
• Created on: 2023-01-13 12:17:01