Prototipna aplikacija za praćenje pokreta očiju te vrednovanje korisnikove uspješnosti u izvođenju zadataka u virtualnoj stvarnosti

master's thesis

• Title (english): Prototype application for tracking eye movement and task performance evaluation in virtual reality
• Author: Ivan Škrabo
• Mentor: Maja Matijašević (mentor)
• Committee member: Maja Matijašević (predsjednik povjerenstva)
• Committee member: Mirko Sužnjević (član povjerenstva)
• Committee member: Igor Sunday Pandžić (član povjerenstva)
• Granter: University of Zagreb; Faculty of Electrical Engineering and Computing; Zagreb
• Defense date and country: 2022-07-12, Croatia
• Scientific / art field, discipline and subdiscipline: TECHNICAL SCIENCES; Computing

Abstract

Razvoj tehnologija virtualne stvarnosti i VR zaslona pruža sve veće i nove načine dobivanja podataka o korisniku. Putem uređaja HTC Vive Pro Eye, uz dodatne aplikacije i programske knjižnice, kao dio ovog rada se prate korisnikove oči tijekom korištenja VR zaslona. Razvijena je prototipna aplikacija u sustavu Unity koja simulira tri uobičajene mehanike u igrama: pucanje, uzimanje i postavljanje i sječenje. Uz to je napravljena dodatna četvrta igra koja kombinira pokrete ruku i fokusiranje očiju. Izrađena aplikacija sadrži četiri scene, pri čemu svaka scena predstavlja jednu igru. Dok korisnik igra te igre, aplikacija prati njegov fokus oka i bilježi treptaje, kao i gdje korisnik gleda. Svaka igra također prati određene metrike koje pomažu u analizi korisničke uspješnosti u izvođenju zadataka. Za dobivanje podataka je provedeno je testiranje s 15 korisnika koji igraju igre u aplikaciji, dok aplikacija bilježi podatke fokusiranja očiju i podatke o uspješnosti. Podaci su na kraju obrađeni i analizirani, uspoređujući broj i duljine treptaja kroz sve četiri igre, te analizirajući dodatno praćene metrike za pojedine igre. Rezultati upućuju na povezanost između vrste zadatka i korisnikovih treptaja, kao i između rezultata izvođenja zadataka i korisničke uspješnosti. Datoteka s rezultatima je predana kao dodatak radu.

Abstract (english)

Development of virtual reality and head-mounted VR display technologies provides ever broader and new ways of obtaining data about the user. Through the HTC Vive Pro Eye VR headset, along with additional applications and program libraries, the user’s eyes can be tracked while they use the headset. A prototype application has been developed in Unity, which simulates three common game mechanics: shooting, pick and place, and slashing. In addition, a fourth game has been developed that combines hand movements and eye focus. The developed application contains four scenes, where each scene represents one game. While the user plays these games, the application tracks their eye focus and records blinks, as well as where the user is looking. Each game also tracks specific metrics that help deduce user success in performing tasks. To obtain data, user testing has been conducted with 15 users that play the games in the application, while the application records the eye focus data as well as user performance. The data has been processed and analyzed, comparing the number and length of blinks across all four games, as well as analyzing the additionally tracked metrics for each game. The results suggest a relationship between the type of task and user blinks, as well as a relationship between task performance results and user performance. The data file containing the results is submitted as an appendix to the thesis.

• Keywords: virtualna stvarnost; VR; praćenje očiju; korisnička interakcija; mehanike igara; Unity
• Keywords (english): virtual reality; VR; eye tracking; user interaction; game mechanics; Unity
• Language: croatian
• URN:NBN: urn:nbn:hr:168:690597
• Study programme: Title: Computing; Study programme type: university; Study level: graduate; Academic / professional title: magistar/magistra inženjer/inženjerka računarstva (magistar/magistra inženjer/inženjerka računarstva)
• Type of resource: Text
• File origin: Born digital
• Access conditions: Closed access
• Created on: 2023-01-13 10:48:15