Utjecaj individualnih prijenosnih funkcija glave na kvalitetu binauralne sinteze uz praćenje položaja glave

doctoral thesis

• Title (english): The influence of individual head-related transfer functions on the quality of binaural synthesis with head tracking
• Author: Vedran Planinec
• Mentor: Kristian Jambrošić (mentor)
• Committee member: Marko Horvat (predsjednik povjerenstva)
• Committee member: Antonio Petošić (član povjerenstva)
• Committee member: Ivan Đurek (član povjerenstva)
• Granter: University of Zagreb; Faculty of Electrical Engineering and Computing; (Department of Electroacoustics); Zagreb
• Defense date and country: 2024-09-27, Croatia
• Scientific / art field, discipline and subdiscipline: TECHNICAL SCIENCES; Computing
• Universal decimal classification (UDC): 004 - Computer science and technology. Computing. Data processing

Abstract

Korištenje audio sustava koji koriste binauralnu sintezu uz praćenje položaja glave postalo je sve popularnije na današnjem tržištu, osobito u sustavima virtualne stvarnosti. Proces binauralne sinteze koristi prijenosne funkcije glave (HRTF, engl. Head-Related Transfer Functions) kao ulazni podatak potreban za vjerni doživljaj zvučnih izvora iz svih mogućih smjerova dolaska u VR okruženjima. Istraživanja kvalitete lokalizacije virtualnih zvučnih izvora često variraju u metodama i zaključcima, posebno u vezi poboljšanja rezultata korištenjem vlastitih individualnih HRTF skupova. Zbog kompleksnosti mjerenja individualnih HRTF skupova, prethodna istraživanja često uključuju mali broj ispitanika. Ova disertacija istražuje cijeli sustav binauralne sinteze, počevši s uređajima za praćenje položaja glave kroz statička i dinamička mjerenja kvalitete IMU senzora. Preliminarno ispitivanje kvalitete binauralne sinteze bez individualnih HRTF skupova ispituje promjene ostalih parametara binauralnog sustava, dok glavno ispitivanje uključuje mjerenje individualnih HRTF skupova metodom Earfish, te ispitivanje točnosti lokalizacije i subjektivnog vrednovanja prirodnosti i eksternalizacije virtualnih zvučnih izvora. Koristeći nove metode, istraživanja u doktorskoj disertaciji pokazuju da korištenje individualnih HRTF skupova povećava točnost lokalizacije, te poboljšava percepciju prirodnosti i eksternalizacije zvučnog polja dobivenog binauralnom sintezom, što rezultira zvučnim doživljajem najbližim slušanju stvarnih zvučnih izvora.

Abstract (english)

The use of audio systems employing binaural synthesis with head-tracking has become increasingly popular in today's market, particularly in virtual reality systems. Binaural synthesis utilizes Head-Related Transfer Functions (HRTFs) as input data, which are essential for accurately simulating sound sources from all possible directions in VR environments.
Research on the quality of virtual sound source localization often varies in methods and conclusions, particularly regarding the improvement of results using individualized HRTF sets. Due to the complexity of measuring individual HRTFs, previous studies typically involve a small number of participants.
This dissertation explores the entire binaural synthesis system, beginning with head-tracking devices through static and dynamic experiments of IMU sensor performance.
A preliminary investigation into the quality of binaural synthesis without individualized HRTFs examines changes in other system parameters, while the main experiment involves measuring individual HRTFs using the Earfish method. It further assesses the accuracy of sound localization and subjective evaluations of the naturalness and externalization of virtual sound sources.
Using new methods, the research in this doctoral dissertation demonstrate that employing individualized HRTF sets enhances localization accuracy and improves the perception of naturalness and externalization in the sound field produced by binaural synthesis, resulting in an auditory experience closest to hearing real sound sources.

• Keywords: binauralna sinteza; praćenje položaja glave; HRTF funkcija; IMU senzor; virtualni zvučni izvor; 3D audio sustav; virtualna i proširena stvarnost
• Keywords (english): binaural synthesis; head tracking; HRTF functions; IMU sensors; virtual sound source; 3D audio systems; virtual and augmented reality
• Language: croatian
• URN:NBN: urn:nbn:hr:168:627770
• Promotion: 2024
• Study programme: Title: Computer Science; Study programme type: university; Study level: postgraduate; Academic / professional title: Doktor znanosti (Doktor znanosti)
• Type of resource: Text
• Extent: 114. str.
• File origin: Born digital
• Access conditions: Open access
• Created on: 2024-11-27 10:50:18