Raspoznavanje izgovorenog jezika iz kratkog zvučnog zapisa metodama strojnog učenja

undergraduate thesis

• Title (english): Recognition of spoken language from a short audio recording using machine learning methods
• Author: Lana Bartolović
• Mentor: Alan Jović (mentor)
• Committee member: Alan Jović (predsjednik povjerenstva)
• Committee member: Eda Jovičić (član povjerenstva)
• Committee member: David Dukić (član povjerenstva)
• Granter: University of Zagreb; Faculty of Electrical Engineering and Computing; Zagreb
• Defense date and country: 2024-07-02, Croatia
• Scientific / art field, discipline and subdiscipline: TECHNICAL SCIENCES; Computing

Abstract

Ljudski jezik nije razumljiv računalu sam po sebi. Stoga se obradom prirodnog jezika nastoji premostiti ta prepreka. Jedan od temeljnih zadataka je određivanje jezika. U ovom radu su učena i ispitana tri modela dubokog učenja s ciljem određivanja uspješnosti klasificiranja jezika iz zvučnog zapisa. Najbolji model, zasnovan na konvolucijskoj mreži i značajkama MFCC, postigao je mjeru točnosti od 83% i utežanu mjeru F1 od 83%.

Abstract (english)

The human language is not understandable to computers in itself. Therefore, natural language processing aims to bridge this gap. One of the fundamental tasks is language identification from audio recordings. In this work, three deep learning models were trained and tested with the goal to determine their success in classifying languages from audio recordings. The best model, based on convolutional network and MFCC features, achieved an accuracy rate of 83% and a weighted F1 score of 83%.

• Keywords: obrada prirodnog jezika; duboko učenje; Fourierova transformacija; spektrogram; MFCC; konvolucijska neuronska mreža; klasifikacija
• Keywords (english): natural language processing; deep learning; Fourier transformation; spectrogram; MFCC; convolutional neural network; classification
• Language: croatian
• URN:NBN: urn:nbn:hr:168:980596
• Study programme: Title: Computing; Study programme type: university; Study level: undergraduate; Academic / professional title: sveučilišni/a prvostupnik/ prvostupnica (baccalaureus/baccalaurea) inženjer/inženjerka računarstva (sveučilišni/a prvostupnik/ prvostupnica (baccalaureus/baccalaurea) inženjer/inženjerka računarstva)
• Type of resource: Text
• File origin: Born digital
• Access conditions: Closed access
• Created on: 2024-10-12 20:04:25