Sustav za praćenje govornika računalnim vidom

master's thesis

• Title (english): Speaker tracking system based on computer vision
• Author: Damir Tomić
• Mentor: Zoran Kalafatić (mentor)
• Committee member: Zoran Kalafatić (predsjednik povjerenstva)
• Committee member: Tomislav Hrkać (član povjerenstva)
• Committee member: Siniša Šegvić (član povjerenstva)
• Granter: University of Zagreb; Faculty of Electrical Engineering and Computing; Zagreb
• Defense date and country: 2015-07-08, Croatia
• Scientific / art field, discipline and subdiscipline: TECHNICAL SCIENCES; Computing

Abstract

Diplomski rad opisuje izradu sustava za praćenje govornika. Sustav se sastoji od računala, pomične kamere visoke rezolucije i Microsoft Kinect senzora. Sustav koristi računalni vid kako bi locirao korisnike i analizirao njihove kretnje. Kinect senzor pronalazi govornika, i zatim prosljeđuje te informacije računalu. Računalna aplikacija pomoću spomenutih podataka računa kut za koji se pomična kamera mora pomaknuti kako bi se govornik nalazio u kadru. Sustav prati govornikovo gibanje u sve tri dimenzije, te koristi optičko povećanje u slučaju da se korisnik udalji. Sustav isto tako može tumačiti govornikove pokrete ruku, koje mu omogućuju upravljanje sustavom putem gesti. Uz diplomski rad, priložena je aplikacija koja sadrži opisane funkcionalnosti.

Abstract (english)

This master's thesis describes how to build a speaker tracking system. The system consists of a computer, a high resolution pan-tilt-zoom camera and a Microsoft Kinect sensor. The system is using computer vision to locate users and analyze their movements. The Kinect sensor acquires the speaker and forwards the information to the computer. Using this data, the computer application calculates the angle required by the pan-tilt-zoom camera. PTZ camera then moves, keeping the speaker inside the video frame. The system tracks the speaker’s movement in all three dimensions and increases magnification in case the user moves backwards. The system can also interpret the speaker’s hand movements, which allows the speaker to utilize the system using gestures. An application containing the described functionalities is included in this master’s thesis.

• Keywords: Računalni vid; Microsoft Kinect; pomična kamera; PTZ; geste; VISCA protokol; C#; WPF
• Keywords (english): Computer vision; Microsoft Kinect; pan tilt zoom camera; PTZ; gesticulation; VISCA protocol; C#; WPF
• Language: croatian
• URN:NBN: urn:nbn:hr:168:458858
• Study programme: Title: Computing; Study programme type: university; Study level: graduate; Academic / professional title: magistar/magistra inženjer/inženjerka računarstva (magistar/magistra inženjer/inženjerka računarstva)
• Type of resource: Text
• File origin: Born digital
• Access conditions: Closed access
• Created on: 2018-02-06 14:07:45