Interakcija s objektima u proširenoj stvarnosti temeljena na prepoznavanju gesta ruke

master's thesis

• Title (english): Interaction with objects in augmented reality based on hand gesture recognition
• Author: Davor Brunović
• Mentor: Igor Čavrak (mentor)
• Committee member: Igor Čavrak (predsjednik povjerenstva)
• Committee member: Hrvoje Mlinarić (član povjerenstva)
• Committee member: Danko Basch (član povjerenstva)
• Granter: University of Zagreb; Faculty of Electrical Engineering and Computing; Zagreb
• Defense date and country: 2014-07-14, Croatia
• Scientific / art field, discipline and subdiscipline: TECHNICAL SCIENCES; Computing

Abstract

U ovom radu proučavalo se područje proširene stvarnosti i metode interakcije s prividnim objektima. Fokusiralo se na interakciju rukom pomoću Leap Motion uređaja. Rezultat je aplikacija koja podržava jednostavno korištenje uređaja Leap Motion kao glavnog sredstva za interakciju korisnika i aplikacije u proširenoj stvarnosti. Kao bazna aplikacija koristi se prije stvorena igra šaha u proširenoj stvarnosti. Dio aplikacije koji se bavi detekcijom podataka ruke pomoću Leap Motion uređaja je odvojen u obliku razreda, kako bi se uz male preinake mogao jednostavno koristiti s drugim aplikacijama u proširenoj stvarnosti.
Realizirano je više načina interakcije:
Rotacijom ruke ostvaruje se rotacija objekta.
Pomakom ruke ostvaruje se translacija objekta.
Gestama se ostvaruje skaliranje/odabir, ovisno o gesti.
Odrađeni su testovi kojima se ispituje i prikazuje točnost i praktičnost korištenja ovakve vrste interakcije u pojedinim tipovima aplikacija. Relativno detaljno se opisuje ideja i implementacija rješenja, za zainteresirane je uz projekt priložen izvorni kod. Za detalje oko principa rada aplikacije u proširenoj stvarnosti preporuča se literatura vezana uz biblioteke ARToolkit i OSGART, uz praćenje komentara u kodu.

Abstract (english)

In this project the area of augmented reality has been examined along with methods of interaction with virtual objects. Hand interaction via the Leap Motion device has been the object of focus. The result is an application that enables simple use of the Leap Motion device as the main mean of interaction between the user and the application in augmented reality. An earlier created AR chess application is used as the base application. The part of the application that is responsible for the detection of hand dana using the Leap Motion device has been divided into a seperate class, so it can be used in other augmented reality applications with little modifications.
More ways of interaction has been realized:
The object rotates by the users hand rotation
The object translates by the users hand movement
The object scales/is selected by the users gesture, depending on the gesture type
Tests have been made to determine and present the accuracy and practicallity of using this kind of interaction in certain application types. The idea and implementation of the solution has been explained relatively in detail, and for those interested the source code is given with the project. For details about how the augmented reality application works, literature about the libraries ARToolkit and OSGART are recommended, with following the code and comments.

• Keywords: ARToolkit; OpenSceneGraph; OSGART; Leap Motion; proširena stvarnost; interakcija rukom; interakcija gestama; marker; šah
• Keywords (english): ARToolit; OpenSceneGraph; OSGART; Leap Motion; augmented reality; hand interaction; gesture interaction; marker; chess
• Language: croatian
• URN:NBN: urn:nbn:hr:168:434009
• Study programme: Title: Computing; Study programme type: university; Study level: graduate; Academic / professional title: magistar/magistra inženjer/inženjerka računarstva (magistar/magistra inženjer/inženjerka računarstva)
• Type of resource: Text
• File origin: Born digital
• Access conditions: Closed access
• Created on: 2018-02-06 08:04:21