Upravljanje gestama 3D objektom pomoću uređaja Leap Motion

master's thesis

• Title (english): Gesture based interaction using Leap Motion device
• Author: Damir Ciganović-Janković
• Mentor: Željka Mihajlović (mentor)
• Committee member: Željka Mihajlović (predsjednik povjerenstva)
• Committee member: Leonardo Jelenković (član povjerenstva)
• Committee member: Vlado Sruk (član povjerenstva)
• Granter: University of Zagreb; Faculty of Electrical Engineering and Computing; Zagreb
• Defense date and country: 2015-07-14, Croatia
• Scientific / art field, discipline and subdiscipline: TECHNICAL SCIENCES; Computing

Abstract

Leap Motion je uređaj za prepoznavanje pokreta i gesti ruku. U radu je objašnjen način na koji uređaj radi te koje su njegove prednosti i nedostaci. Glavni cilj rada bio je iskoristiti aplikacijsko programsko sučelje Leap Motion-a, biblioteku leap.js, kako bi se ostvarilo upravljanje 3D objektom unutar aplikacije. Cilj je ostvaren ugrađivanjem podrške za Leap Motion funkcionalnosti unutar već postojeće web aplikacije Micro Soot maintenance app tako da se aplikacijom upravljalo pomoću gesti. Aplikacija ima pet različitih načina rada te je za njenu implementaciju korišteno nekoliko različitih Javascript biblioteka, od kojih je posebno važna Three.js potrebna za implementaciju 3D grafike unutar aplikacije. Za potrebe prepoznavanja gesti bilo je potrebno implementirati vlastiti prepoznavatelj gesti kako bi se proširio ograničen skup gesti koje sam uređaj može prepoznati. Gestama se aplikacijom upravljalo na način da je svaka gesta, ovisno o načinu rada, okidala neku od akcija unutar aplikacije, ponekad zavisno o položaju ruke, a ponekad ne.

Abstract (english)

Leap Motion is a device for hand motion and hand gesture recognition. This paper explains how Leap Motion works and what are its advantages and disadvantages. The main objective of this study was to utilize Leap Motion application programming interface (leap.js library) in order to manage 3D object within an application by using Leap Motion device. The goal is achieved by incorporating support for Leap Motion functionality within existing web application, Micro Soot maintenance app, to manage the application by using gestures. The application has five different modes. Number of different Javascript libraries are used for its implementation, with Three.js library as particularly important because it was needed to implement 3D graphics within the application. For the purposes of gesture recognizing, gesture recognizer was needed to be implemented to spread a limited set of gestures that the device can recognize. Application was managed by gestures in such a way that every gesture, depending on the application mode, was triggering some of the actions within the application, sometimes depending on the hand position, sometimes not.

• Keywords: Leap Motion; leap.js; prepoznavanje pokreta ruke; prepoznavanje gesti ruke; Three.js
• Keywords (english): Leap Motion; leap.js; hand motion recognition; hand gesture recognition; Three.js
• Language: croatian
• URN:NBN: urn:nbn:hr:168:319902
• Study programme: Title: Computing; Study programme type: university; Study level: graduate; Academic / professional title: magistar/magistra inženjer/inženjerka računarstva (magistar/magistra inženjer/inženjerka računarstva)
• Type of resource: Text
• File origin: Born digital
• Access conditions: Closed access
• Created on: 2018-02-06 08:11:16