Obrada toka senzorskih podataka korištenjem platforme Apache Apex

undergraduate thesis

• Title (english): Sensor Datastream Processing with Apache Apex Platform
• Author: Borna Bezjak
• Mentor: Krešimir Pripužić (mentor)
• Committee member: Krešimir Pripužić (predsjednik povjerenstva)
• Committee member: Martina Marjanović (član povjerenstva)
• Committee member: Damjan Katušić (član povjerenstva)
• Granter: University of Zagreb; Faculty of Electrical Engineering and Computing; Zagreb
• Defense date and country: 2018-07-13, Croatia
• Scientific / art field, discipline and subdiscipline: TECHNICAL SCIENCES; Computing

Abstract

U radu je opisana platforma za obradu velike količine podataka Apache Apex. Prikazana je integracija s platformom Apache Hadoop, osnovni koncepti rada s platformom Apache Apex. Opisan je proces validiranja aplikacije, te kako se platforma Apache Apex nosi s ograničenim resursima i kako se oporavlja od pogrešaka. Uz opis platforme prikazan je proces izrade aplikacije za obradu tokova podataka s temperaturnih senzora. Aplikacija čita zapise iz datoteke i dinamički računa maksimalnu, minimalnu i srednju vrijednost pristiglih podataka. Dobiveni rezultati zapisuju se u pripadne datoteke.

Abstract (english)

In this paper is described Apache Apex, platform for big data processing. Reader can see how Apache Apex integrates with Hadoop and basic concepts of Apache Apex, as well as how Apache Apex handles situations when computer resources are limited and how Apex recovers from errors. Reader can also see the process of constructing an application for processing data from temperature sensors. Application reads CSV file with collected data, and dynamically calculates minimum, maximum and mean value of processed values. After processing, results are stored in associated files.

• Keywords: Java; Apache; Apex; Malhar; CSV; Hadoop; Obrada tokova podataka; Maven; senzori temperature
• Keywords (english): Java; Apache; Apex; Malhar; CSV; Hadoop; stream processing; Maven; temperature sensors
• Language: croatian
• URN:NBN: urn:nbn:hr:168:230417
• Study programme: Title: Computing; Study programme type: university; Study level: undergraduate; Academic / professional title: sveučilišni/a prvostupnik/ prvostupnica (baccalaureus/baccalaurea) inženjer/inženjerka računarstva (sveučilišni/a prvostupnik/ prvostupnica (baccalaureus/baccalaurea) inženjer/inženjerka računarstva)
• Type of resource: Text
• File origin: Born digital
• Access conditions: Closed access
• Created on: 2019-03-13 19:03:59