Usporedba različitih inačica platforme Apache Spark

undergraduate thesis

• Title (english): A Comparison of Different Apache Spark Versions
• Author: Filip Herceg
• Mentor: Krešimir Pripužić (mentor)
• Committee member: Krešimir Pripužić (predsjednik povjerenstva)
• Committee member: Darko Štriga (član povjerenstva)
• Committee member: Denis Salopek (član povjerenstva)
• Granter: University of Zagreb; Faculty of Electrical Engineering and Computing; Zagreb
• Defense date and country: 2019-07-12, Croatia
• Scientific / art field, discipline and subdiscipline: TECHNICAL SCIENCES; Computing

Abstract

U ovom radu opisani su osnovi koncepti platforme Apache Spark, komponente platforme Apache Spark (Spark Core, Spark Streaming, Spark SQL, Spark MLlib, Spark GraphX), mogućnosti pokretanja aplikacije te upravljanja resursima. Objašnjene su temeljne strukture podataka platforme Apache Spark. Napravljena je usporedba inačica 1 i 2 te su razlike prikazane na primjerima.

Abstract (english)

This paper describes basic concepts of Apache Spark platform, components of Apache Spark platform (Spark Core, Spark Streaming, Spark SQL, Spark MLlib, Spark GraphX), possibilities of running a Spark application and possibilites of resource management, defines fundamental data structures of Apache Spark platform. Finally this paper shows a comparison of versions 1 and 2 which are also show in the examples.

• Keywords: Apache Spark; Spark SQL; MLlib; Spark Streaming; Spark Structured Streaming; GraphX; Scala; Upravljač; Izvršitelj; RDD; Dataset; DataFrame; raspodijeljena obrada podataka; transformacije; akcije; Akumulator; Hadoop YARN; Mesos; Raspodijeljena obrada u oblaku
• Keywords (english): Apache Spark; Spark SQL MLlib; Spark Streaming; Spark Structured Streaming; GraphX; Scala; Driver; Executor; RDD; Dataset; DataFrame; distributed computing; transformations; actions; Accumulator; Hadoop YARN; Mesos; Distributed cloud computing
• Language: croatian
• URN:NBN: urn:nbn:hr:168:184819
• Study programme: Title: Computing; Study programme type: university; Study level: undergraduate; Academic / professional title: sveučilišni/a prvostupnik/ prvostupnica (baccalaureus/baccalaurea) inženjer/inženjerka računarstva (sveučilišni/a prvostupnik/ prvostupnica (baccalaureus/baccalaurea) inženjer/inženjerka računarstva)
• Type of resource: Text
• File origin: Born digital
• Access conditions: Closed access
• Created on: 2020-01-07 18:25:02