Identificiranje geografskih područja s najvećim poboljšanjem kvalitete zraka korištenjem programskog okvira Apache Spark

undergraduate thesis

• Title (english): Identification of the geographical areas with the greatest improvement in air quality with Apache Spark
• Author: Bernard Kazazić
• Mentor: Martina Antonić (mentor)
• Committee member: Martina Antonić (predsjednik povjerenstva)
• Committee member: Petar Krivić (član povjerenstva)
• Committee member: Josip Marić (član povjerenstva)
• Granter: University of Zagreb; Faculty of Electrical Engineering and Computing; Zagreb
• Defense date and country: 2022-07-15, Croatia
• Scientific / art field, discipline and subdiscipline: TECHNICAL SCIENCES; Computing

Abstract

Cilj ovog rada je napisati program za identifikaciju geografskih područja s najvećim poboljšanjem kvalitete zraka 2020. godine u odnosu na 2019. godinu pomoću programskog okvira Apache Spark. U radu su opisani veliki podaci, raspodijeljeni sustavi i programski okviri Apache Spark i Apache Sedona. Za potrebe određivanja kvalitete zraka korišten je skup podataka Luftdaten. Poboljšanja su gledana samo za njemačke regije i gradove. Program je napisan pomoću programskih okvira Spark SQL-a i Apache Sedona . U okviru rada opisani su dijelovi programa koji su korišteni za dobivanje odgovora na upit zadan u sklopu konferencije DEBS 2021. Program je pokretan na lokalnom računalu s 4 dretve.

Abstract (english)

The goal of this paper is to create a program for the identification of geographical areas with the most significant improvement in air quality in 2020. compared to 2019. using the Apache Spark framework. The paper describes big data, distributed systems, and Apache Spark and Apache Sedona frameworks. Luftdaten data set was used to determine the air quality index (AQI). Only German cities and regions were looked at for improvements. The program was written using Spark SQL and Apache Sedona framework. The paper also describes the parts of the program used to obtain the answer to the query given as a task at the DEBS 2021 conference. The program is run on a local computer with 4 threads.

• Keywords: COVID-19; pandemija; indeks kvalitete zraka; raspodijeljeni sustavi; Apache Spark; Apache Sedona; Spark SQL; GeoJSON
• Keywords (english): COVID-19; pandemic; air quality index; distributed systems; Apache Spark; Apache Sedona; Spark SQL; GeoJSON
• Language: croatian
• URN:NBN: urn:nbn:hr:168:814805
• Study programme: Title: Computing; Study programme type: university; Study level: undergraduate; Academic / professional title: sveučilišni/a prvostupnik/ prvostupnica (baccalaureus/baccalaurea) inženjer/inženjerka računarstva (sveučilišni/a prvostupnik/ prvostupnica (baccalaureus/baccalaurea) inženjer/inženjerka računarstva)
• Type of resource: Text
• File origin: Born digital
• Access conditions: Closed access
• Created on: 2023-01-15 10:30:32