Sustav temeljen na mikrouslužnoj arhitekturi za nadgledanje kvantitativnih podataka u stvarnom vremenu

master's thesis

• Title (english): A system based on a microservice architecture for monitoring quantitative data in real-time
• Author: Josip Žaja
• Mentor: Krešimir Pripužić (mentor)
• Committee member: Krešimir Pripužić (predsjednik povjerenstva)
• Committee member: Dragan Jevtić (član povjerenstva)
• Committee member: Marin Vuković (član povjerenstva)
• Granter: University of Zagreb; Faculty of Electrical Engineering and Computing; Zagreb
• Defense date and country: 2023-07-11, Croatia
• Scientific / art field, discipline and subdiscipline: TECHNICAL SCIENCES; Computing

Abstract

Ovaj diplomski rad istražuje razvoj i implementaciju sustava temeljenog na mikrouslužnoj arhitekturi za nadzor kvantitativnih podataka u stvarnom vremenu. Rad se usredotočuje na korištenje tehnologija i alata poput Strimzi (Kafke), generatora podataka, Logstasha, Opensearcha, Prometheusa, Grafane, Lokija, Argo CD-a i pristupa "app of apps". Svaka komponenta je opisana te su objašnjeni svi povezani pojmovi. Kombinacijom ovih komponenti stvoren je snažan i učinkovit ekosustav za prikupljanje, analizu, vizualizaciju i upravljanje podacima u stvarnom vremenu. Cilj rada je detaljno istražiti razvoj i implementaciju takvog sustava, te poboljšati performanse, pouzdanost i skalabilnost sustava, prilagođavajući ga specifičnim potrebama korisnika. Osim toga, rad želi pružiti značajan uvid u prednosti i potencijal mikrouslužne arhitekture u kontekstu obrade i nadzora podataka u stvarnom vremenu. Kroz praktičnu primjenu i detaljnu analizu ovog sustava, cilj je pružiti znanje potrebno za samostalni razvoj sličnih sustava temeljenih na mikrouslugama te razumijevanje DevOps razvoja.

Abstract (english)

This thesis explores the development and implementation of a microservices-based system for real-time monitoring of quantitative data. The focus is on utilizing technologies and tools such as Strimzi (Kafka), Data Generator, Logstash, OpenSearch, Prometheus, Grafana, Loki, Argo CD and "app of apps" approach. Each component is described and all the linked concepts are explained. By combining these components, a powerful and efficient ecosystem has been created for collecting, analysing, visualizing, and managing real-time data. The aim of the thesis is to thoroughly investigate the development and implementation of such a system, as well as to improve its performance, reliability, and scalability, while adapting it to specific user needs. Additionally, the thesis aims to provide significant insights into the advantages and potential of microservices architecture in the context of real-time data processing and monitoring. Through practical application and detailed analysis of this system, the goal is to provide the knowledge required for independent development of similar microservices-based systems and a comprehensive understanding of DevOps development.

• Keywords: mikrouslužna arhitektura; obrada podataka u stvarnom vremenu; Kubernetes; Strimzi; Kafka; Prometheus; OpenSearch; Grafana; Loki; Logstash; logovi; metrike; generator podataka
• Keywords (english): microservice architecture; real-time data processing; Kubernetes; Strimzi; Kafka; Prometheus; OpenSearch; Grafana; Loki; Logstash; logs; metrics; data generator
• Language: croatian
• URN:NBN: urn:nbn:hr:168:351288
• Study programme: Title: Computing; Study programme type: university; Study level: graduate; Academic / professional title: magistar/magistra inženjer/inženjerka računarstva (magistar/magistra inženjer/inženjerka računarstva)
• Type of resource: Text
• File origin: Born digital
• Access conditions: Closed access
• Created on: 2023-10-11 11:04:57