Obrada toka podataka korištenjem programske knjižnice Kafka Streams

undergraduate thesis

• Title (english): Data Stream Processing with Kafka Streams
• Author: Josip Lučić
• Mentor: Krešimir Pripužić (mentor)
• Committee member: Krešimir Pripužić (predsjednik povjerenstva)
• Committee member: Josip Marić (član povjerenstva)
• Committee member: Ivan Sičić (član povjerenstva)
• Granter: University of Zagreb; Faculty of Electrical Engineering and Computing; Zagreb
• Defense date and country: 2023-07-04, Croatia
• Scientific / art field, discipline and subdiscipline: TECHNICAL SCIENCES; Computing

Abstract

Ovaj rad demonstrira obradu toka podataka koristeći Processor API u programskom jeziku Java. On je jedan od dvaju API-ja koje platforma Apache Kafka nudi u sklopu programske knjižnice Kafka Streams. S obzirom na to da je Kafka Streams sastavni dio platforme, rad se prije svega fokusira na njenu arhitekturu, funkcionalnosti i terminlogiju radi lakšeg razumijevanja. Naravno, prije objašnjavnja programskog koda, glavni koncepti samog Processor API-ja su također opisani. Podaci koji se koriste za demonstraciju obrade podataka preuzeti su iz skupa podataka Aposemat IoT-23 koji sadrži mrežni promet internet uređaja.

Abstract (english)

This paper demonstrates data-stream processing using the Processor API in the Java programming language. It is one of the two APIs offered by the Apache Kafka platform within the Kafka Streams library. Considering that Kafka Streams is an integral part of the platform, the paper first focuses on it's architecture, functionalities, and terminology for easier understanding. Of course, before explaining the program code, the main concepts of the Processor API are also described. The data used to demonstrate data processing is taken from the Aposemat IoT-23 dataset, which contains network traffic from internet devices.

• Keywords: tok; tema; događaj; zapis; particija; ključ; vrijednost; posrednik; proizvođač; potrošač; topologija; procesor
• Keywords (english): stream; topic; event; record; partition; key; value; broker; producer; consumer; topology; processor
• Language: croatian
• URN:NBN: urn:nbn:hr:168:866180
• Study programme: Title: Computing; Study programme type: university; Study level: undergraduate; Academic / professional title: sveučilišni/a prvostupnik/ prvostupnica (baccalaureus/baccalaurea) inženjer/inženjerka računarstva (sveučilišni/a prvostupnik/ prvostupnica (baccalaureus/baccalaurea) inženjer/inženjerka računarstva)
• Type of resource: Text
• File origin: Born digital
• Access conditions: Closed access
• Created on: 2023-10-11 09:34:27