Informacijski sustav za upravljanje sadržajem repozitorija Apache Kafka procesora

undergraduate thesis

• Title (english): Information System for Content Management of Apache Kafka Stream Processor Repository
• Author: Fran Vrdoljak
• Mentor: Dejan Škvorc (mentor)
• Committee member: Dejan Škvorc (predsjednik povjerenstva)
• Committee member: Ivan Grgurina (član povjerenstva)
• Committee member: Ivan Kovačević (član povjerenstva)
• Granter: University of Zagreb; Faculty of Electrical Engineering and Computing; Zagreb
• Defense date and country: 2020-07-10, Croatia
• Scientific / art field, discipline and subdiscipline: TECHNICAL SCIENCES; Computing

Abstract

Trenutno jedna od najraširenijih tehnologija razvijenih za lako upravljanje ogromnim skupovima podatka unutar velikih sustava jest Apache Kafka. Apache Kafka je distribuirana platforma za prijenos temeljena na objavi-pretplati sistemu razmijene poruka. Popularizacijom ove platforme stvara se potreba za izgradnjom repozitorija koji će okupljati Apache Kafka procesore toka (engl. streaming processor) te datoteke koje ih opisuju.

Osnovni cilj ovog rada je ostvariti sustav za provjeru ispravnosti i učitavanje Apache Kafka procesora toka na repozitorij. Sustav se temelji na REST arhitekturnom stilu koji je prethodno proučen i opisan. Posebna pozornost posvećena je strukturi programskog paketa i metapodacima za opis Apache Kafka procesora. Analizom tehnologija za oblikovanje poslužiteljskih aplikacija odabrano je okruženje za izvođenje programskog jezika JavaScript, Node.js s njegovim aplikacijskim okvirom Express. Izgrađeno je klijentsko sučelje koje uz atraktivan i moderan izgled pruža klijentu mogućnost učitavanja vlastitog Apache Kafka procesora toka na povuci i spusti način ili uz pomoć čarobnjaka za učitavanje. Sustav je izgrađen na modularan način te je kao takav spreman za promijene i nadogradnju.

Abstract (english)

One of the most popular technologies used for easy managing of Big Data within large systems is Apache Kafka. Apache Kafka is a distributed streaming platform based on publish-subscribe messaging system. With popularization of this platform comes the need to build the repository which will store the Apache Kafka stream processors and their data.
The main goal of this project was to create a system for validation and upload of the Apache Kafka stream processors in Apache Kafka processors' repository. The system is based on REST architectural style which was previously studied and described. A special attention was paid to the structure of the programme package and metadata for describing the Apache Kafka stream processor. After analysing the technologies for developing service applications, JavaScript runtime environment Node.js with its framework Express was chosen. An attractive and modern client interface for uploading components was built. The client has the possibility to upload his Apache Kafka stream processor in a drag and drop way or via upload wizard. The system was built in a modular way and it is open to changes and upgrades.

• Keywords: Apache Kafka; Veliki skupovi podataka; Repozitorij Apache Kafka procesora toka; REST; Node.js; Express.js; Angular
• Keywords (english): Apache Kafka; Big Data; Apache Kafka processor repository; REST; Node.js; Express.js; Angular
• Language: croatian
• URN:NBN: urn:nbn:hr:168:530565
• Study programme: Title: Computing; Study programme type: university; Study level: undergraduate; Academic / professional title: sveučilišni/a prvostupnik/ prvostupnica (baccalaureus/baccalaurea) inženjer/inženjerka računarstva (sveučilišni/a prvostupnik/ prvostupnica (baccalaureus/baccalaurea) inženjer/inženjerka računarstva)
• Type of resource: Text
• File origin: Born digital
• Access conditions: Closed access
• Created on: 2023-01-13 16:29:06