Razvoj sustava za dinamičku pohranu strukturiranih podataka o mrežnom prometu

master's thesis

• Title (english): Development of a Dynamic Storage System for Structured Network Traffic Data
• Author: Luka Macan
• Mentor: Damir Pintar (mentor)
• Committee member: Damir Pintar (predsjednik povjerenstva)
• Committee member: Mihaela Vranić (član povjerenstva)
• Committee member: Luka Humski (član povjerenstva)
• Granter: University of Zagreb; Faculty of Electrical Engineering and Computing; Zagreb
• Defense date and country: 2022-07-12, Croatia
• Scientific / art field, discipline and subdiscipline: TECHNICAL SCIENCES; Computing

Abstract

Prikupljeni podaci s interneta često su u formatu koji nije prikladan za obrađivanje stoga ih je potrebno pretvoriti u format kojim se jednostavno služiti i upravljati. Također ti isti podatci mogu biti spremljeni na različitim lokacijama zbog čega je njihov pronalazak otežan. Zbog navedenih razloga potrebno je izgraditi sustav koji će dinamički skladištiti podatke na različite oblike spremišta podataka. U ovom radu razvijen je sustav koji dinamički skladišti podatke u oblaku i to podatke koji predstavljaju analizirani mrežni promet. Razvojem ovog sustava riješeni su navedeni problemi jer se podatci spremaju u lako obradivom JSON formatu. Također podaci spremljeni unutar oblaka dostupni su u bilo kojem trenutku i na bilo kojem mjestu te unutar samog skladišta mogu biti posloženi unutar direktorija ovisno o vremenu dolaska, vrsti mrežnog napada i slično.

Abstract (english)

Data collected from the Internet is often in a format that is not suitable for processing, so it needs to be converted into a format that is easy to use and manage. Also, this same data can be stored in different locations and therefore would be difficult to find. For the reasons above, it is necessary to build a system that will dynamically store data on various forms of data storage. In this thesis, a system was developed that dynamically stores data in the cloud, data that represents the analyzed network traffic. The development of this system has solved all of the previous problems because data is saved in an easy-to-operate JSON format. Also, data store within the cloud is available at any time and any location and can be arranged within the repository depending on the time of arrival, type of network attack, and so on.

• Keywords: Mrežni promet; Spremište podataka; Broker poruka; Pub/Sub arhitektura; Arhitektura s redom poruka; Programski jezik Go; AI Defender; Tema; Pretplata
• Keywords (english): Network traffic; Data warehouse; Message broker; Pub/Sub architecture; Queue message architecture; Go programming language; AI Defender; Topic; Subscription
• Language: croatian
• URN:NBN: urn:nbn:hr:168:791838
• Study programme: Title: Computing; Study programme type: university; Study level: graduate; Academic / professional title: magistar/magistra inženjer/inženjerka računarstva (magistar/magistra inženjer/inženjerka računarstva)
• Type of resource: Text
• File origin: Born digital
• Access conditions: Closed access
• Created on: 2023-01-14 09:20:32