Sustav za prikupljanje novinskih članaka s portala i pridruženih komentara na društvenim mrežama

master's thesis

• Title (english): System for collecting news articles from portals and their associated comments on social networks
• Author: Ivan Bratović
• Mentor: Stjepan Groš (mentor)
• Committee member: Stjepan Groš (predsjednik povjerenstva)
• Committee member: Dejan Škvorc (član povjerenstva)
• Committee member: Ante Đerek (član povjerenstva)
• Granter: University of Zagreb; Faculty of Electrical Engineering and Computing; Zagreb
• Defense date and country: 2021-07-14, Croatia
• Scientific / art field, discipline and subdiscipline: TECHNICAL SCIENCES; Computing

Abstract

U zadnjih par desetljeća, popularnost umjetne inteligencije, strojnog učenja i znanosti o podacima nikada nije bila veća. Jako bitan aspekt tih disciplina su podaci koji se moraju prikupiti, strukturirati te u konačnici analizirati. Ovaj rad opisuje sustav čija je svrha prikupljati podatke s novinskih portala i pridruženih komentara s društvenih mreža. Zadatak dizajniranja i implementacija sustava da bude lako nadogradiv, jednostavan za instalaciju i održavanje, nije bio jednostavan. Krajnji rezultat rada je sustav koji je upravo takav.

Abstract (english)

The popularity of AI, machine learning and data sciency has sky-rocketed in the last few decades. A very important ascpect of these fields is the process of data collection and analysis. In this thesis, I'll describe the process of designing a system that collects data from newspaper web portals: articles and associated comments from these articles. The task of designing this system to be easily upgradable, simple to deploy and to maintain was difficult. However, the end result is exactly as described.

• Keywords: internetski crawler; novinski članci; Docker; Kubernetes
• Keywords (english): web crawler; news articles; Docker; Kubernetes
• Language: croatian
• URN:NBN: urn:nbn:hr:168:724628
• Study programme: Title: Computing; Study programme type: university; Study level: graduate; Academic / professional title: magistar/magistra inženjer/inženjerka računarstva (magistar/magistra inženjer/inženjerka računarstva)
• Type of resource: Text
• File origin: Born digital
• Access conditions: Closed access
• Created on: 2023-01-13 11:52:01