Analiza performansi sustava za udaljeno izvršavanje programskog kôda

master's thesis

• Title (english): Performance analysis of online code execution systems
• Author: Herman Zvonimir Došilović
• Mentor: Igor Mekterović (mentor)
• Committee member: Igor Mekterović (predsjednik povjerenstva)
• Committee member: Mario Brčić (član povjerenstva)
• Committee member: Ljiljana Brkić (član povjerenstva)
• Granter: University of Zagreb; Faculty of Electrical Engineering and Computing; Zagreb
• Defense date and country: 2021-07-06, Croatia
• Scientific / art field, discipline and subdiscipline: TECHNICAL SCIENCES; Computing

Abstract

Sustavi za udaljeno izvršavanje programskog kôda imaju ključni utjecaj na korisničko iskustvo, i važno je da prilikom intenzivnog višekorisničkog opterećenja korisničko iskustvo ne pati zbog dugog vremena obrade zahtjeva za izvršavanje programskog kôda. Dosada u kontekstu sustava za udaljeno izvršavanje programskog kôda nisu postavljeni radni okviri za analizu njihovih performansi i ocjenu njihove kvalitete i pouzdanosti. Ovaj rad predstavlja prvi radni okvir za analizu performansi i ocjenu kvalitete i pouzdanosti usluge koju nude sustavi za udaljeno izvršavanje programskog kôda. Ovaj rad također predstavlja i aplikaciju Hélory koja implementira predstavljeni radni okvir za analizu performansi i ocjenu kvalitete i pouzdanosti za tri sustava za udaljeno izvršavanje programskog kôda: Sphere Engine, Piston i Judge0. Nakon pregleda osnovnih funkcionalnosti i sučelja aplikacije Hélory dan je primjer korištenja u analizi performansi sustava Piston i Judge0, ali i analiza performansi instance sustava Judge0 koja se aktivno koristi na Fakultetu elektrotehnike i računarstva Sveučilišta u Zagrebu. Konačno, na kraju se donose smjernice za budući razvoj radnog okvira i aplikacije.

Abstract (english)

Online code execution systems have a crucial impact on the user experience, and it is essential that during intense multi-user workloads, the user experience does not suffer due to the long processing time of code execution requests. So far, in the context of online code execution systems, no framework has been made to analyze their performance and assess their quality and reliability. This paper presents the first framework for analyzing the performance and evaluating the quality and reliability of the service offered by online code execution systems. This paper also presents the Hélory application that implements the presented framework for performance analysis and quality and reliability assessment for three systems for online code execution: Sphere Engine, Piston, and Judge0. After reviewing the basic functionalities and interface of the Hélory application, an example of use in the performance analysis of the Piston and Judge0 systems is given, as well as the performance analysis of the Judge0 system instance actively used at the Faculty of Electrical Engineering and Computing, University of Zagreb. Finally, guidelines for the future development of the framework and application are given.

• Keywords: analiza performansi; sustav za udaljeno izvršavanje programskog kôda; sustav za udaljeno ocjenjivanje; izvršavanje nepouzdanog programskog kôda; sphere engine; piston; judge0
• Keywords (english): performance analysis; online code execution system; online judge system; untrusted code execution; sphere engine; piston; judge0
• Language: croatian
• URN:NBN: urn:nbn:hr:168:886704
• Study programme: Title: Computing; Study programme type: university; Study level: graduate; Academic / professional title: magistar/magistra inženjer/inženjerka računarstva (magistar/magistra inženjer/inženjerka računarstva)
• Type of resource: Text
• File origin: Born digital
• Access conditions: Closed access
• Created on: 2023-01-13 09:55:55