Razvoj programskog agenta-igrača za računalnu igru primjenom podržanog učenja

undergraduate thesis

• Title (english): Development of a software agent-player for a computer game using reinforcement learning
• Author: Bartul Tadić
• Mentor: Siniša Popović (mentor)
• Committee member: Siniša Popović (predsjednik povjerenstva)
• Committee member: Marko Đurasević (član povjerenstva)
• Committee member: Mate Gambiraža (član povjerenstva)
• Granter: University of Zagreb; Faculty of Electrical Engineering and Computing; Zagreb
• Defense date and country: 2023-07-07, Croatia
• Scientific / art field, discipline and subdiscipline: TECHNICAL SCIENCES; Computing

Abstract

Zadnjih godina razvoj u dubokom podržanom učenju uvelike je imao primjenu u računalnim igricama i simulatorima zbog mogućnosti generiranja velikog broja interaktivnih i vizualno bogatih simulacija. U ovom radu, razvijeno je 3D okruženje koristeći pogonski sustav za računalne igre Unity te je opisana uporaba ML-Agents Toolkita za treniranje inteligentnih agenata pomoću gotove PyTorch implementacije algoritma Proximal Policy Optimization (PPO). U radu su uspoređene performanse različitih konfiguracija te opisano uspješno treniranje. Podržanim učenjem, agent je naučio vještine kretanja i istraživanja okoline, izbjegavanje neprijatelja te skupljanja novčića. Također, u radu je pokrivena teorija iza strojnog učenja, podržanog učenja, dubokih neuronskih mreža, algoritma PPO te korištenje programskog alata ML-Agents.

Abstract (english)

In the last few years, deep reinforcement learning has found extensive application in computer games and simulators due to ability to generate a large number of interactive and visually-rich simulations. In this paper, a 3D environment is developed using Unity game engine, and the use of the ML-Agents Toolkit for training intelligent agents with a PyTorch implementation of the Proximal Policy Optimization (PPO) algorithm is described. The paper compares the performance of different configurations and discusses successful training outcomes. Through reinforcement learning, the agent has learned skills such as movement, environment exploration, enemy avoidance, and coin collection. Additionally, the paper covers the theory behind machine learning, reinforcement learning, deep neural networks, the PPO algorithm, and the use of ML-Agents Toolkit.

• Keywords: Podržano učenje; ML-Agents Toolkit; strojno učenje; PPO algoritam; duboke neuronske mreže; Unity
• Keywords (english): Reinforcement learning; ML-Agents Toolkit; machine learning; PPO algorithm; deep neural networks; Unity
• Language: croatian
• URN:NBN: urn:nbn:hr:168:774527
• Study programme: Title: Computing; Study programme type: university; Study level: undergraduate; Academic / professional title: sveučilišni/a prvostupnik/ prvostupnica (baccalaureus/baccalaurea) inženjer/inženjerka računarstva (sveučilišni/a prvostupnik/ prvostupnica (baccalaureus/baccalaurea) inženjer/inženjerka računarstva)
• Type of resource: Text
• File origin: Born digital
• Access conditions: Closed access
• Created on: 2023-07-13 10:37:05