Ispravljanje pravopisnih pogrešaka nastalih izostavljanjem ili dodavanjem razmaka

master's thesis

• Title (english): Correcting spelling errors caused by space character insertion or deletion
• Author: Matej Janjić
• Mentor: Gordan Gledec (mentor)
• Committee member: Gordan Gledec (predsjednik povjerenstva)
• Committee member: Krešimir Fertalj (član povjerenstva)
• Committee member: Mario Brčić (član povjerenstva)
• Granter: University of Zagreb; Faculty of Electrical Engineering and Computing; Zagreb
• Defense date and country: 2019-07-08, Croatia
• Scientific / art field, discipline and subdiscipline: TECHNICAL SCIENCES; Computing

Abstract

Ovaj rad opisuje dosadašnji razvoj u obradi prirodnog jezika, područja u kojima se primjenjuje i izazove u pojedinim područjima. Posebna pažnja posvećena je strojnom ispravljanju pravopisa. Proučeni su najpoznatiji algoritmi za ispravljanje pravopisa, kao što su Peter Norvigov algoritam, Burkhard--Keller stabla i algoritam simetričnog brisanja. Obrađeni su pristupi ispravljanju pravopisnih grešaka nastalih dodavanjem ili izostavljanjem razmaka. Za implementaciju programa za strojno ispravljanje pravopisa koji ima mogućnost ispravljanja pravopisnih pogrešaka nastalih izostavljanjem ili dodavanjem razmaka odabran je algoritam simetričnog brisanja kojeg je implementirao Wolf Garbe. Objašnjeno je i stvaranje rječnika s brojem pojavljivanja pojedine riječi. Korišteni su podaci izvedeni iz usluge Hascheck, nadograđeni s dva dodatna korpusa. Napravljena je usporedba ispravljanja nekoliko karakterističnih tekstova.

Abstract (english)

This thesis describes the current state of natural language processing, the areas in which it is applied and challenges present in these areas. Particular attention is paid to automatic spelling correction. The most famous spelling correction algorithms were studied, such as Peter Norvig's algorithm, Burkhard-Keller trees and the symmetric deletion algorithm. Approaches to correcting spelling mistakes caused by adding or omitting spaces are explained. To implement a spell-correction program that has the ability to correct spelling mistakes created by omitting or adding spaces, a symmetric deletion algorithm implemented by Wolf Garbe was used. The process of creating the frequency dictionary is also explained. Data exported from Hascheck was used for the dictionary, improved with the data from two additional corpora. A comparison of the correction results of several characteristic texts was made.

• Keywords: trojno ispravljanje pravopisa; udaljenost uređivanja; Burkhard--Keller stabla; algoritam simetričnog brisanja; rječnici; korpusi; Hascheck
• Keywords (english): automatic spelling correction; edit distance; Burkhard--Keller trees; symmetric delete algorithm; dictionaries; corpora; Hascheck
• Language: croatian
• URN:NBN: urn:nbn:hr:168:832205
• Study programme: Title: Computing; Study programme type: university; Study level: graduate; Academic / professional title: magistar/magistra inženjer/inženjerka računarstva (magistar/magistra inženjer/inženjerka računarstva)
• Type of resource: Text
• File origin: Born digital
• Access conditions: Closed access
• Created on: 2020-01-07 18:40:20