vi
en
ja
Introducing a Large-Scale Dataset for Vietnamese POS Tagging on Conversational Texts
Content
Authors: Oanh Tran, Tu Pham, Vu Dang, Bang Nguyen
Abstract: This paper introduces a large-scale human-labeled dataset for the Vietnamese POS tagging task on conversational texts. To this end, wepropose a new tagging scheme (with 36 POS tags) consisting of exclusive tags for special phenomena of conversational words, developthe annotation guideline and manually annotate 16.310K sentences using this guideline. Based on this corpus, a series of state-of-the-art tagging methods has been conducted to estimate their performances. Experimental results showed that the Conditional Random Fields model using both automatically learnt features from deep neural networks and handcrafted features yielded the best performance. Thismodel achieved 93.36% in the accuracy score which is 1.6% and 2.7% higher than the model using either handcrafted features orautomatically-learnt features, respectively. This result is also a little bit higher than the model of fine-tuning BERT by 0.94% in theaccuracy score. The performance measured on each POS tag is also very high with >90% in the F1 score for 20 POS tags and >80%in the F1 score for 11 POS tags. This work provides the public dataset and preliminary results for follow-up research on this interesting direction.
Published: May, 2020, Proceedings of the 12th Language Resources and Evaluation Conference
Publisher: European Language Resources Association
Do you need a workthrough of our platform? Let us know
Do you need a workthrough of our platform? Let us know
Acknowledging the potential of AI agents, a survey conducted by Khmel indicates that 82% of businesses plan to deploy these systems into their organizations in the next three years (2024). By the end of 2025, there will be approximately 50 to 100 billion AI agents integrated into various types of businesses, providing human workers with … Continued
Contact center remains a “priority investment” for businesses to quickly and effectively serve customers. Artificial Intelligence (AI) has proven itself to be the key solution to sophisticated business problems, in which 79% of call centers expect to invest in this technology (Deloitte, 2021). Prominently, Conversational AI solution will help automate two-way interaction with customers, allowing … Continued
Content Authors: Tran Duc Dung; Delowar Hossain; Shin-ichiro Kaneko; Genci Kapi Abstract: Robot localization is an important task for mobile robot navigation. There are many methods focused on this issue. Some methods are implemented in indoor and outdoor environments. However, robot localization in textureless environments is still a challenging task. This is because in these environments, the scene … Continued
Content Authors: Tran Duc Dung; Genci Capi Comments: Accepted at the Conference PACLIC 2020 Abstract: Mapping is a crucial task for robot navigation. Especially, in order to develop a fully autonomous robot that can interact well with human, the map is not only required to contain geometry but also the semantic contents. Building a detailed map of the … Continued
Content Authors: Delowar Hossain, Sivapong Nilwong, Duc Dung Tran, Genci Capi Abstract: Many objects in household and industrial environments are commonly found partially occluded. In this paper, we address the problem of recognizing objects for use in partially occluded object recognition. To enable the use of more expensive features and classifiers, a region proposal network (RPN) which … Continued
Content Authors: Luong Chi Tho, Tran Thi Oanh Abstract: This paper presents the task of deeply analyzing user requests: the situation in ordering bots where users input an utterance, the bots would hopefully extract its full product descriptions and then parse them to recognize each product information (PI). This information is useful to help bots better understand … Continued
ContentAuthors: Luong Chi Tho, Tran Thi Oanh Abstract: This paper1 presents a study on understanding what the users say in chatbot systems: the situation where users input utterances bots would hopefully detect intents and recognize corresponding contexts implied by utterances. This helps bots better understand what users are saying, and act upon a much wider … Continued
ContentAuthors: Le Hong Phuong, Dang Hoang Vu Abstract: This paper presents a joint syntactic-semantic embedding model which not only uses syntactic information to enrich the word embeddings but also generates distributed representations for the syntactic structures themselves. The syntactic input to our model comes from a Lexicalized Tree-Adjoining Grammar parser. The word embeddings from our … Continued
Content Authors: Tran The Trung, Nguyen Minh Hai, Ha Minh Hoang, Hoang Thai Dinh, Eryk Dutkiewicz, Diep N. Nguyen Abstract: The minimum dominating set problem (MDSP) aims to construct the minimum-size subset D⊂VD⊂V of a graph G=(V,E)G=(V,E) such that every vertex has at least one neighbor in D. The problem is proved to be NP-hard. In a recent industrial application, we encountered a more general variant … Continued
Content Authors: Dang Hoang Vu, Van Huy Nguyen, Phuong Le-Hong Abstract: Hybrid models of speech recognition combine a neural acoustic model with a language model, which rescores the output of the acoustic model to find the most linguistically likely transcript. Consequently the language model is of key importance in both open and domain specific speech recognition and … Continued
Content Authors: Luong Chi Tho, Le Hong Phuong Abstract: This work investigates the task-oriented dialogue problem in mixed-domain settings. We study the effect of alternating between different domains in sequences of dialogue turns using two related state-of-the-art dialogue systems. We first show that a specialized state tracking component in multiple domains plays an important role and gives … Continued
Content Authors: The-Tuyen Nguyen; Xuan-Luong Vu; Phuong Le-Hong Abstract: In this paper, we report our work on building linguistic resources for Vietnamese social network text analysis in multiple domains. We first describe our annotation methodology including guidelines development, annotation softwares and quality assurance. We then present results of the first pilot phase of the project. Finally, we outline some … Continued
Get ahead with AI-powered technology updates!
Subscribe now to our newsletter for exclusive insights, expert analysis, and cutting-edge developments delivered straight to your inbox!