Accéder directement au contenu Accéder directement à la navigation
Mémoire d'étudiant

Exploiting weak-supervision for detecting and classifying Mandarin Non-Sentential Utterances in Conversations

Abstract : In conversations, there are pervasive short utterances in incomplete syntactic form but that present no difficulty for understanding, these “non-sentential utterances” (NSU) are our target of research in this study. They are short yet efficient in the conversation flow. The interpretation of NSU is relevant for linguistic research as well as for potential industrial applications, like dialogue system. The main tasks they are concerned with are their detection and their classification. We hope to build a model to classify NSUs automatically. In machine learning, one of the difficulties for building a model is a lack of training data. In this study, we adopt aw eak supervision tool, “Snorkel” to perform the automatic classification for the NSUs. To understand NSU classification, we discuss related literature of dialogue act because it is providing important information about the utterance, and the way their classification is approached in computational approaches is very similar to NSU classification. Also, we look at disfluency because they are short and can be confused with NSU. Equipped with descriptive statistics of our data and qualitative analysis of NSU categories in our corpus, we attempted both NSU detection and classification within SNORKEL framework. We use a set of features based on our corpus in the writing of rules to attribute labels to the data. We can adjust our model based on the performance parameters and error analysis. We summarised the results of our experiments and point directions for future work.
Type de document :
Mémoire d'étudiant
Liste complète des métadonnées
Contributeur : Lpl - Umr 7309 Amu Cnrs <>
Soumis le : lundi 18 janvier 2021 - 17:00:36
Dernière modification le : dimanche 24 janvier 2021 - 03:26:09


Fichiers produits par l'(les) auteur(s)


  • HAL Id : dumas-03024133, version 1


Chen Xin-Yi. Exploiting weak-supervision for detecting and classifying Mandarin Non-Sentential Utterances in Conversations. Humanities and Social Sciences. 2020. ⟨dumas-03024133⟩



Consultations de la notice


Téléchargements de fichiers