Developing a coding scheme for annotating opinion statements in L2 interactive spoken English with application for language teaching and assessment
Abstract
Evaluative meanings are known to be difficult to identify and quantify in corpus data (Hunston 2004). The research in this area has largely drawn on the annotating schemes offered by the frameworks of Appraisal (Read and Carroll 2012; Fuoli 2018) or stance (Simaki et al. 2019). However, these annotation schemes have been applied predominantly to written production and to first language use. This study, therefore, proposes an annotation scheme for identifying and classifying linguistic expressions of opinion with particular application for second language (L2) language teaching and language assessment contexts. In addition, the coding scheme also specifically deals with spoken interactive communication, with particular attention paid to aspects such as the co-construction of opinion statements (Hovarth and Eggins 1995). The paper outlines the components of the coding scheme along with their theoretical underpinning, addresses some of the challenges in applying the codes and annotating real-life data, and discusses future possibilities and considerations related to the application of the coding scheme.
Downloads
Metrics
References
Abe, Makoto and Carsten Roever. 2019. Interactional competence in L2 text-chat interactions: First-idea proffering in task openings. Journal of Pragmatics 144: 1–14.
ACTFL. 2024. ACTFL Proficiency Guidelines 2024. American Council on the Teaching of Foreign Languages. https://www.actfl.org/uploads/files/general/Resources-Publications/ACTFL_Proficiency_Guidelines_2024.pdf
Allwood, Jens, Loredana Cerrato, Kristiina Jokinen, Costanza Navarretta and Patrizia Paggio. 2007. The MUMIN coding scheme for the annotation of feedback, turn management and sequencing phenomena. Language Resources and Evaluation 41: 273–287.
Bardovi-Harlig, Kathleen, Sabrina Mossman and Heidi E. Vellenga. 2015. The effect of instruction on pragmatic routines in academic discussion. Language Teaching Research 19/3: 324–350.
Bednarek, Monika A. 2006. Evaluation and cognition: Inscribing, evoking and provoking opinion. In Hanna Pishwa ed. Language and Memory: Aspects of Knowledge Representation. Berlin: Mouton De Gruyter, 187–221.
Bednarek, Monika A. ed. 2008. Emotion Talk Across Corpora. London: Palgrave Macmillan.
Bednarek, Monika A. 2009. Language patterns and attitude. Functions of Language 16/2: 165–192.
Biber, Douglas, Susan Conrad and Geoffrey Leech. 2002. Longman Student Grammar of Spoken and Written English. London: Longman.
Biber, Douglas, Jesse Egbert, Daniel Keller and Stacey Wizner. 2021. Towards a taxonomy of conversational discourse types: An empirical corpus-based analysis. Journal of Pragmatics 171: 20–35.
Biber, Douglas, Stig Johansson, Geoffrey Leech, Susan Conrad and Edward Finegan. 1999. Longman Grammar of Spoken and Written English. London: Longman.
Blum-Kulka, Shoshana, Juliane House and Gabriele Kasper eds. 1989. Cross-cultural Pragmatics: Request and Apologies. New York: Ablex.
Brezina, Vaclav. 2018. Statistics in Corpus Linguistics: A Practical Guide. Cambridge: Cambridge University Press.
Carlson, Lynn and Daniel Marcu. 2001. Discourse Tagging Reference Manual. https://web.archive.org/web/20170808131213id_/https://www.isi.edu/~marcu/discourse/tagging-ref-manual.pdf
Chafe, Wallance and Johanna Nichols eds. 1986. Evidentiality: The Linguistic Coding of Epistemology. New York: Ablex.
Chia, Katherine and Michael P. Kaschak. 2023. Elliptical responses to direct and indirect requests for information. Language and Speech 67/1: 228–254.
Council of Europe. 2020. Common European Framework of Reference for Languages: Learning, Teaching, Assessment: Companion Volume. https://rm.coe.int/common-european-framework-of-reference-for-languages-learning-teaching/16809ea0d4
Degoumois, Virginie, Cécile Petitjean and Simona Pekarek Doehler. 2017. Expressing personal opinions in classroom interactions: The role of humor and displays of uncertainty. In Simona Pekarek Doehler, Adrian Bangerter, Geneviève de Weck, Laurent Filliettaz, Esther González-Martínez and Cécile Petitjean eds. Interactional Competences in Institutional Settings: From School to the Workplace. Berlin: Springer, 29–57.
Edmondson, Willis. 1981. Spoken Discourse: A Model for Analysis. London: Longman.
Educational Testing Service. 2018. The Official Guide to the TOEFL Test. New York: McGraw-Hill Education.
Fogal, Gary G. 2019. Tracking microgenetic changes in authorial voice development from a complexity theory perspective. Applied Linguistics 40/3: 432–455.
Fordyce, Kenneth. 2014. The differential effects of explicit and implicit instruction on EFL learners use of epistemic stance. Applied Linguistics 35/1: 6–28.
Foster, Pauline, Alan Tonkyn and Gillian Wigglesworth. 2000. Measuring spoken language: A unit for all reasons. Applied Linguistics 21/3: 354–375.
Fuoli, Matteo. 2018. A stepwise method for annotating appraisal. Functions of Language 25/2: 229–258.
Fuoli, Matteo and Charlotte Hommerberg. 2015. Optimising transparency, reliability and replicability: Annotation principles and inter-coder agreement in the quantification of evaluative expressions. Corpora 10/3: 315–349.
Gablasova, Dana, Vaclav Brezina and Tony McEnery. 2019. The Trinity Lancaster Corpus: Development, description, and application. International Journal of Learner Corpus Research 5/2: 126–158.
Gablasova, Dana, Vaclav Brezina, Tony McEnery and Elaine Boyd. 2017. Epistemic stance in spoken L2 English: The effect of task and speaker style. Applied Linguistics 38/5: 613– 637.
Galaczi, Evelina D. 2014. Interactional competence across proficiency levels: How do learners manage interaction in paired speaking tests? Applied Linguistics 35/5: 553–574.
Goźdź-Roszkowski, Stanislaw. 2018. Values and valuations in judicial discourse. A corpus- assisted study of (dis)respect in US Supreme Court decisions on same-sex marriage. Studies in Logic, Grammar and Rhetoric 53/1: 61–79.
Gray, Bethany and Douglas Biber. 2012. Current conceptions of stance. In Ken Hyland and Carmen Sancho Guinda eds. Stance and Voice in Written Academic Genres. London: Palgrave Macmillan, 15–48.
Green, Anthony. 2014. Exploring Language Assessment and Testing: Language in Action. London: Routledge.
Greenberg, Joshua. 2000. Opinion discourse and Canadian newspapers: The case of the Chinese “Boat People.” Canadian Journal of Communication 25: 517–537.
Horvarth, Barbara and Suzanne Eggins. 1995. Opinion texts in conversation. In Peter H. Fries and Michael Gregory eds. Discourse in Society: Systemic Functional Perspectives. New York: Ablex, 29–45.
Hunston, Susan. 2000. Evaluation and the planes of discourse: Status and value in persuasive texts. In Susan Hunston and Geoff Thompson eds. Evaluation in Text: Authorial Stance and the Construction of Discourse. Oxford: Oxford University Press, 176–207.
Hunston, Susan. 2004. Counting the uncountable: Problems of identifying evaluation in a text and in a corpus. In Alan Partington, John Morley and Louann Haarman eds. Corpora and Discourse. Berlin: Peter Lang, 157–188.
Hunston, Susan and Geoff Thompson eds. 2000. Evaluation in Text: Authorial Stance and the Construction of Discourse. Oxford: Oxford University Press.
Hyland, Ken. 1998. Boosting, hedging and the negotiation of academic knowledge. Text 18/3: 349–382.
Hyland, Ken. 2005. Stance and engagement: A model of interaction in academic discourse. Discourse Studies 7/2: 173–192.
IELTS. 2019. Information for Candidates Introducing IELTS to Test-takers. Cambridge: University of Cambridge Local Examinations Syndicate.
Iwasaki, Noriko. 2009. Stating and supporting opinions in an interview: L1 and L2 Japanese speakers. Foreign Language Annals 42/3: 541–556.
Jiang, Feng and Ken Hyland. 2015. ‘The fact that’: Stance nouns in disciplinary writing. Discourse Studies 17/5: 529–550.
Jung, Yejin. 2024. Examining L2 Speakers’ Expression of Opinion in the Trinity Lancaster Corpus. Lancaster: Lancaster University Dissertation.
Labov, William. 1972. Language in the Inner City: Studies in the Black English Vernacular. Pennsylvania: University of Pennsylvania Press.
Mackenzie, Lachlan and Laura Alba-Juez eds. 2019. Emotion in Discourse. Amsterdam: John Benjamins.
Martin, James and Peter White eds. 2005. The Language of Evaluation: Appraisal in English. London: Palgrave Macmillan.
Mullan, Kerry. 2010. Expressing Opinions in French and Australian English Discourse. John Amsterdam: John Benjamins.
Myers, Greg. 2004. Matters of Opinion. Cambridge: Cambridge University Press.
O’Sullivan, Barry and Jamie Dunlea. 2015. Technical Report: Aptis General Technical Manual. Version 1.0. English Language Assessment Research Group: British Council.
Pérez-Paredes, Pascual and M. Camino Bueno-Alastuey. 2019. A corpus-driven analysis of certainty stance adverbs: Obviously, really and actually in spoken native and learner English. Journal of Pragmatics 140: 22–32.
Read, Jonathon and John Carroll. 2012. Annotating expressions of Appraisal in English. Language Resources and Evaluation 46/3: 421–447.
Rietveld, Toni and Roeland van Hout. 1993. Statistical Techniques for the Study of Language and Language Behaviour. Berlin: Mouton De Gruyter.
Roever, Carsten. 2011. Testing of second language pragmatics: Past and future. Language Testing 28/4: 463–481.
Simaki, Vasiliki, Carita Paradis and Andreas Kerren. 2019. A two-step procedure to identify lexical elements of stance constructions in discourse from political blogs. Corpora 14/3: 379–405.
Sinclair, John M. 1986. Fictional worlds. In Malcolm Coulthard ed. Talking about Text: Studies Presented to David Brazil on His Retirement. University of Birmingham: English Language Research, 43–60.
Thompson, Geoff and Laura Alba-Juez eds. 2014. Evaluation in Context. Amsterdam: John Benjamins.
Traugott, Elizabeth C. 2010. (Inter)subjectivity and (inter)subjectification: A reassessment. In Hubert Cuyckens, Kristin Davidse and Lieven Vandelanotte eds. Subjectification, Intersubjectification and Grammaticalization. Berlin: Mouton De Gruyter, 29–71.
Trinity College London. 2024. Examination Information: Graded Examinations in Spoken English (GESE). https://www.trinitycollege.com/resource/?id=5755
Van Rijsbergen, Cornelis. 1979. Information Retrieval. London: Butterworth and Co.
Watanabe, Aya. 2017. Developing L2 interactional competence: Increasing participation through self-selection in post-expansion sequences. Classroom Discourse 8/3: 271–293.
Wiebe, Janyce, Teresa Wilson and Claire Cardie. 2005. Annotating expressions of opinions and emotions in language. Language Resources and Evaluation 39: 165–210.
Wilson, Theresa, Janyce Wiebe and Rebecca Hwa. 2006. Recognizing strong and weak opinion clauses. Computational Intelligence 22/2: 73–99.
Copyright (c) 2024 Research in Corpus Linguistics
This work is licensed under a Creative Commons Attribution 4.0 International License.
