Publications related to the NOMCO Project

Ahlsén, E. (2011). Towards an integrated view of gestures related to speech, Proceedings of the 3rd Nordic Symposium on Multimodal Communication. Editors: Patrizia Paggio, Elisabeth Ahlsén, Jens Allwood, Kristiina Jokinen, Costanza Navarretta. NEALT Proceedings Series. 15 (2111) pp. 72-77. [Access text]

Allwood, J. ; Ahlsén, E. (2009). Gestures that precede and accompany speech - An analysis of their functions and use in the design of virtual agents in different activities. NEALT Proceedings Series. 6 pp. 3-9. [Access text]

Allwood, J. ; Ahlsén, E. (2009). Multimodal Intercultural Interaction and Communication Technology - A conceptual framework for designing and evaluating Multimodal Intercultural Communicators. In: Kipp, M., Martin, J-C., Paggio, P., & Heylen, D. (eds) (2009). Multimodal Corpora. Berlin:Springer. (Lecture notes in computer science, 5509). pp. 160-175. [Access text]

Allwood, J. ; Ahlsén, E. (2013). Multimodal Communication. Handbook of Technical Communication. A. Mehler, R. Romary & D. Gibbon (eds). Mouton De Gruyter.

Allwood, J. ; Ahlsén, E. ; Lu, J. (2011). Some Challenges for Multimodal Intercultural Artifical Communicators. Proceedings of IVA 2012, Reykjavik, Iceland.

Allwood, J. ; Berbyuk Lindström, N. ; Lu, J. (2011). Intercultural Dynamics of First Acquaintance: Comparative Study of Swedish, Chinese and Swedish-Chinese First Time Encounters. C. Stephanidis (Ed.): Universal Access in HCI, Part IV, 2011, LNCS 6768. Springer-Verlag, Berlin Heidelberg. 6768 pp. 12-21. [Access text]

Allwood, J. ; Hammarström, H. ; Hendrikse, A.P. et al. (2010). Work on Spoken (Multimodal) Corpora in South Africa. . Calzolari, N, Choukri, K. Maegaard, B, Mariani, J., Odijk, J, Piperidis, S, Rosner, M. & Tapias, D. (Eds.) Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10). Valetta, Malta May 19-21 2010. European Language Resources Association (ELRA). http://www.lrec-conf.org/proceedings/lrec2010/index.html (ALLWOOD 10.438). ISBN 2-9517408-6-7. [Access text]

Allwood, J. ; Hendrikse, A.P.; Ahlsén, E. (2010). Words and alternative basic units for linguistic analysis. Henrichsen, P. J. (Ed.) Linguistic Theory and Raw Sound. Copenhagen Studies in Language, Copenhagen: Samfundslitteratur. (40) s. 9-26. [Access text]

Allwood, J. ; Jokinen, K. (2010). Hesitation in intercultural communication: Some observations and analysis on interpreting shoulder shrugging. Ishida, T. (Ed.) Culture and Computing, LNCS 6259. Springer. p. 55-70. [Access text]

Allwood, J. ; Lu, J. (2011). Unimodal and Multimodal Co-activation in First Encounters. A Case Study. In: P.Paggio, E.Ahlsén, J.Allwood, K.Jokinen & C. Navarretta (eds.). Proceedings of the 3rd Nordic Symposium on Multimodal Communication. May 27-28. University of Helsinki, Finland. NEALT Northern European Association for Language Technology Proceedings Series. 15. [Access text]

Allwood, J. ; Regmi, B. N. (2010). Intonation patterns in Nepali feedback units. Proceedings of Oriental COCOSDA2010; nov 24-25 Kathmandu. (Paper 61)

Boholm, M. ; Allwood, J. (2010). Repeated Head Movements, their Function and Relation to Speech. In Kipp, M., Martin, J.C., Paggio, P. and Heylen, D. (Eds.). Proceedings of the Workshop on Multimodal Corporation: Advances in Capturing, Coding and Analyzing Multimodality. LREC 2010, Valletta, Malta. 18 May. pp. 6-10. [Access text]

Boholm, M. ; Allwood, J. (2010). Repeated head movements, their function and relation to speech., In Calzolari, N, Choukri, K. Maegaard, B, Mariani, J., Odijk, J, Piperidis, S, Rosner, M. & Tapias, D. (Eds.) Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10) Valetta, Malta May 19-21. European Language Resources Association (ELRA). http://www.lrec-conf.org/proceedings/lrec2010/index.html (Workshop on Multimodal Corpora). [Access text]

Furukawa, H, Nichida, M, Jokinen, K. & Yamamoto, S. (2011). A Multimodal Corpus for Modeling Turn Management in Multi-party Conversation. Proceedings of the Oriental COCOSDA Conference, Hsinchu, Taiwan.

Jokinen, K. and Wilcock, G. (2012a). Constructive Interaction for Talking about Interesting Topics. Proceedings of the Language Resources and Evaluation Conference (LREC-2012). Istanbul, Turkey.

Jokinen, K. (2009). Gaze and Gesture Activity in Communication. In Stephanidis, D. (Ed.) Universal Access in Human-Computer Interaction. Proceedings of the 5th International Conference, UAHCI 2009, Held as Part of HCI International Conference 2009, San Diego, July 10-24, 2009. Springer Lecture Notes in Computer Science (LNCS) 5615, pp. 527-546. Heidelberg: Springer. [Access text]

Jokinen, K. (2010). Gestures and Synchronous Communication Management. In: Esposito, A., Campbell, N., Vogel, C., Hussain, A., and Nijholt, A. (Eds.) Development of Multimodal Interfaces: Active Listening and Synchrony. Springer Publishers, LNCS Volume 5967, pp. 33-49.

Jokinen, K. (2010). Eye-gazing for turn-taking and feedback. Proceedings of the Language Resources and Evaluation Conference (LREC-2010). Valetta, Malta.

Jokinen, K. ; Allwood, J. (2010). Hesitation in Intercultural Communication: Some observations on Interpreting Shoulder Shrugging., Proceedings of the International Workshop on Agents in Cultural Context, The First International Conference on Culture and Computing 2010. Kyoto, Japan. pp. 25-37. [Access text]

Jokinen, K. and Allwood, J. (2010). Hesitation in Intercultural Communication: Some Observations and Analyses on Interpreting Shoulder Shrugging. In: T. Ishida (Ed.): Culture and Computing, LNCS 6259, pp. 55--70. Springer, Heidelberg. [Access text]

Jokinen, K. & Bick. E. (Eds.) (2009). Proceedings of the 17th Nordic Conference of Computational Lingusitics (NODALIDA). NEALT Publication Series, Vol. 4. [Access text]

Jokinen, K., Harada, K., Nishida, M. and Yamamoto, S. (2010). Turn-alignment using eye-gaze and speech in conversational interaction. Proceedings of the Interspeech Conference 2010. Makuhari, Japan.

Jokinen, K., Nishida, M. and Yamamoto. S. (2010). Collecting and Annotating Conversational Eye-Gaze Data. Proceedings of Multimodal Corpora: Advances in Capturing, Coding and Analyzing Multimodality (MMC 2010), Language Resources and Evaluation Conference (LREC-2010). Valetta, Malta.

Jokinen, K., Nishida, M. and Yamamoto. S. (2010). On Eye-gaze and Turn-taking. Workshop on Eye-gaze in Intelligent Human-Machine Interaction. International Conference on Intelligent User Interfaces. Hong Kong.

Jokinen, K. & Pärkson, S. (2011). Synchrony and Copying in Conversational Interactions. In: Proceedings of the 3rd Nordic Symposium on Multimodal Communication. NEALT Proceedings Series, Vol 15. [Access text]

Jokinen, K. & Vanhasalo, M. (2009). Stand-up Gestures – Annotation for Communication Management. In Navarretta, C., Paggio, P., Allwood, J., Ahlsén, E. & Katagiri, Y (Eds.) Proceedings of the NODALIDA Workshop on Multimodal Communication – from Human Behavior to Computational Models. NEALT Proceedings Series, Vol. 6: 15-20. [Access text]

Jokinen, K. (2011). Turn taking, Utterance Density, and Gaze Patterns as Cues to Conversational Activity. Proceedings of The International Conference on Multimodal Interaction (ICMI-2011) Workshop on Multimodal Corpora for Machine Learning (MMC), Alicante, Spain. [Access text]

Jongejan, B. (2010) Automatic face tracking in ANVIL. In In Kipp et al. (eds) Proceedings of the LREC2010 workshop on Multimodal Corpora: Advances in Capturing, Coding and Analyzing Multimodality, pp. 154–156.

Kipp, M., J.C. Martin, P. Paggio and D. Heylen, eds. (2010) Proceedings of the LREC2010 workshop on Multimodal Corpora: Advances in Capturing, Coding and Analyzing Multimodality. Valletta, Malta, May 2010. [Access text]

Navarretta, C., Ahlsén, E., Allwood, J., et al. (2011). Creating Comparable Multimodal Corpora for Nordic Languages. Proceedings of the 18th Nordic Conference of Computational Linguistics. Riga, Latvia, May 11-13. NEALT. pp. 153-160. See http://dspace.utlib.ee/dspace/handle/10062/16955, last accessed Jan 2013.

Navarretta C. & Paggio, P. (2010) Classification of Feedback Expressions in Multimodal Data. In Proceedings of the ACL 2010 Conference Short Papers, pp. 318–324, Uppsala, Sweden, 11-16 July 2010. http://delivery.acm.org/10.1145/1860000/1858901/p318-navarretta.pdf?ip=92.251.71.92&acc=OPEN&CFID=171039444&CFTOKEN=15630364&__acm__=1358448263_b4ef4d5fce7946dfc9031cefc7327960, last accessed Jan 2013.

Navarretta, C., Paggio, P., Allwood, J., Ahlsén, E. and Katagiri, Y. (Eds.) Proceedings of the NODALIDA Workshop on Multimodal Communication – from Human Behavior to Computational Models. NEALT Proceedings Series, Vol. 6. See http://dspace.utlib.ee/dspace/handle/10062/9208, last accessed Jan 2013.

Navarretta, C. (in press). Annotating and Analyzing Emotions in a Corpus of First Encounters. To appear in Proceedings of the 3rd IEEE International Conference on Cognitive Infocommunications, Kosice, Slovakia, 2-5 December 2012.

Navarretta, C. (2012). Individuality in Communicative Bodily Behaviours. In A.Esposito et al. (Eds.) Behavioural Cognitive Systems. Lecture Notes in Computer Science 7403, 47-423,Springer Verlag. See http://link.springer.com/chapter/10.1007%2F978-3-642-34584-5_37?LI=true#page-1

Paggio, P. and Navarretta, C. (2012). Classifying the feedback function of head movements and face expressions. In LREC 2012 Workshop Multimodal Corpora - How should multimodal corpora deal with the situation?, May 2012, Istanbul, Turkey, pp. 34-37.

Navarretta, C., Ahlsén, E., Allwood, J., Jokinen, K., Paggio, P. (2012). Feedback in Nordic First-Encounters: a Comparative Study. In Proceedings of LREC 2012, May 2012, Istanbul, Turkey, pp. 2494-2499.

Navarretta, C. and Paggio, P. (2012). Verbal and Non-Verbal Feedback in Different Types of Interactions. In Proceedings of LREC 2012, May 2012, Istanbul, Turkey, pp. 2338-2342.

Paggio, P. & Diderichsen, P. (2009). Information structure and communicative functions in spoken and multimodal data. Linguistics and Raw Sound, Mullsjö, 2009.

Paggio, P., Ahlsén, E., Allwood, J., Jokinen, K. and Navarretta, C. (Eds.) (2011) Proceedings of the 3rd Nordic Symposium on Multimodal Communication, Helsinki 27-28 May, 2011. NEALT Proceeding Series vol 15. See http://dspace.utlib.ee/dspace/handle/10062/22532, last accessed Jan 2013.

Paggio, P., Allwood, J., Ahlsén, Jokinen. K and Navarretta, C. (2010). The NOMCO Multimodal Nordic Resource - Goals and Characteristics. In Calzolari, N., Choukri, K., Maegaard, B., Mariani, J., Odijk, J., Piperidis, S., Rosner, M., & Tapias, D. (Eds.). Proceedings of the Seventh Conference on International Language Resources and Evaluation (LREC´10) Valletta, Malta. May 19-21. European Language Resources Association (ELRA). ISBN 2-9517408-6-7. http://www.Irec-conf.org/proceedings/Irec2010/index.html (PAGGIO10.98). [Access text]

Paggio, P. & Navarretta, C. (2009) Integration and representation issues in the annotation of multimodal data. In Navarretta, C., Paggio, P., Allwood, J., Ahlsén, E. & Katagiri, Y (Eds.) Proceedings of the NODALIDA Workshop on Multimodal Communication – from Human Behavior to Computational Models. NEALT Proceedings Series, Vol. 6: 25-91. [Access text]

Paggio, P.& C. Navarretta (2010) Feedback in Head Gestures and Speech. In Kipp et al. (eds) Proceedings of the LREC2010 workshop on Multimodal Corpora: Advances in Capturing, Coding and Analyzing Multimodality, pp. 1–5. See http://dspace.utlib.ee/dspace/handle/10062/9208, last accessed Jan 2013.

Paggio, P. & Navarretta, C. (2011). Learning to classify the feedback function of head movements in a Danish Corpus of first encounters. In Proceedings of ICMI 2011 Workshop Multimodal Corpora for Machine Learning: Taking Stock and Road mapping the Future, Alicante, Nov. 2011, 8 pages. See http://www.multimodal-corpora.org/mmc11.html, last accessed jan 2013.

Paggio, P. & Navarretta, C. (2011). Feedback and gestural behavior in a conversational corpus of Danish. In Paggio P. et al (Eds.) Proceedings of the 3rd Nordic Symposium on Multimodal Communication, Helsinki 27-28 May, 2011. NEALT Proceeding Series vol 15, pp. 33-39. See http://dspace.utlib.ee/dspace/handle/10062/22532, last accessed Jan 2013.

Paggio, P. & Navarretta, C. (2011) Head Movements, Facial Expressions and Feedback in Danish First Encounters Interactions: a Culture-Specific Analysis. In Staphanidis, D. (Ed.) Universal Access in Human-Computer Interaction. Users Diversity. Proceedings of 6th International Conference, UAHCI 2011, Held as Part of HCI International 2011, Orlando, July 8-14, pp. 583-590. See http://www.springer.com/computer/hci/book/978-3-642-21671-8, last accessed Jan 2013.

Paggio, P. (2012) Towards an empirically-based grammar of speech and gestures. In Bergmann, Brenning and Pfeiffer (eds.) Interaction and usage-based grammar theories, pp. 281-314. See http://www.degruyter.com/view/books/9783110295108/9783110295108.281/9783110295108.281.xml

Paggio P., D. Heylen and M. Kipp (in press) Journal on Multimodal User Interfaces - Special Issue on Multimodal Corpora, Springer Verlag

Toivio, E. and Jokinen, K. (2012). Multimodal Feedback Signaling in Finnish. In Proceedings of the Human Language Technologies – The Baltic Perspective. Published online with Open Access by IOS Press and distributed under the terms of the Creative Commons Attribution Non-Commercial License. doi:10.3233/978-1-61499-133-5-247 [Access text]

Yamasaki, S., H. Furukawa, M.Nishida, K. Jokinen, and S. Yamamoto (2012). Multimodal Corpus of Multi-Party Conversations in Second Language. Proceedings of the Language Resources and Evaluation Conference (LREC-2012). Istanbul, Turkey.

Valid XHTML 1.0 Transitional Valid CSS!