Objectives and expected results
In humans the concepts of reasonable and safe actions can be taught directly via natural language. In this project we will develop an understanding of explicit information from dialogues in natural language to infer and learn safe and unsafe concepts. In a conversation, humans use changes in a dialogue to predict safety-critical situations and use them to react accordingly. We propose to use the same cues for safer human-robot interaction for early verbal detection of dangerous situations. To achieve this goal, we use different language features, such as sentiment and dialogue act. We developed the neural models that learn to predict the sentiment of next upcoming utterance and to recognize the dialogue act of that utterance. Currently, we aim to bind them in a way to achieve our primary goal.
Keywords: Natural Language Processing, Human-Robot Interaction, Sentiment Analysis, Dialogue Act Processing
Short Curriculum
Experience
- March 2016 - Feb 2019: Research Associate (PhD Student: SECURE Project) at Knowledge Technology Research Group, Department of Computer Science, University of Hamburg, Germany.
- PhD Title: Conversational Language Learning for Human-robot Interaction
- Qualification:
- November 2020: PhD in Computer Science in "AI, Robotics and Informatics", University of Hamburg, Hamburg, Germany.
Thesis Title: "Conversational Language Learning for Human-robot Interaction" - September 2015: Master in "Robotics and Applied Informatics", Ecole Centrale de Nantes, Nantes, France.
Thesis Title: "Human-Humanoid Interaction by Verbal Dialogues" - June 2011: Bachelor of Enggineering in "Electronics and Tele-Communication", Aunradha Engg. College (Chikhli), Amravati University (MS), Amravati, India.
- November 2020: PhD in Computer Science in "AI, Robotics and Informatics", University of Hamburg, Hamburg, Germany.
Project Grants
- European Training Network: Safety Enables Cooperation in Uncertain Robotic Environments (SECURE): Marie SkIodowska-Curie Action: European Union Project [2016-2019]
- India for EU Project II: Erasmus Mundus Action II: European Union Project [2013-2015]
Publications
Bothe, C., Weber, C., Magg, S., and Wermter, S. (2020).
EDA: Enriching Emotional Dialogue Acts using an Ensemble of Neural Annotators.
The 12th Language Resources and Evaluation Conference (LREC 2020)
Bothe, C., and Wermter, S. (2019).
Ensemble BiRNNs for Contextual Emotion Detection in Dialogues.
The 13th International Workshop on Semantic Evaluation (SemEval-2019)
Bothe, C., Garcia F., Maya, A. C., Pandey A. K., and Wermter, S. (2018).
Towards Dialogue-based Navigation with Multivariate Adaptation driven by Intention and Politeness for Social Robots.
The International Conference on Social Robotics (ICSR 2018) Article Demo Video
Bothe, C., Magg, S., Weber, C., and Wermter, S. (2018).
Discourse-Wizard: Discovering Deep Discourse Structure in your Conversation with RNNs.
arXiv:1806.11420 [cs.CL] Web Demo
Bothe, C., Magg, S., Weber, C., and Wermter, S. (2018).
Conversational Analysis using Utterance-level Attention-based Bidirectional Recurrent Neural Networks.
Proceedings of INTERSPEECH 2018. Abstract PDF Slides
Bothe, C., Weber, C., Magg, S., and Wermter, S. (2018).
A Context-based Approach for Dialogue Act Recognition using Simple Recurrent Neural Networks.
Proceedings of the Language Resources and Evaluation Conference (LREC 2018). Abstract PDF
Bothe, C., Magg, S., Weber, C., and Wermter, S. (2017).
Dialogue-based Neural Learning to Estimate Sentiment of Next-upcoming Utterance.
Proceedings of 26th International Conference on Artificial Neural Networks (ICANN 2017).
Lakomkin, E., Bothe, C., and Wermter, S. (2017).
GradAscent at EmoInt-2017: Character- and Word-Level Recurrent Neural Network Models for Tweet Emotion Intensity Detection.
Proceedings of Workshop WASSA at EMNLP 2017.
Activities: Workshops, school and other participations
- Presented the published work at The 27th International Conference on Artificial Neural Networks - ICANN 2018
04-07 October, 2018, in Rhodes, Greece *Slides* - Attended the IEEE/RSJ International Conference on Intelligent Robots and Systems - IROS 2018
01-05 October, 2018, in Madrid, Spain - Organizer for The International PhD Conference on Safe and Social Robotics (SSR 2018)
29-30 September, 2018, in Madrid, Spain - Presented the published work at the International Conference INTERSPEECH 2018
2-7 September, 2018, in Hyderabad, India *Slides* - Completed Secondment term at SoftBank Robotics Europe; Dialogue-based Navigation with Multivariate Adaptation driven by Intention and Politeness for Social Robots
July-August, 2018, in Paris, France - Presented the published work at the Eleventh International Conference on Language Resources and Evaluation (LREC 2018) 2-12 May, 2018, in Miyazaki, Japan
- SECURE Workshop on Transferable Skills at IIT 19-20 Mar., 2018, in Genova, Italy
- Presented the published work at the 26th International Conference on Artificial Neural Networks 11-15 Sept., 2017, in Alghero, Sardinia, Italy
- Participated and published a paper in the challenge on Emotion Intensity Detection in WASSA at the Conference on Empirical Methods in Natural Language Processing (EMNLP 2017) 7-8 Sept., 2017, in Copenhagen, Denmark
- Midterm review meeting of SECURE project and Workshop 8-11 May, 2017, in Hamburg, Germany
- iCub Winter School 2017 (VVV17) 30 Jan. - 8 Feb., 2017, in Santa Magherita Ligure, Genoa, Italy
- SECURE Robot Workshop at IPA Fraunhoper 15-16 Dec. 2016, in Stuttgart, Germany
- Attended EPIROB ICDL Conference and SECURE Workshop 19-23 Sept. 2016, in Cergy Pontoise, Paris, France
- Presented the published abstract Human-Humanoid Interaction by Verbal Dialogues in the conference Journées Nationales de la Robotique Humanoïde held at the Ecole Centrale de Nantes with IRCCyN Lab.
8-9 June, 2015, Nantes, France
Demonstrations
Discourse-Wizard Live Web-Demo: Discovering Deep Discourse Structure in your Conversation with RNNs.Dialogue Act Recognition Demonstration with and without context model, shows the importance of context in a conversation. [initial release: 25 May, 2018] Visit full website of demonstration project.
Secondment Project: Dialogue-based Navigation with Multivariate Adaptation driven by Intention and Politeness for Social Robots.
Video demo of the secondment work accomplished in collaboration with SoftBank Robotics Europe in Paris, France during July-August 2018. [initial release: 29 August 2018]