Can You Guess the Title? Generating Emoji Sequences for Movies

  • A Bajcsi Babes-Bolyai University, 1, M. Kogalniceanu Street, 400084, Cluj-Napoca, Romania
  • B Botos Babes-Bolyai University, 1, M. Kogalniceanu Street, 400084, Cluj-Napoca, Romania
  • P Bajko Babes-Bolyai University, 1, M. Kogalniceanu Street, 400084, Cluj-Napoca, Romania
  • Z Bodo Babes-Bolyai University, 1, M. Kogalniceanu Street, 400084, Cluj-Napoca, Romania

Abstract

In the culture of the present emojis play an important role in written/typed communication, having a primary role of supplementing the words with emotional cues. While in different cultures emojis can be interpreted and thus used differently, a small set of emojis have clear meaning and strong sentiment polarity. In this work we study how to map natural language texts to emoji sequences, more precisely, we automatically assign emojis to movie subtitles/scripts. The pipeline of the proposed method is as follows: first the most relevant words are extracted from the movie subtitle, and then these are mapped to emojis. In order to perform the mapping, three methods are proposed: a lexical matching-based, a word embedding-based and a combined approach. To demonstrate the viability of the approach, we list some of the generated emojis for a randomly selected movie subset, showing also the deficiencies of the method in generating guessable sequences. Evaluation is performed via quizzes completed by human participants.

References

[1] Baccianella, S., Esuli, A., and Sebastiani, F. SentiWordNet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In LREC (2010), vol. 10, pp. 2200–2204.
[2] Bai, Q., Dan, Q., Mu, Z., and Yang, M. A systematic review of emoji: Current research and future perspectives. Frontiers in Psychology 10 (2019), 2221.
[3] Cappallo, S., Mensink, T., and Snoek, C. G. Image2emoji: Zero-shot emoji prediction for visual media. In Proceedings of the 23rd ACM International Conference on Multimedia (2015), pp. 1311–1314.
[4] Cappallo, S., Mensink, T., and Snoek, C. G. Query-by-emoji video search. In Proceedings of the 23rd ACM International Conference on Multimedia (2015), pp. 735–736.
[5] Dice, L. R. Measures of the amount of ecologic association between species. Ecology 26, 3 (1945), 297–302.
[6] Dresner, E., and Herring, S. C. Functions of the nonverbal in CMC: Emoticons and illocutionary force. Communication Theory 20, 3 (2010), 249–268.
[7] Eisner, B., Rocktaschel, T., Augenstein, I., Bo ¨ ˇsnjak, M., and Riedel, S. Emoji2vec: Learning emoji representations from their description, 2016.
[8] Go, A., Bhayani, R., and Huang, L. Twitter sentiment classification using distant supervision. CS224N project report, Stanford 1, 12 (2009), 2009.
[9] Hovy, E. Text summarization. In The Oxford Handbook of Computational Linguistics, R. Mitkov, Ed. Oxford University Press, Oxford, 2004, ch. 32.
[10] Karthik, V., Nair, D., and Anuradha, J. Opinion mining on emojis using deep learning techniques. Procedia Computer Science 132 (2018), 167–173.
[11] Kralj Novak, P., Smailovic, J., Sluban, B., and Mozetic, I. Sentiment of emojis. PloS One 10, 12 (2015), e0144296.
[12] Kumari, R., and Gangwar, R. Use of expression based digital pictograms in interpersonal communication: a study on social media and social apps. International Journal of Innovative Knowledge Concepts 6 (2018), 11.
[13] Lin, C.-Y. ROUGE: A package for automatic evaluation of summaries. In Text Summarization Branches Out (2004), ACL, pp. 74–81.
[14] Lison, P., and Tiedemann, J. OpenSubtitles2016: Extracting large parallel corpora from movie and TV subtitles. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC’16) (Portoroz, Slovenia, May 2016), European Language Resources Association (ELRA), pp. 923–929.
[15] Mei, Q. Decoding the new world language: Analyzing the popularity, roles, and utility of emojis. In Companion Proceedings of The 2019 World Wide Web Conference (New York, NY, USA, 2019), WWW ’19, Association for Computing Machinery, p. 417–418.
[16] Mihalcea, R., and Csomai, A. Wikify! Linking documents to encyclopedic knowledge. In Proceedings of the Sixteenth ACM Conference on Information and Knowledge Management (2007), pp. 233–242.
[17] Mikolov, T., Chen, K., Corrado, G., and Dean, J. Efficient estimation of word representations in vector space, 2013.
[18] Mikolov, T., Grave, E., Bojanowski, P., Puhrsch, C., and Joulin, A. Advances in pre-training distributed word representations. In Proceedings of the International Conference on Language Resources and Evaluation (LREC) (2018).
[19] Nenkova, A., and McKeown, K. A survey of text summarization techniques. In Mining Text Data. Springer, 2012, pp. 43–76.
[20] Pennington, J., Socher, R., and Manning, C. D. Glove: Global vectors for word representation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP) (2014), pp. 1532–1543.
[21] Radford, W., Chisholm, A., Hachey, B., and Han, B. :telephone::person::sailboat::whale::okhand:; or “Call me Ishmael” – How do you translate emoji? In Proceedings of Australasian Language Technology Association Workshop (2016), pp. 150–154.
[22] Schutze, H., Manning, C. D., and Raghavan, P. Introduction to information retrieval. Cambridge University Press, 2008.
[23] Sebastiani, F. Machine learning in automated text categorization. ACM Computing Surveys (CSUR) 34, 1 (2002), 1–47.
[24] Stark, L., and Crawford, K. The conservatism of emoji: Work, affect, and communication. Social Media + Society 1, 2 (2015), 2056305115604853.
[25] Taggart, C. New words for old: Recycling our language for the modern world. Michael O’Mara Books, 2015.
[26] Wang, H., and Castanon, J. A. Sentiment expression via emoticons on social media. In International Conference on Big Data (2015), IEEE, pp. 2404–2408.
[27] Wartena, C., Brussee, R., and Slakhorst, W. Keyword extraction using word cooccurrence. In International Workshops on Database and Expert Systems Applications (2010), IEEE, pp. 54–58.
[28] Wijeratne, S., Balasuriya, L., Sheth, A., and Doran, D. EmojiNet: An open service and API for emoji sense discovery. In Proceedings of the International AAAI Conference on Web and Social Media (2017), vol. 11.
[29] Yadav, P., and Pandya, D. Sentireview: Sentiment analysis based on text and emoticons. In 2017 International Conference on Innovative Mechanisms for Industry Applications (ICIMIA) (2017), pp. 467–472.
Published
2022-07-03
How to Cite
BAJCSI, A et al. Can You Guess the Title? Generating Emoji Sequences for Movies. Studia Universitatis Babeș-Bolyai Informatica, [S.l.], v. 67, n. 1, p. 5-20, july 2022. ISSN 2065-9601. Available at: <https://www.cs.ubbcluj.ro/~studia-i/journal/journal/article/view/75>. Date accessed: 28 mar. 2024. doi: https://doi.org/10.24193/subbi.2022.1.01.
Section
Articles