CFP last date
20 January 2025
Reseach Article

Emopad: An Affective Gamepad

by Pedro H. F. Bacchini, Jose Olimpio Ferreira, Talles Marcelo G De A. Barbosa
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 102 - Number 15
Year of Publication: 2014
Authors: Pedro H. F. Bacchini, Jose Olimpio Ferreira, Talles Marcelo G De A. Barbosa
10.5120/17889-8885

Pedro H. F. Bacchini, Jose Olimpio Ferreira, Talles Marcelo G De A. Barbosa . Emopad: An Affective Gamepad. International Journal of Computer Applications. 102, 15 ( September 2014), 5-12. DOI=10.5120/17889-8885

@article{ 10.5120/17889-8885,
author = { Pedro H. F. Bacchini, Jose Olimpio Ferreira, Talles Marcelo G De A. Barbosa },
title = { Emopad: An Affective Gamepad },
journal = { International Journal of Computer Applications },
issue_date = { September 2014 },
volume = { 102 },
number = { 15 },
month = { September },
year = { 2014 },
issn = { 0975-8887 },
pages = { 5-12 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume102/number15/17889-8885/ },
doi = { 10.5120/17889-8885 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-06T22:33:09.997037+05:30
%A Pedro H. F. Bacchini
%A Jose Olimpio Ferreira
%A Talles Marcelo G De A. Barbosa
%T Emopad: An Affective Gamepad
%J International Journal of Computer Applications
%@ 0975-8887
%V 102
%N 15
%P 5-12
%D 2014
%I Foundation of Computer Science (FCS), NY, USA
Abstract

Affective Systems have been used in different applications, such as stress monitoring in aircraft seats and managing sensitivity in autism spectrum disorder. Although many scientific progresses have been made there are many computational challenges to be overcome in order to embedded affectivity into traditional user interfaces. For example, context-sensitive algorithms, low-complexity pattern recognition models and hardware customizations are requirements to support the simplification of user's experience becoming more intuitive, transparent and less obstructive. In this paper an affective gamepad is presented. This acquisition system has been developed to improve user's biofeedback when they are playing games on Microsoft Xbox or Sony PlayStation. The preliminary version of Emopad is able to capture Galvanic Skin Response (GSR), Temperature, Force, Heart Rate (HR) and its variability (HRV) by photoplethysmography (PPG) sensor while complementary algorithms are executed to filter noise, recognize interests patterns and classify events related to user's emotional states. All processing phases are embedded into Emopad, and they explore microcontroller's dynamic power management. Emopad has been developed to deal with energy-efficient and platform-independent requirements. Concerning to this paper's aim, the acquisition systems development is highlighted. Also, the sliding window-based algorithm is presented and evaluated. It has been applied after sampling in GSR, Force, Temperature and HR signals to detect events related to emotional responses. The success of affective gamepads can lead to a paradigm shift, because traditional consoles can be configured to work as Point-of-Care technologies. Consequently, they can receive, process and transmit physiological data and events related to clinical conditions about their users.

References
  1. R. Picard, "Affective computing", MIT Press. Boston, 1997.
  2. M. F. A. Carvalhaes, A. F da Rocha, M. F. Vieira and T. M. G. de A. Barbosa, "Affective embedded systems: a requirement engineering aproach", International Journal of Computer Trends and Technology (IJCTT), v. 8, pp. 70-75, Feburary 2014.
  3. D. Bersak, G. McDarby, N. Augenblick, et al. , "Intelligent biofeedback using an immersive competitive environment," in Proceedings of the UbiComp Workshop on Designing Ubiquitous Computing Games, 2001.
  4. V. H. M. Gomide, P. A. Valle, J. O. Ferreira, J. R. G. Barbosa, A. F. da Rocha and T. M. G. de A. Barbosa, "Affective crowdsourcing applied to usability software", International Journal of Computer Science and Information Technologies (IJCSIT), Vol. 5 (1) , 2014, 575-579. doi: 10. 14445/22312803/IJCTT-V8P113.
  5. J. Schumm, C. Setz, M. Bächlin, M. Bächler, B. Arnrich, G. Tröster, "Unobtrusive physiological monitoring in an airplane seat", Personal and Ubiquitous Computing, V. 14 (6), 2010, pp. 541-550. doi: 10. 1007/s00779-009-0272-1.
  6. M. Z. Poh, k. Kim, K. , A. D. Goessling,N. C. Swenson, R. W. Picard, "Heartphones: sensor earphones and mobile application for non-obtrusive health monitoring," Proceedings of the 13th IEEE International Symposium on Wearable Computers, Linz, Austria, 2009, pp. 153-154.
  7. M. Z. Poh, D. J. McDuff and R. Picard, "Advancements in Non-contact, Multiparameter Physiological Measurements Using a Webcam," IEEE Transactions on Biomedical Engineering, vol. 58, no. 1, pp. 7-11, Jan 2011. doi: 10. 1109/TBME. 2010. 2086456.
  8. R. Fletcher, K. Dobson, M. S. Goodwin, H. Eydgahi, D. Wilder-Smith, D. Fernholz, Y. Kuboyama, E. Hedman, M. Z. Poh, R. W. Picard, "iCalm: wearable sensor and network architecture for wirelessly communicating and logging autonomic activity," IEEE Transactions on Information Technology in Biomedicine, vol. 14, no. 2, pp. 215-223, March 2010. doi: 10. 1109/TITB. 2009. 2038692.
  9. F. Arafsha, K. M. Alam and A. El Saddik, "EmoJacket: consumer centric wearable affective jacket to enhance emotional immersion", Proceedings of International Conference on Innovations in Information Technology (IIT), 2012, pp. 350-355.
  10. R. Fernandez and R. W. Picard (2003), "Modeling Driver's Speech under Stress," Speech Communication, Volume 40, pp. 145-159.
  11. J. Hernandez, D. McDuff, X. Benavides, J. Amores, P. Maes and R. Picard, "AutoEmotive: Bringing Empathy to the Driving Experience to Reduce Stress," To appear as a provocative work in Designing Interactive Systems (DIS), Vancouver, Canada 2014.
  12. K. Williams, J. Peters and C. Breazeal, "Towards Leveraging the Driver's Mobile Device for an Intelligent, Sociable In-Car Robotic Assistant," IEEE Intelligent Vehicles Symposium, 23-26 Jun. 2013.
  13. S. O. Adalgeirsson and C. Breazeal, "MeBot: A robotic platform for socially embodied telepresence" Proceedings of 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI), 2010.
  14. M. Z. Poh, D. J. McDuff and Picard, R. W. , "A Medical Mirror for Non-Contact Health Monitoring," ACM SIGGRAPH Emerging Technologies, Aug 2011.
  15. J. Hernandez, I. Riobo, A. Rozga, G. D. Abowd and R. W. Picard, "How Easy Are Children to Engage during Child-Adult Play? Using Electrodermal Activity as Identifier", To appear in the Extended Abstract of IMFAR, Alanta, USA, 2014.
  16. T. Teixeira, T. Kaliouby and R. Picard, "Why, When and How Much to Entertain Consumers in Advertisements? A Web-based Facial Tracking Field Study," Marketing Science (To Appear) 2014.
  17. M. Eckhardt, C. Ferguson and R. W. Picard, "A Platform for Creating Stories Across Digital and Physical Boundaries," Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction. ACM, 2014.
  18. L. E. Nack, M. Kalyn, C. Lough and R. L. Mandryk Biofeedback Game Design: Using Direct and Indirect Physiological Control to Enhance Game Interaction" Proceedings of ACM Conference on Human Factors in Computing Systems (CHI), 2011.
  19. K. Schaaff and M. T. P. Adam, "Measuring Emotional Arousal for Online Applications: Evaluation of Ultra-Short Term Heart Rate Variability Measures" Proceedings of Humaine Association Conference on Affective Computing and Intelligent Interaction, 2013.
  20. A. Parnandi, Y. Son amd R. Gutierrez-Osuna, "A Control-Theoretic Aproach to Adaptive Physiological Games" Proceedings of Humaine Association Conference on Affective Computing and Intelligent Interaction, 2013.
  21. M. W. Kennedy, J. P. Shimiedeler, C. R. Crowell, M. Villano, A. D. Striegel and J. Kuitse, "Enhanced Feedback in Balance Rehabilitation using the Nintendo Wii Balance Board" Proceedings of 13th IEEE International Conference on e-Health Networking, Applications and Services, 2011.
  22. L. E. Nack, M. Kalyn, C. Lough and R. L. Mandryk Biofeedback Game Design: Using Direct and Indirect Physiological Control to Enhance Game Interaction" Proceedings of ACM Conference on Human Factors in Computing Systems (CHI), 2011.
  23. Neurosky – Body and Mind: Throw Trucks. Online: http://store. neurosky. com/products/throw-trucks-with-your-mind?mc_cid=6c3dfb6fe0&mc_eid=53dde7647e/, April, 2014.
  24. J. Hsu, "Game Controller Senses Players' Excitement Levels", Online: http://spectrum. ieee. org/tech-talk/consumer-electronics/gaming/game-controller-senses-players-excitement-levels, April, 2014.
  25. Shapeways. Online: http://www. shapeways. com.
  26. STERN, R. M. , RAY, W. J. & QUIGLEY, K. S. , Psychophysiological Recording. (2nd ed. ), Oxford University Press, New York, 2001.
  27. Lang, P. J. The Emotion Probe. American Psychologist, 50(5), pp. 372-385, 1995.
  28. R. W. Picard, S. Fedor & Y. Ayzenberg, "Multiple Arousal Theory and Daily-Life Electrodermal Activity Asymmetry" Emotion Review, (To Appear) 2014.
  29. J. Bishop, "Thermistor temperature transducer-to-ADC application" in Analog Applications Journal, Texas Instruments Incorporated.
  30. Epcos, "NTC thermistors for temperature measurement", Mar 2013.
  31. PulseSensor. Online: http://pulsesensor. myshopify. com/, April, 2014.
  32. J. G. Webster, "Medical Instrumentation Application and Design", 4th ed. , Wiley, 2009.
  33. Sparkfun, "Bluetooth Modem – BlueSMiRF". Online: https://www. sparkfun. com/products/12582.
  34. Game Jolt, "Death Unknown". Online: http://gamejolt. com/games/other/death-unknown-v-1-2/16329/".
  35. A. S. Sierra, C. S. Ávila, J. G. Casanova and G. B. del Pozo, "A Stress-Detection Based on Physiological Signals and Fuzzy Logic", IEEE Transactions on Industrial Electronics, v. 58, n. 10, october 2011.
  36. O. Kalinli-Akbacak, "Multi-modal sensor based emotion recognition and emotional interface". Online: http://www. google. com/patents/US201401125
Index Terms

Computer Science
Information Sciences

Keywords

Affective Gamepad Affective Systems