CFP last date
20 May 2024
Reseach Article

Decoding Multiple Subject fMRI Data using Manifold based Representation of Cognitive State Neural Signatures

by Accamma I. V, Suma H. N, Dakshayini M
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 115 - Number 15
Year of Publication: 2015
Authors: Accamma I. V, Suma H. N, Dakshayini M

Accamma I. V, Suma H. N, Dakshayini M . Decoding Multiple Subject fMRI Data using Manifold based Representation of Cognitive State Neural Signatures. International Journal of Computer Applications. 115, 15 ( April 2015), 1-7. DOI=10.5120/20224-2512

@article{ 10.5120/20224-2512,
author = { Accamma I. V, Suma H. N, Dakshayini M },
title = { Decoding Multiple Subject fMRI Data using Manifold based Representation of Cognitive State Neural Signatures },
journal = { International Journal of Computer Applications },
issue_date = { April 2015 },
volume = { 115 },
number = { 15 },
month = { April },
year = { 2015 },
issn = { 0975-8887 },
pages = { 1-7 },
numpages = {9},
url = { },
doi = { 10.5120/20224-2512 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
%0 Journal Article
%1 2024-02-06T22:54:52.346349+05:30
%A Accamma I. V
%A Suma H. N
%A Dakshayini M
%T Decoding Multiple Subject fMRI Data using Manifold based Representation of Cognitive State Neural Signatures
%J International Journal of Computer Applications
%@ 0975-8887
%V 115
%N 15
%P 1-7
%D 2015
%I Foundation of Computer Science (FCS), NY, USA

Mind reading or thought prediction is a promising application of functional neuroimaging studies. The emergence of functional magnetic resonance imaging (fMRI) has, in the last two decades given a boost to these studies. In order to improve the accuracy, predictability and repeatability of thought prediction, it is important to have a representation that can capture the nuances of fMRI activations with respect to a particular cognitive state. In this paper, the process of creating a geometrical representation of the activations using non-linear manifolds is described. Manifold learning brings out the geometry of the activated voxels in the fMRI image. It is shown that this kind of representation is able to give high accuracy in classification studies as compared to using activation profiles.

  1. Roberto Cabeza and Lars Nyberg. Imaging cognition ii: An empirical review of 275 pet and fmri studies. Journal of cognitive neuroscience, 12(1):1–47, 2000.
  2. Alfonso Caramazza and J Shelton. Domain-specific knowledge systems in the brain: The animate-inanimate distinction. Cognitive Neuroscience, Journal of, 10(1):1–34, 1998.
  3. Linda L Chao, James V Haxby, and Alex Martin. Attribute-based neural substrates in temporal cortex for perceiving and knowing about objects. Nature neuroscience, 2(10):913–919, 1999.
  4. John A Clithero, David V Smith, R McKell Carter, and Scott A Huettel. Within-and cross-participant classifiers reveal different neural coding of information. Neuroimage, 56(2):699–708, 2011.
  5. Bryan Conroy, Ben Singer, James Haxby, and Peter J Ramadge. fmri-based inter-subject cortical alignment using functional connectivity. In Advances in Neural Information Processing Systems, pages 378–386, 2009.
  6. Christos Davatzikos, Kosha Ruparel, Yong Fan, DG Shen, M Acharyya, JW Loughead, RC Gur, and Daniel D Langleben. Classifying spatial patterns of brain activity with machine learning methods: application to lie detection. Neuroimage, 28(3):663–668, 2005.
  7. Rahul S Desikan, Florent S´egonne, Bruce Fischl, Brian T Quinn, Bradford C Dickerson, Deborah Blacker, Randy L Buckner, AndersMDale, R Paul Maguire, Bradley T Hyman, et al. An automated labeling system for subdividing the human cerebral cortex on mri scans into gyral based regions of interest. Neuroimage, 31(3):968–980, 2006.
  8. Russell Epstein and Nancy Kanwisher. A cortical representation of the local visual environment. Nature, 392(6676):598–601, 1998.
  9. Alan C Evans, D Louis Collins, SR Mills, ED Brown, RL Kelly, and Terry M Peters. 3d statistical neuroanatomical models from 305 mri volumes. In Nuclear Science Symposium and Medical Imaging Conference, 1993. , 1993 IEEE Conference Record. , pages 1813–1817. IEEE, 1993.
  10. Joshua D Greene, R Brian Sommerville, Leigh E Nystrom, John M Darley, and Jonathan D Cohen. An fmri investigation of emotional engagement in moral judgment. Science, 293(5537):2105–2108, 2001.
  11. Stephen Jos´e Hanson, Toshihiko Matsuka, and James V Haxby. Combinatorial codes in ventral temporal lobe for object recognition: Haxby (2001) revisited: is there a face area? Neuroimage, 23(1):156–166, 2004.
  12. James V Haxby, M Ida Gobbini, Maura L Furey, Alumit Ishai, Jennifer L Schouten, and Pietro Pietrini. Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science, 293(5539):2425–2430, 2001.
  13. John-Dylan Haynes and Geraint Rees. Predicting the orientation of invisible stimuli from activity in human primary visual cortex. Nature neuroscience, 8(5):686–691, 2005.
  14. John-Dylan Haynes and Geraint Rees. Decoding mental states from brain activity in humans. Nature Reviews Neuroscience, 7(7):523–534, 2006.
  15. Marcel Adam Just, Vladimir L Cherkassky, Sandesh Aryal, and Tom M Mitchell. A neurosemantic theory of concrete noun representation based on the underlying brain codes. PloS one, 5(1):e8622, 2010.
  16. Yukiyasu Kamitani and Frank Tong. Decoding the visual and subjective contents of the human brain. Nature neuroscience, 8(5):679–685, 2005.
  17. Yukiyasu Kamitani and Frank Tong. Decoding seen and attended motion directions from activity in the human visual cortex. Current Biology, 16(11):1096–1102, 2006.
  18. Nancy Kanwisher, Josh McDermott, and Marvin M Chun. The fusiform face area: a module in human extrastriate cortex specialized for face perception. The Journal of Neuroscience, 17(11):4302–4311, 1997.
  19. Kendrick N Kay, Thomas Naselaris, Ryan J Prenger, and Jack L Gallant. Identifying natural images from human brain activity. Nature, 452(7185):352–355, 2008.
  20. Nikolaus Kriegeskorte, Rainer Goebel, and Peter Bandettini. Information-based functional brain mapping. Proceedings of the National Academy of Sciences of the United States of America, 103(10):3863–3868, 2006.
  21. Nikolaus Kriegeskorte, Marieke Mur, Douglas A Ruff, Roozbeh Kiani, Jerzy Bodurka, Hossein Esteky, Keiji Tanaka, and Peter A Bandettini. Matching categorical object representations in inferior temporal cortex of man and monkey. Neuron, 60(6):1126–1141, 2008.
  22. Bradford Z Mahon and Alfonso Caramazza. Concepts and categories: a cognitive neuropsychological perspective. Annual review of psychology, 60:27, 2009.
  23. Peter Mannfolk, Ronnie Wirestam, Markus Nilsson, Freddy St°ahlberg, and Johan Olsrud. Dimensionality reduction of fmri time series data using locally linear embedding. Magnetic Resonance Materials in Physics, Biology and Medicine, 23(5-6):327–338, 2010.
  24. Alex Martin. The representation of object concepts in the brain. Annu. Rev. Psychol. , 58:25–45, 2007.
  25. Manel Mart´?nez-Ram´on, Vladimir Koltchinskii, Gregory L Heileman, and Stefan Posse. fmri pattern classification using neuroanatomically constrained boosting. Neuroimage, 31(3):1129–1141, 2006.
  26. Tom M Mitchell, Svetlana V Shinkareva, Andrew Carlson, Kai-Min Chang, Vicente L Malave, Robert A Mason, and Marcel Adam Just. Predicting human brain activity associated with the meanings of nouns. science, 320(5880):1191–1195, 2008.
  27. Yoichi Miyawaki, Hajime Uchida, Okito Yamashita, Masa-aki Sato, Yusuke Morito, Hiroki C Tanabe, Norihiro Sadato, and Yukiyasu Kamitani. Visual image reconstruction from human brain activity using a combination of multiscale local image decoders. Neuron, 60(5):915–929, 2008.
  28. Shinji Nishimoto, An T Vu, Thomas Naselaris, Yuval Benjamini, Bin Yu, and Jack L Gallant. Reconstructing visual experiences from brain activity evoked by natural movies. Current Biology, 21(19):1641–1646, 2011.
  29. Kenneth A Norman, Sean M Polyn, Greg J Detre, and James V Haxby. Beyond mind-reading: multi-voxel pattern analysis of fmri data. Trends in cognitive sciences, 10(9):424–430, 2006.
  30. Kevin N Ochsner, Silvia A Bunge, James J Gross, and John DE Gabrieli. Rethinking feelings: an fmri study of the cognitive regulation of emotion. Journal of cognitive neuroscience, 14(8):1215–1229, 2002.
  31. Alice J O'Toole, Fang Jiang, Herv´e Abdi, Nils P´enard, Joseph P Dunlop, and Marc A Parent. Theoretical, statistical, and practical perspectives on pattern-based classification approaches to the analysis of functional neuroimaging data. Journal of cognitive neuroscience, 19(11):1735–1752, 2007.
  32. Marius V Peelen and Paul E Downing. Selectivity for the human body in the fusiform gyrus. Journal of neurophysiology, 93(1):603–608, 2005.
  33. Hanchuan Peng, Fulmi Long, and Chris Ding. Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 27(8):1226–1238, 2005.
  34. Russell A Poldrack, Jeanette A Mumford, and Thomas E Nichols. Handbook of functional MRI data analysis. Cambridge University Press, 2011.
  35. Rajeev DS Raizada and Andrew C Connolly. What makes different people's representations alike: neural similarity space solves the problem of across-subject fmri decoding. Journal of cognitive neuroscience, 24(4):868–877, 2012.
  36. Indrayana Rustandi, Marcel Adam Just, and Tom M Mitchell. Integrating multiple-study multiple-subject fmri datasets using canonical correlation analysis. In Proceedings of the MICCAI 2009 Workshop, 2009.
  37. Mert R Sabuncu, Benjamin D Singer, Bryan Conroy, Ronald E Bryan, Peter J Ramadge, and James V Haxby. Function-based intersubject alignment of human cortical anatomy. Cerebral Cortex, 20(1):130–140, 2010.
  38. Xilin Shen and Franc¸ois G Meyer. Analysis of event-related fmri data using diffusion maps. In Information Processing in Medical Imaging, pages 652–663. Springer, 2005.
  39. Svetlana V Shinkareva, Robert A Mason, Vicente L Malave, Wei Wang, Tom M Mitchell, and Marcel Adam Just. Using fmri brain activation to identify cognitive states associated with perception of tools and dwellings. PLoS One, 3(1):e1394, 2008.
  40. Vishwajeet Singh, Krishna P Miyapuram, and Raju S Bapi. Detection of cognitive states from fmri data using machine learning techniques. In IJCAI, pages 587–592, 2007.
  41. Stephen M Smith, Mark Jenkinson, Mark W Woolrich, Christian F Beckmann, Timothy EJ Behrens, Heidi Johansen-Berg, Peter R Bannister, Marilena De Luca, Ivana Drobnjak, David E Flitney, et al. Advances in functional and structural mr image analysis and implementation as fsl. Neuroimage, 23:S208–S219, 2004.
  42. Sylvain Takerkart, Guillaume Auzias, Bertrand Thirion, Daniele Sch¨on, and Liva Ralaivola. Graph-based inter-subject classification of local fmri patterns. In Machine Learning in Medical Imaging, pages 184–192. Springer, 2012.
  43. Sylvain Takerkart, Liva Ralaivola, et al. Multiple subject learning for inter-subject prediction. In Proceedings of the 4TH International Workshop on Pattern Recognition in Neuroimaging (PRNI), 2014.
  44. Jean Talairach and Pierre Tournoux. Co-planar stereotaxic atlas of the human brain. 3-dimensional proportional system: an approach to cerebral imaging. Nature neuroscience, 1988.
  45. Bertrand Thirion and Olivier Faugeras. Nonlinear dimension reduction of fmri data: the laplacian embedding approach. In Biomedical Imaging: Nano to Macro, 2004. IEEE International Symposium on, pages 372–375. IEEE, 2004.
  46. Xuerui Wang, Tom M Mitchell, and Rebecca Hutchinson. Using machine learning to detect cognitive states across multiple subjects. CALD KDD project paper, 2003.
  47. Elizabeth K Warrington and Tim Shallice. Category specific semantic impairments. Brain, 107(3):829–853, 1984.
Index Terms

Computer Science
Information Sciences


fMRI classification multiple-subject manifold learning