We apologize for a recent technical issue with our email system, which temporarily affected account activations. Accounts have now been activated. Authors may proceed with paper submissions. PhDFocusTM
CFP last date
20 November 2024
Call for Paper
December Edition
IJCA solicits high quality original research papers for the upcoming December edition of the journal. The last date of research paper submission is 20 November 2024

Submit your paper
Know more
Reseach Article

Deep Q-Learning for Home Automation

by Vignesh Gokul, Parinitha Kannan, Sharath Kumar, Shomona Gracia Jacob
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 152 - Number 6
Year of Publication: 2016
Authors: Vignesh Gokul, Parinitha Kannan, Sharath Kumar, Shomona Gracia Jacob
10.5120/ijca2016911873

Vignesh Gokul, Parinitha Kannan, Sharath Kumar, Shomona Gracia Jacob . Deep Q-Learning for Home Automation. International Journal of Computer Applications. 152, 6 ( Oct 2016), 1-5. DOI=10.5120/ijca2016911873

@article{ 10.5120/ijca2016911873,
author = { Vignesh Gokul, Parinitha Kannan, Sharath Kumar, Shomona Gracia Jacob },
title = { Deep Q-Learning for Home Automation },
journal = { International Journal of Computer Applications },
issue_date = { Oct 2016 },
volume = { 152 },
number = { 6 },
month = { Oct },
year = { 2016 },
issn = { 0975-8887 },
pages = { 1-5 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume152/number6/26320-2016911873/ },
doi = { 10.5120/ijca2016911873 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-06T23:57:25.637298+05:30
%A Vignesh Gokul
%A Parinitha Kannan
%A Sharath Kumar
%A Shomona Gracia Jacob
%T Deep Q-Learning for Home Automation
%J International Journal of Computer Applications
%@ 0975-8887
%V 152
%N 6
%P 1-5
%D 2016
%I Foundation of Computer Science (FCS), NY, USA
Abstract

In this paper, the first deep reinforcement learning model for home automation systems is presented. Home automation has been one of the most important applications in the field of Artificial Intelligence. The system should learn the pattern and behaviour of the user automatically from experience and take future actions accordingly. The system proposed here makes use only of images to learn the user’s needs using Deep Q-Learning, thus minimizing the use of any sensors and other hardware. The model makes use of a Convolutional Neural Network that takes as input, the image and outputs the future reward for each action. The system was tested with images of a house and describes the methods and results in the paper.

References
  1. Marc G Bellemare, Yavar Naddaf, Joel Veness, and Michael Bowling. The arcade learning environment: An evaluation platform for general agents. Journal of Artificial Intelligence Research, 2012.
  2. Natalie Kcomt Ch´e, Niels Pardons, Yves Vanrompay, Davy Preuveneers, and Yolande Berbers. An intelligent domotics system to automate user actions. In Ambient Intelligence and Future Trends-International Symposium on Ambient Intelligence (ISAmI 2010), pages 201–204. Springer, 2010.
  3. Sajal K Das and Diane J Cook. Designing smart environments: A paradigm based on learning and prediction. In International Conference on Pattern Recognition and Machine Intelligence, pages 80–90. Springer, 2005.
  4. Peter Gorniak and David Poole. Predicting future user actions by observing unmodified applications. In AAAI/IAAI, pages 217–222, 2000.
  5. Edwin O Heierman and Diane J Cook. Improving home automation by discovering regularly occurring device usage patterns. In Data Mining, 2003. ICDM 2003. Third IEEE International Conference on, pages 537–540. IEEE, 2003.
  6. Li Jiang, Da-You Liu, and Bo Yang. Smart home research. In Machine Learning and Cybernetics, 2004. Proceedings of 2004 International Conference on, volume 2, pages 659–663. IEEE, 2004.
  7. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems, pages 1097–1105, 2012.
  8. Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, and Martin Riedmiller. Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602, 2013.
  9. Michael C Mozer. The neural network house: An environment hat adapts to its inhabitants. In Proc. AAAI Spring Symp. Intelligent Environments, volume 58, 1998.
  10. Mamun Bin Ibne Reaz, Awss Assim, Muhammad I Ibrahimy, Florence Choong, and Faisal Mohd-Yasin. Hardware simulation of home automation using pattern matching and reinforcement learning for disabled people. In IC-AI, pages 213– 218, 2008.
Index Terms

Computer Science
Information Sciences

Keywords

Home Automation Smart Homes Deep Q-Learning Reinforcement Learning