CFP last date
20 December 2024
Call for Paper
January Edition
IJCA solicits high quality original research papers for the upcoming January edition of the journal. The last date of research paper submission is 20 December 2024

Submit your paper
Know more
The week's pick
Responsive image
Improved Shuffled Frog Leaping Algorithm with Self-Adaptive Shuffling for Fuzzy Logic PD+G Controller Optimization in Robotic Manipulators

Duc Hoang Nguyen
Random Articles
Reseach Article

Getting Your Bias Variance Right and Regularization

by Divisha Bera
journal cover thumbnail

International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 181 - Number 7
Year of Publication: 2018
Authors: Divisha Bera
10.5120/ijca2018917579

Divisha Bera . Getting Your Bias Variance Right and Regularization. International Journal of Computer Applications. 181, 7 ( Aug 2018), 18-20. DOI=10.5120/ijca2018917579

@article{ 10.5120/ijca2018917579,
author = { Divisha Bera },
title = { Getting Your Bias Variance Right and Regularization },
journal = { International Journal of Computer Applications },
issue_date = { Aug 2018 },
volume = { 181 },
number = { 7 },
month = { Aug },
year = { 2018 },
issn = { 0975-8887 },
pages = { 18-20 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume181/number7/29784-2018917579/ },
doi = { 10.5120/ijca2018917579 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-07T01:05:18.121959+05:30
%A Divisha Bera
%T Getting Your Bias Variance Right and Regularization
%J International Journal of Computer Applications
%@ 0975-8887
%V 181
%N 7
%P 18-20
%D 2018
%I Foundation of Computer Science (FCS), NY, USA
Abstract

It is clear that with ever improving computational power and endless data, there have been more breakthroughs in Machine Learning. Some practices have clearly emerged as promising while building a neural network. A performance metric to judge the model, is to see if it is in the wrong side of bias or variance. While building a classifier, cases with high bias, and high variance crop up. This paper shall attempt to shed some light on the problem of bias-variance, and how to solve them, with some approaches to perform Regularization.

References
  1. Sebastian Raschka 2016 Model evaluation, model selection, and algorithm selection in machine learning.
  2. Bengio, Yoshua, and Yves Grandvalet. 2004. “No Unbiased Estimator of the Variance of K-Fold Cross-Validation.” J. Mach. Learn. Res. 5 (December). JMLR.org: 1089–1105.
  3. Stanford University, Coursera 2018 Machine Learning Computing Systems.
  4. Google 2018 Machine Learning Crash Course.
  5. Tan, Pang-Ning, Michael Steinbach, and Vipin Kumar. 2005 Classification: Basic Concepts, Decision Trees, and Model Evaluation.” In Introduction to Data Mining. Boston: Pearson Addison Wesley.
  6. Hawkins, Douglas M., Subhash C. Basak, and Denise Mills. 2003. “Assessing Model Fit by Cross-Validation.” Journal of Chemical Information and Computer Sciences 43 (2). American Chemical Society: 579–86.
  7. Anders Krogh, John A. Hertz. A Simple Weight Decay Can Improve Generalization.
  8. Juergen Schmidhuber 2014 Deep Learning: An Overview
  9. Andrew Ng. Feature selection, L1 vs. L2 regularization
  10. Coursera 2018 deeplearning.ai
Index Terms

Computer Science
Information Sciences

Keywords

Machine Learning Bias Variance Neural Networks Regularization.

Powered by PhDFocusTM