CFP last date
20 January 2025
Reseach Article

Network Traffic Measurements and Analysis using Hadoop

Published on May 2016 by Amol S. Suryawanshi, S.v. Bodake
National Conference on Advancements in Computer & Information Technology
Foundation of Computer Science USA
NCACIT2016 - Number 3
May 2016
Authors: Amol S. Suryawanshi, S.v. Bodake
2beea8de-577b-45af-b997-da0ed7591aec

Amol S. Suryawanshi, S.v. Bodake . Network Traffic Measurements and Analysis using Hadoop. National Conference on Advancements in Computer & Information Technology. NCACIT2016, 3 (May 2016), 21-25.

@article{
author = { Amol S. Suryawanshi, S.v. Bodake },
title = { Network Traffic Measurements and Analysis using Hadoop },
journal = { National Conference on Advancements in Computer & Information Technology },
issue_date = { May 2016 },
volume = { NCACIT2016 },
number = { 3 },
month = { May },
year = { 2016 },
issn = 0975-8887,
pages = { 21-25 },
numpages = 5,
url = { /proceedings/ncacit2016/number3/24714-3052/ },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Proceeding Article
%1 National Conference on Advancements in Computer & Information Technology
%A Amol S. Suryawanshi
%A S.v. Bodake
%T Network Traffic Measurements and Analysis using Hadoop
%J National Conference on Advancements in Computer & Information Technology
%@ 0975-8887
%V NCACIT2016
%N 3
%P 21-25
%D 2016
%I International Journal of Computer Applications
Abstract

Accurate network traffic capture & measurements, analysis and monitoring is key to a wide range of network applications such as computer network traffic engineering, error detection & correction and all kind of security analysis with maintaince. A number of critical network management decisions, such as identifying faulty nodes & servers, routers, blocking traffic to a victim destination, monitoring traffic require extraction and analysis of real time data patterns in network traffic. The large traffic volumes seen in today's high-speed networks pose tremendous computational and storage requirements for accurate traffic measurements & analysis. We are going to actualizing Hadoop based system which collect traffic data, perform Traffic Analysis, Measurement, and Classification with deference to different parameters at parcel level. These outcomes can be utilized by Network Administrator and ISP's to identify abnormalities in system to achieve efficiency.

References
  1. IEEE Journal on Selected Areas in Communication, Vol. 32, No. 10, October 2014,"Stream-Oriented Network Traffic Capture and Analysis for High-Speed Networks" by Antonis Papadogiannakis, Michalis Polychronakis,and Evangelos P. Markatos.
  2. Cisco White Paper. "Cisco Visual Networking Index: Forecast and Methodology", 2011-2016, May 2012.
  3. S. Ghemawat, H. Gobio, and S. Leung,"The Google File System", ACM SOSP, 2003.
  4. J. Dean and S. Ghemawat,"MapReduce: Simplified Data Processing on Large Cluster", USENIX OSDI, 2004.
  5. Hadoop, http://hadoop. apache. org/.
  6. T. White, Hadoop: The Definitive Guide, O'Reilly, Third ed. , 2012.
  7. M. Roesch,"Snort: Lightweight intrusion detection for networks," in Proc. USENIX LISA Conf. , 1999, pp. 229-238.
  8. V. Paxson,"Bro: A system for detecting network intruders in real-time," Comput. Netw. , vol. 31, no. 23/24, pp. 2435-2463, Dec. 1999.
  9. G. Gu, P. Porras, V. Yegneswaran, M. Fong, and W. Lee,"BotHunter: Detecting malware infection through IDS-driven dialog correlation," in Proc. USENIX Security Symp. , 2007, pp. 167-182.
  10. S. Singh, C. Estan, G. Varghese, and S. Savage,"Automated worm finger printing,"in Proc. USENIX Symp. OSDI, 2004, pp. 45-60.
  11. Application Layer Packet Classifier for Linux (L7-Filter). [Online]. Available:http://l7-filter. sourceforge. net/.
  12. IEEE/ACM TRANSACTIONS ON NETWORKING, VOL. 22, NO. 2, APRIL 2014 377 "Streaming Solutions for Fine-Grained Network Traffic Measurements and Analysis" Faisal Khan, Nicholas Hosein, Soheil Ghiasi, Senior Member, IEEE Chen-Nee Chuah, Senior Member, IEEE, and Puneet Sharma, Senior Member, IEEE.
  13. "Hadoop-The Definitive Guide" -Tom White
  14. "Data communications & Networking" –Forouzan
  15. "Computer Networks"-A. S. Tanenbaum.
Index Terms

Computer Science
Information Sciences

Keywords

Network Traffic Measurement Traffic Analysis Hadoop Isp Is Internet Service Provider.