CFP last date
20 January 2025
Reseach Article

Development of a Facebook Crawler for Opinion Trend Monitoring and Analysis Purposes: Case Study of Government Service Delivery in Dwesa

by S. I. Mfenyana, N. Moroosi, M. Thinyane, S. M. Scott
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 79 - Number 17
Year of Publication: 2013
Authors: S. I. Mfenyana, N. Moroosi, M. Thinyane, S. M. Scott
10.5120/13964-1934

S. I. Mfenyana, N. Moroosi, M. Thinyane, S. M. Scott . Development of a Facebook Crawler for Opinion Trend Monitoring and Analysis Purposes: Case Study of Government Service Delivery in Dwesa. International Journal of Computer Applications. 79, 17 ( October 2013), 32-39. DOI=10.5120/13964-1934

@article{ 10.5120/13964-1934,
author = { S. I. Mfenyana, N. Moroosi, M. Thinyane, S. M. Scott },
title = { Development of a Facebook Crawler for Opinion Trend Monitoring and Analysis Purposes: Case Study of Government Service Delivery in Dwesa },
journal = { International Journal of Computer Applications },
issue_date = { October 2013 },
volume = { 79 },
number = { 17 },
month = { October },
year = { 2013 },
issn = { 0975-8887 },
pages = { 32-39 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume79/number17/13964-1934/ },
doi = { 10.5120/13964-1934 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-06T21:53:17.379515+05:30
%A S. I. Mfenyana
%A N. Moroosi
%A M. Thinyane
%A S. M. Scott
%T Development of a Facebook Crawler for Opinion Trend Monitoring and Analysis Purposes: Case Study of Government Service Delivery in Dwesa
%J International Journal of Computer Applications
%@ 0975-8887
%V 79
%N 17
%P 32-39
%D 2013
%I Foundation of Computer Science (FCS), NY, USA
Abstract

For service providers it is important to know what the public thinks or requires. Having such knowledge can help in decision making and future planning. In nowadays there is very high usage of Social Networking Sites (SNSs) and blogs where people share their views, opinions, and thoughts. If service providers can keep track of such views, opinions or thoughts with regard to the services they provide, they can better their understanding about the public or clients' needs and improve the provision of relevant services. This paper presents a system prototype for performing trend analysis on Facebook. The proposed system crawl Facebook, indexes the data and provides user interface where end users can search and see the trend of topic of their choice. The main objective of this paper is to propose a framework that can contribute in the improvement of the way government official and normal citizens communicate in regard with service delivery in rural areas. The premise in this paper is that if the government can keep track of the citizen's opinions and thoughts with regards to service delivery, it can help improve the delivery of such services. This research and the implementation of the trend analysis tool is undertaken in the context of the Siyakhula Living Lab (SLL), an Information and Communication Technologies for development (ICTD) intervention for Dwesa marginalized community located in the Eastern Cape province of South Africa.

References
  1. "Project Activities | Siyakhula Living Lab. " [Online]. Available: http://siyakhulall. org/?q=activities. [Accessed: 20-Sep-2013].
  2. M. Srivastava, "Social Media and Its Use by the Government," J. Public Adm. Gov. , vol. 3, no. 2, pp. 161–172, Jul. 2013.
  3. R. Bassett, T. Chamberlain, S. Cunningham, and G. Vidmar, "Data Mining and Social Networking Sites: Protecting Business Infrastructure and Beyond," Data Min. Soc. Netw. Sites, vol. Volume XI,, no. 1, pp. 352–357, 2010.
  4. E. Costa, R. Ferreira, P. Brito, I. I. Bittencourt, O. Holanda, and A. Machado, "Expert Systems with Applications A framework for building web mining applications in the world of blogs?: A case study in product sentiment analysis," Expert Syst. Appl. , vol. 39, no. 5, pp. 4813–4834, 2012.
  5. M. Thinyane, H. Slay, A. Terzoli, and P. Clayton, "A Preliminary Investigation into the Implementation of ICTs in Marginalized Communities," in SATNAC, 2006, p. No 213.
  6. B. T. Jakachira, "Implementing an integrated e-Government functionality for a marginalized community in the Eastern Cape , South Africa Master of Science in Computer Science University of Fort Hare by," no. November, 2009.
  7. S. Batsakis, E. G. M. Petrakis, and E. Milios, "Improving the performance of focused web crawlers," Data Knowl. Eng. , vol. 68, no. 10, pp. 1001–1013, 2009.
  8. N. B. Ellison, "Social Network Sites: Definition, History, and Scholarship," J. Comput. Commun.
  9. K. G. Provan, a. Fish, and J. Sydow, "Interorganizational Networks at the Network Level: A Review of the Empirical Literature on Whole Networks," J. Manage. , vol. 33, no. 3, pp. 479–516, Jun. 2007.
  10. K. Differences, G. Cormode, and B. Krishnamurthy, "Key Differences between Web1. 0 and Web2. 0," pp. 1–30, 2008.
  11. S. S. Dhenakaran and K. T. Sambanthan, "Web Crawler - An Overview," vol. 2, no. 1, pp. 265–267, 2011.
  12. B. Pontes, S. Rocha, R. Luis, and T. Santos, "Example-Driven, Content-Based, Distributed Crawling and Extraction for Online Social Network Analysis," 2006.
  13. G. Pant, P. Srinivasan, and F. Menczer, "Crawling the Web," springer, pp. 153–177, 2004.
  14. "Yahoo News ZA - Latest World News South Africa News Headlines. " [Online]. Available: http://za. news. yahoo. com/. [Accessed: 20-Sep-2013].
  15. M. Mathioudakis and N. Koudas, "TwitterMonitor?: Trend Detection over the Twitter Stream," pp. 5–7.
  16. M. Spiliopoulou, B. Mobasher, O. Nasraoui, and O. Zaiane, "Guest editorial: special issue on a decade of mining the Web," Data Min. Knowl. Discov. , vol. 24, no. 3, pp. 473–477, Mar. 2012.
  17. E. Boldrini, A. Balahur, P. Martínez-Barco, and A. Montoyo, "Using EmotiBlog to annotate and analyse subjectivity in the new textual genres," Data Min. Knowl. Discov. , vol. 25, no. 3, pp. 603–634, Mar. 2012.
  18. S. Papadopoulos, Y. Kompatsiaris, A. Vakali, and P. Spyridonos, "Community detection in Social Media," Data Min. Knowl. Discov. , vol. 24, no. 3, pp. 515–554, Jun. 2011.
  19. A. Tuzhilin, "Customer relationship management and Web mining: the next frontier," Data Min. Knowl. Discov. , vol. 24, no. 3, pp. 584–612, Feb. 2012.
  20. J. Hagberg, "Development of a News Reading System," 2012.
  21. "RestFB - A Lightweight Java Facebook Graph API and Old REST API Client. " [Online]. Available: http://www. restfb. com/. [Accessed: 20-Sep-2013].
  22. "FacebookClient (RestFB). " [Online]. Available: http://restfb. com/javadoc/com/restfb/FacebookClient. html. [Accessed: 20-Sep-2013].
  23. "JSON. " [Online]. Available: http://www. json. org/. [Accessed: 20-Sep-2013].
  24. M. Najork and J. L. Wiener, "Breadth-First Search Crawling Yields High-Quality Pages," pp. 114–118, 2001.
  25. M. Mccandless, E. Hatcher, and O. Gospodnetic, Lucene in Action, Second Edi. Manning Publications Co. 180 Broad St. Suite 1323 Stamford, CT 06901.
  26. P. Kadam, "Trend Detection and Visualization and Custom Search. ".
Index Terms

Computer Science
Information Sciences

Keywords

Data Retrieval Social Networking Sites Web Crawlers Facebook ICTD SLL.