The week's pick
Reseach Article
Video Calling through Augmented Reality
| International Journal of Computer Applications |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 174 - Number 28 |
| Year of Publication: 2021 |
| Authors: Sagar Dhanake, Akash Pittalwar, Priyanka Dubey, Swarneil Pradhan |
10.5120/ijca2021921209
|
Sagar Dhanake, Akash Pittalwar, Priyanka Dubey, Swarneil Pradhan . Video Calling through Augmented Reality. International Journal of Computer Applications. 174, 28 ( Apr 2021), 37-42. DOI=10.5120/ijca2021921209
Abstract
Augmented reality is an interactive experience of a real-world environment where the objects of real-world are enhanced by computer generated perceptual information, including visual, auditory and olfactory inputs from various sensory modalities. Augmented Reality will play the vital role in enhancing the user experience of better interaction and perception of the output. Augmented reality allows overlapping virtual objects above the images of real objects when seen through your smart device camera. In this article, the members have integrated Agora API in a video conference scenario. This article describes the implementation of two scenarios in the video: Integrate AGORA API with live video streaming and Render the live video stream to the AR plane using Agora’s Video SDK. The proposed paper contains AR Core to detect a plane in the room and then make use of Custom Video Source and Renderer function, included in Agora.io Video SDK v2.1.1, to render the live video stream onto the plane. This ends up giving a holographic feel to the video call, just like anyone could see in Sci-fi movies. Agora’s video SDK functions RESTful API which is the core of video calling. Agora provides a wrapper for users to easily use WebRTC. Agora has made WebRTC comprehensible to everyone with simplified functions and extensive, instructive documentation. As traditional WebRTC would require you to maintain TURN/STUN servers for relaying data and obtaining IP Addresses respectively, Agora’s WebRTC does all of this under the hood, leaving the user with very little to do. The user has no hardware over-heads to manage, making the process hassle-free. This drastically cuts down the cost and complexity of implementation. Moreover this application will also concern about multi-user functionality which maybe a revolutionary situation in AR world in near future. So the conclusion of the repertoire of this application is enabling video calling in AR such that the remote people may get exemplary learning and which could be seen as 3D.
References
- George Suciu, Stefan Stefanescu, Cristian Beceanu, Marian Ceaparu, “WEBRTC role in real time communication and video conferencing”, Kumar Mridul, M. Ramanathan, Kunal Ahirwar, Mansi Sharma, “Multi- user AR application for video communication in virtual space”, IIT Madras 2019.
- Dikai Fang, Huahu Xu, Xiaoxian Yang, Minjie Bian, “AR based method for remote collaborative real time assistance from a system perspective”, Springer 2019.
- WebRTC Official Website. http://www.webrtc.org/. Accessed 25 June 2018
- W3C WebRTC 1.0: Real-time communication between browsers.https://www.w3.org/TR/2018/CR-webrtc-20180621/. Accessed 28 June 2018
- Jun HE, Peng HAN, Huan LIU, Shiying MEN, Lu JU, Pu ZHEN, Ting WANG,” Research and application of AR Technology”, 2017 IEEE, North Information Control Research Academy Group Co.,Ltd.
- Sung Lae Kim, Hae Jung Suk, Jeong Hwa Kang, Jun Mo Jung, “Using Unity3D to facilitate mobile AR Game Development “, 2014 IEEE World Forum on Internet of Things
- T. Arakawa, K. Kasada, T. Narumi, T. Tanikawa and M. Hirose, "Augmented reality system for overlaying a scene in a video onto real world and reliving the camera operator's experience," 2013 IEEE Virtual Reality (VR), Lake Buena Vista, FL, 2013, pp. 139-140.
- Johnston AB, Burnett DC (2012) WebRTC: APIs and RTCWEB protocols of the HTML5 real-time web [M]. Digital codex LLC
Index Terms
Keywords