VR and AR are digital technologies that allow automation and can be used in fields of medicine where repetitive tasks need to be performed and often perfected. With the advancement of technology, both VR and AR systems, in recent years have become more portable, more realistic, and better to navigate in real time, adding a sensory and sometimes olfactory element to the range of sensations. These technologies have been adopted in various domains ranging from entertainment to education because of their accessibility and affordability. AR and VR modalities create an immersive experience, enabling 3D visualization of the content without a conventional 2D display constraint and their high potential and diversity of applications in medicine are already highly visible. In this article the applications of VR and AR in medicine and allied sciences field are explored focusing on future research directions.