A Mixed Reality Simulator Framework for 3D Object Optimization and Depth-of-Field Analysis

Mohamad Jamil; IIs Hamsir Ayub Wahab; Kiswanto Kiswanto; Seh Turuy

doi:10.29407/intensif.v10i1.28116

Authors

Mohamad Jamil Universitas Khairun https://orcid.org/0000-0001-5945-4427
IIs Hamsir Ayub Wahab Universitas Khairun https://orcid.org/0000-0002-2641-5963
Kiswanto ISB Atma Luhur https://orcid.org/0000-0002-7017-1417
Seh Turuy Universitas Khairun https://orcid.org/0009-0007-5683-8792

DOI:

https://doi.org/10.29407/intensif.v10i1.28116

Keywords:

Mixed Reality, Immersive, Framework, Vertex Decimation, Optimization, Depth of Field

Abstract

Background: Mixed Reality (MR) technology enables real-time interaction between physical and digital environments and has become increasingly important in immersive simulation and visualization applications. However, MR implementation still faces challenges related to system performance limitations and the complexity of 3D object rendering, which may reduce immersion quality and interaction realism. Therefore, optimization of 3D assets and visual effects is urgently needed to improve MR efficiency and user experience. Objective: This study aims to propose a design and evaluation framework for Mixed Reality systems by focusing on 3D object optimization and Depth-of-Field (DoF) enhancement in Mixed Reality Simulator (MRSi) development. Methods: The proposed framework integrates vertex decimation-based 3D object optimization and DoF analysis using Circle of Confusion (CoC) calculations. Low-poly 3D assets were optimized through vertex and triangle reduction, while DoF parameters were adjusted based on focal length, aperture, and object distance. Results: The results showed that the proposed approach successfully reduced 3D model complexity by 16.280%–90.950% while maintaining visual quality, with CoC values ranging from 0.0066 to 0.2414, indicating improved depth perception and more realistic visual focus effects in MR environments. The optimization process improved rendering efficiency and enhanced visual realism in Mixed Reality environments. Conclusion: The proposed framework effectively improves MR system performance and immersion quality, providing practical guidance for the development of efficient and visually realistic Mixed Reality applications.

Downloads

Download data is not yet available.

Abstract views: 18 , PDF downloads: 11

References

[1] M. Dolata and G. Schwabe, “What is the Metaverse and who seeks to define it? Mapping the site of social construction,” J. Inf. Technol., 2023, doi: 10.1177/02683962231159927.

[2] S. M. Schöbel and J. M. Leimeister, “Metaverse platform ecosystems,” Electron. Mark., vol. 33, no. 1, 2023, doi: 10.1007/s12525-023-00623-w.

[3] S. Liu and J. Bai, “New development trends of ‘metaverse + psychology’ blending virtual and reality,” Metaverse, vol. 3, no. 1, p. 9, 2022, doi: 10.54517/met.v3i1.1809.

[4] D. Robert, R. Wistort, J. Gray, and C. Breazeal, “Exploring mixed reality robot gaming,” Proc. 5th Int. Conf. Tangible Embed. Embodied Interact. TEI’11, pp. 125–128, 2011, doi: 10.1145/1935701.1935726.

[5] M. Trunfio, T. Jung, and S. Campana, “Mixed reality experiences in museums: Exploring the impact of functional elements of the devices on visitors’ immersive experiences and post-experience behaviours,” Inf. Manag., vol. 59, no. 8, p. 103698, 2022, doi: 10.1016/j.im.2022.103698.

[6] D. J. Wortley, “The Mixed Reality Revolution - Opportunities and Challenges,” vol. 4, no. 5, pp. 53–63, 2022.

[7] M. F. Syahputra, R. Zanury, U. Andayani, and S. M. Hardi, “Heart Disease Simulation with Mixed Reality Technology,” J. Phys. Conf. Ser., vol. 1898, no. 1, 2021, doi: 10.1088/1742-6596/1898/1/012025.

[8] V. Chauhan, “Using Mixed Reality for Iterative Sketching and Prototyping in Product Design,” Int. J. Res. Appl. Sci. Eng. Technol., vol. 11, no. 6, pp. 704–742, 2023, doi: 10.22214/ijraset.2023.53648.

[9] P. S. Gasparello et al., “Use of mixed reality for the training of operators of mobile elevating work platforms with the aim of increasing the level of health and safety at work and reducing training costs,” Front. Virtual Real., vol. 3, no. November, pp. 1–7, 2022, doi: 10.3389/frvir.2022.1034500.

[10] H. Schaffernak et al., “Novel Mixed Reality Use Cases for Pilot Training,” Educ. Sci., vol. 12, no. 5, pp. 1–18, 2022, doi: 10.3390/educsci12050345.

[11] L. R. Rochlen, E. Putnam, R. Levine, and A. R. Tait, “Mixed reality simulation for peripheral intravenous catheter placement training,” BMC Med. Educ., vol. 22, no. 1, pp. 1–8, 2022, doi: 10.1186/s12909-022-03946-y.

[12] A. Brunzini, A. Papetti, D. Messi, and M. Germani, “A comprehensive method to design and assess mixed reality simulations,” Virtual Real., 2022, doi: 10.1007/s10055-022-00632-8.

[13] J. J. Aguilar and Y. Flores, “Analyzing the effectiveness of using mixed-reality simulations to develop elementary pre-service teacher’s high-leverage practices in a mathematics methods course,” Eurasia J. Math. Sci. Technol. Educ., vol. 18, no. 5, pp. 1–12, 2022, doi: 10.29333/ejmste/12006.

[14] A. G. Campbell, K. Santiago, D. Hoo, and E. Mangina, “Future mixed reality educational spaces,” in 2016 Future Technologies Conference (FTC), 2016, pp. 1088–1093. doi: 10.1109/FTC.2016.7821738.

[15] A. Prabhakaran, “Understanding the challenges of immersive technology use in the architecture and construction industry: A systematic review,” Automation in Construction, vol. 137. 2022, doi: 10.1016/j.autcon.2022.104228.

[16] M. Filipenko, A. Angerer, A. Hoffmann, and W. Reif, “Opportunities and Limitations of Mixed Reality Holograms in Industrial Robotics,” no. January, 2020.

[17] T. R. Jonker, “The Role of AI in Mixed and Augmented Reality Interactions,” 2020, doi: doi.org/10.1145/3334480.

[18] A. N. Jayawardena and I. Perera, “A framework for Mixed Reality application development: A case study on Yapahuwa archaeological site,” 16th Int. Conf. Adv. ICT Emerg. Reg. ICTer 2016 - Conf. Proc., no. September, pp. 186–192, 2017, doi: 10.1109/ICTER.2016.7829917.

[19] L. Gong, “A Framework for Extended Reality System Development in Manufacturing,” IEEE Access, vol. 9, pp. 24796–24813, 2021, doi: 10.1109/ACCESS.2021.3056752.

[20] V. Yepes, M. Wolf, H. Söbke, and S. Zander, “Design principles for educational mixed reality? Adaptions of the design recommendations of multimedia learning,” Des. Deploying, Eval. Virtual Augment. Real. Educ., no. April 2022, pp. 76–99, 2020, doi: 10.4018/978-1-7998-5043-4.ch004.

[21] M. Ciccarelli, A. Brunzini, A. Papetti, and M. Germani, “Interface and interaction design principles for Mixed Reality applications: the case of operator training in wire harness activities,” Procedia Comput. Sci., vol. 204, no. 2021, pp. 540–547, 2022, doi: 10.1016/j.procs.2022.08.066.

[22] T. Dalinger, K. B. Thomas, S. Stansberry, and Y. Xiu, “A mixed reality simulation offers strategic practice for pre-service teachers,” Comput. Educ., vol. 144, 2020, doi: 10.1016/j.compedu.2019.103696.

[23] H. N. Sharma, S. A. Alharthi, I. Dolgov, and Z. O. Toups, “A framework supporting selecting space to make place in spatial mixed reality play,” CHI Play 2017 - Proc. Annu. Symp. Comput. Interact. Play, pp. 83–100, 2017, doi: 10.1145/3116595.3116612.

[24] R. Hammady, “Design and development of a spatial mixed reality touring guide to the Egyptian museum,” Multimed. Tools Appl., vol. 79, no. 5, pp. 3465–3494, 2020, doi: 10.1007/s11042-019-08026-w.

[25] S. Rokhsaritalemi, A. Sadeghi-Niaraki, and S. M. Choi, “A review on mixed reality: Current trends, challenges and prospects,” Appl. Sci., vol. 10, no. 2, 2020, doi: 10.3390/app10020636.

[26] C. Sha, H. Zeng, B. Wu, W. Zhang, and H. Guo, “Research on the application of mixed reality technology in the field of art design,” in SHS Web of Conferences 145, 2022. doi: 10.1051/shsconf/202214501022.

[27] V. Krauß, F. Jasche, S. M. Saßmannshausen, T. Ludwig, and A. Boden, “Research and Practice Recommendations for Mixed Reality Design – Different Perspectives from the Community,” in Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology, 2021. doi: 10.1145/3489849.3489876.

[28] L. Wei and D.-M. Cho, “Research on Design of Mixed Reality Interface Based on Spatial Perception,” J. Korea Multimed. Soc., vol. 24, no. 6, pp. 815–824, 2021, doi: 10.9717/kmms.2021.24.6.815.

[29] M. M. Keleşoğlu and D. Güleçözer, “A study on digital low poly modeling methods as an abstraction tool in design processes,” Civ. Eng. Archit., vol. 9, no. 7, pp. 2570–2586, 2021, doi: 10.13189/cea.2021.091513.

[30] D. S. Rana, “3D Modeling and Rendering for Virtual and Augmented reality Applications,” Int. J. Manag., vol. 10, no. 4, pp. 467–476, 2019, doi: https://doi.org/10.17605/OSF.IO/7DUKN.