Systematic Literature Review of 3D Object Replacement Algorithms in Live Broadcasts

Authors

  • Alexandra Polo Martinez Rafael Nuñez University Corporation, System Engineering Program, Sistemas Neurodifusos Research Group, Colombia, Cartagena https://orcid.org/0009-0004-9611-5271
  • Miguel Caro Alvárez Rafael Nuñez University Corporation, System Engineering Program, Sistemas Neurodifusos Research Group, Colombia, Cartagena. https://orcid.org/0009-0008-6097-716X
  • Jorge Manuel Barrios Sánchez Rafael Nuñez University Corporation, System Engineering Program, Sistemas Neurodifusos Research Group, Colombia, Cartagena
  • Udualdo Herrera-García Rafael Nuñez University Corporation, System Engineering Program, Sistemas Neurodifusos Research Group, Colombia, Cartagena. https://orcid.org/0000-0002-9394-112X
  • Jairo Acosta-Solano Rafael Nuñez University Corporation, System Engineering Program, Sistemas Neurodifusos Research Group, Colombia, Cartagena https://orcid.org/0000-0001-7788-2812

DOI:

https://doi.org/10.61467/2007.1558.2026.v17i4.1330

Keywords:

3D Object Replacement, Live Streaming, Content Moderation, Computer Vision, Photogrammetry, Reemplazo de objetos 3D, visión por computadora, fotogrametría

Abstract

The exponential growth of live broadcasts has exacerbated the exposure of vulnerable audiences to inappropriate visual content, surpassing the capabilities of traditional reactive moderation. This systematic literature review investigates the potential of 3D object replacement algorithms as a proactive real-time solution. By analyzing research from the last five years, the study identifies key methodologies in photogrammetry, deep learning, and physically based rendering capable of dynamic substitution. Results indicate that while detection and modeling technologies are advanced, significant challenges regarding latency and visual coherence in dynamic environments remain. The paper concludes that integrating these technologies offers a promising pathway for automating content safety, particularly for protecting minors, though further research on real-time optimization is required.

 

Spanish-language metadata / Metadatos en español
Título en español:
Revisión sistemática de la literatura sobre algoritmos de reemplazo de objetos 3D en transmisiones en vivo

Resumen:

El crecimiento exponencial de las transmisiones en vivo ha incrementado la exposición de audiencias vulnerables a contenidos visuales inapropiados, superando las capacidades de la moderación reactiva tradicional. Esta revisión sistemática de la literatura investiga el potencial de los algoritmos de reemplazo de objetos 3D como una solución proactiva en tiempo real. Mediante el análisis de investigaciones publicadas durante los últimos cinco años, el estudio identifica metodologías clave de fotogrametría, aprendizaje profundo y renderizado basado en principios físicos capaces de realizar sustituciones dinámicas. Los resultados indican que, aunque las tecnologías de detección y modelado se encuentran avanzadas, persisten desafíos importantes relacionados con la latencia y la coherencia visual en entornos dinámicos. El artículo concluye que la integración de estas tecnologías ofrece una vía prometedora para automatizar la seguridad de los contenidos, particularmente para proteger a los menores de edad, aunque se requieren investigaciones adicionales sobre la optimización en tiempo real.

Palabras Claves:
Reemplazo de objetos 3D; transmisiones en vivo; moderación de contenidos; visión por computadora; fotogrametría.


Smart citations:

https://scite.ai/reports/10.61467/2007.1558.2026.v17i4.1330
Dimensions.
Open Alex.

References

Alcántara, J. C., Tasic, I., & Cano, M.-D. (2024). Enhancing digital identity: Evaluating avatar creation tools and privacy challenges for the metaverse. Information, 15(10), Article 624. https://doi.org/10.3390/info15100624

Atencio, E., Duarte, F., Lozano-Galant, F., Porras, R., & Xia, Y. (2026). AI-based 3D modeling strategies for civil infrastructure: Quantitative assessment of NeRF and photogrammetry. Sensors, 26(3), Article 852. https://doi.org/10.3390/s26030852

Benítez Obando, I. F., Quevedo Tumailli, W. J., Chela Ninabanda, C. S., & Solórzano Costales, Á. X. (2024). Modelado de objetos, una herramienta para la publicidad digital. Polo del Conocimiento, 9(1), 1867–1879. https://doi.org/10.23857/pc.v9i1.6469

Cai, J., & Wohn, D. Y. (2019). Categorizing live streaming moderation tools: An analysis of Twitch. International Journal of Interactive Communication Systems and Technologies, 9(2), 36–50. https://doi.org/10.4018/IJICST.2019070103

Chen, H., Chu, X., Li, M., Liu, Y., Zhou, J., Fu, X., Liu, S., & Yu, F. (2026). Multi-view 3D reconstruction of ship hull via multi-scale weighted neural radiation field. Journal of Marine Science and Engineering, 14(2), Article 229. https://doi.org/10.3390/jmse14020229

Deng, H., Zhang, Q., Jin, H., & Kim, C.-H. (2023). Real-time interaction for 3D pixel human in virtual environment. Applied Sciences, 13(2), Article 966. https://doi.org/10.3390/app13020966

Fabra, L., Solanes, J. E., Muñoz, A., Martí-Testón, A., Alabau, A., & Gracia, L. (2024). Application of neural radiance fields (NeRFs) for 3D model representation in the industrial metaverse. Applied Sciences, 14(5), Article 1825. https://doi.org/10.3390/app14051825

Ferrara, P., Franceschini, G., Corsello, G., Mestrovic, J., Giardino, I., Vural, M., Pop, T. L., Namazova-Baranova, L., & Pettoello-Mantovani, M. (2021). The dark side of the web—A risk for children and adolescents challenged by isolation during the novel coronavirus 2019 pandemic. The Journal of Pediatrics, 228, 324–325.e2. https://doi.org/10.1016/j.jpeds.2020.10.008

Galcerá, S., Navarro, S., Cabrelles, M., & Lerma, J. L. (2009). Generación de vídeos a partir de modelos 3D [Paper presentation]. Semana Geomática Internacional–Globalgeo, Barcelona, Spain.

Gómez Echeverry, L. L., Jaramillo Henao, A. M., Ruiz Molina, M. A., Velásquez Restrepo, S. M., Páramo Velásquez, C. A., & Silva Bolívar, G. J. (2018). Sistemas de captura y análisis de movimiento cinemático humano: Una revisión sistemática. Prospectiva, 16(2), 24–34. https://doi.org/10.15665/rp.v16i2.1587

Gongane, V. U., Munot, M. V., & Anuse, A. D. (2022). Detection and moderation of detrimental content on social media platforms: Current status and future directions. Social Network Analysis and Mining, 12(1), Article 129. https://doi.org/10.1007/s13278-022-00951-3

Grandón-Pastén, N., Aracena-Pizarro, D., & Tozzi, C. L. (2007). Reconstrucción de objeto 3D a partir de imágenes calibradas. Ingeniare. Revista Chilena de Ingeniería, 15(2), 158–168. https://doi.org/10.4067/S0718-33052007000200006

Helle, R. H., & Lemu, H. G. (2021). A case study on use of 3D scanning for reverse engineering and quality control. Materials Today: Proceedings, 45, 5255–5262. https://doi.org/10.1016/j.matpr.2021.01.828

Herling, J. (2014). Advanced real-time manipulation of video streams. Springer Vieweg. https://doi.org/10.1007/978-3-658-05810-4

Ingale, A. K., & Divya Udayan, J. (2021). Real-time 3D reconstruction techniques applied in dynamic scenes: A systematic literature review. Computer Science Review, 39, Article 100338. https://doi.org/10.1016/j.cosrev.2020.100338

Kakkar, P., Mukherjee, S., Ragothaman, H., & Mehta, V. (2024). Physics based differentiable rendering for inverse problems and beyond. Journal of Electrical Systems, 20(11s), 472–481. https://doi.org/10.52783/JES.7210

Kamali, M., Atazadeh, B., Rajabifard, A., & Chen, Y. (2024). Advancements in 3D digital model generation for digital twins in industrial environments: Knowledge gaps and future directions. Advanced Engineering Informatics, 62, Article 102929. https://doi.org/10.1016/j.aei.2024.102929

Kitchenham, B. A., Mendes, E., & Travassos, G. H. (2007). Cross versus within-company cost estimation studies: A systematic review. IEEE Transactions on Software Engineering, 33(5), 316–329. https://doi.org/10.1109/TSE.2007.1001

Korycki, A., Yeaton, C., Gilbert, G. S., Josephson, C., & McGuire, S. (2025). NeRF-accelerated ecological monitoring in mixed-evergreen redwood forest. Forests, 16(1), Article 173. https://doi.org/10.3390/f16010173

Kovac, F. D., Fruccio, W., & Mieza, M. S. (2021). Modelado 3D de superficies regulares utilizando software educativo. In Actas del II Simposio Argentino de Imágenes y Visión (SAIV 2021): 50 JAIIO (pp. 11–15). SADIO. https://sedici.unlp.edu.ar/handle/10915/141280

Luis Tello, J. J. (2023). Estudio de los materiales en entornos 3D con render en tiempo real para la creación en artes digitales [Doctoral dissertation, Universidad de Murcia]. Digitum. https://digitum.um.es/digitum/handle/10201/134903

Luque Ordóñez, J. (2020). Realidad virtual y realidad aumentada. Revista Digital de ACTA, (63), 1–19. https://www.acta.es/recursos/revista-digital-manuales-formativos/616-063

Mantri, A. (2021). Real-time content moderation using artificial intelligence and machine learning. International Journal of Science and Research, 10(1), 1682–1684. https://doi.org/10.21275/sr24724150350

Martínez, F., Gómez, F., & Romero, E. (2009). Análisis de vídeo para estimación del movimiento humano: Una revisión. Revista Med, 17(1), 95–106. http://www.scielo.org.co/scielo.php?script=sci_arttext&pid=S0121-52562009000100014

Meerits, S., & Saito, H. (2015). Real-time diminished reality for dynamic scenes. In 2015 IEEE International Symposium on Mixed and Augmented Reality Workshops (ISMARW) (pp. 53–59). IEEE. https://doi.org/10.1109/ISMARW.2015.19

Meng, X., Li, Y., Liu, K., Liu, Y., Yang, B., Song, X., Liao, G., Wang, S., Yu, Z., Chen, L., Pan, X., & Lin, Y. (2025). Spatial data intelligence and city metaverse: A review. Fundamental Research, 5(3), 1169–1193. https://doi.org/10.1016/j.fmre.2023.10.014

Mori, S., Ikeda, S., & Saito, H. (2017). A survey of diminished reality: Techniques for visually concealing, eliminating, and seeing through real objects. IPSJ Transactions on Computer Vision and Applications, 9, Article 17. https://doi.org/10.1186/s41074-017-0028-1

Muñoz, A., Jiménez-Pérez, A., & Morales-Rosales, L. A. (2024). Clonación digital de objetos mediante proyección de franjas e impresión 3D. Innovación y Desarrollo Tecnológico Revista Digital, 16(4), 1819–1820. https://iydt.wordpress.com/wp-content/uploads/2024/10/4_49_clonacion-digital-de-objetos-mediante-proyeccion-de-franjas_.pdf

Olmedo López, G., & Torrico Irahola, R. A. (2023). Realidad aumentada y modelado 3D aplicado en programas de televisión transmitidos desde los estudios de radiotelevisión de Veracruz-México. Ciencia Latina Revista Científica Multidisciplinar, 7(2), 1798–1815. https://doi.org/10.37811/cl_rcm.v7i2.5438

Pardo-Gómez, M. E., Izquierdo-Pardo, J. M., & Izquierdo-Lao, J. M. (2023). Los modelos digitales tridimensionales como recursos educativos abiertos en la educación universitaria. Revista Latinoamericana de Tecnología Educativa—RELATEC, 22(1), 261–277. https://doi.org/10.17398/1695-288X.22.1.261

Pepe, M., Alfio, V. S., & Costantino, D. (2023). Assessment of 3D model for photogrammetric purposes using AI tools based on NeRF algorithm. Heritage, 6(8), 5719–5731. https://doi.org/10.3390/heritage6080301

Petrovska, I., & Jutzi, B. (2024). Vision through obstacles—3D geometric reconstruction and evaluation of neural radiance fields (NeRFs). Remote Sensing, 16(7), Article 1188. https://doi.org/10.3390/rs16071188

Rangelov, D., Waanders, S., Waanders, K., van Keulen, M., & Miltchev, R. (2024). Impact of camera settings on 3D reconstruction quality: Insights from NeRF and Gaussian splatting. Sensors, 24(23), Article 7594. https://doi.org/10.3390/s24237594

Roa Becerra, J. J., Rojas Ramírez, S. F., & Torres Benito, D. C. (2022). Recursos, técnicas y herramientas digitales 3D: El hombre adaptándose a una nueva realidad (Documentos de Trabajo Areandina No. 2022-2). Fundación Universitaria del Área Andina. https://doi.org/10.33132/26654644.2045

Rodríguez Navarro, P. (2012). La fotogrametría digital automatizada frente a los sistemas basados en sensores 3D activos. EGA. Revista de Expresión Gráfica Arquitectónica, 17(20), 100–111. https://doi.org/10.4995/ega.2012.1408

Sánchez García, A., Estévez, E., Ruano Ruano, I., Gómez Ortega, J., & Gámez García, J. (2022). Plataforma código abierto para generar gemelos digitales. In XLIII Jornadas de Automática: Libro de actas (pp. 941–948). Servizo de Publicacións da Universidade da Coruña. https://doi.org/10.17979/spudc.9788497498418.0941

Sui, C., He, K., Lyu, C., & Liu, Y. H. (2022). Accurate 3D reconstruction of dynamic objects by spatial-temporal multiplexing and motion-induced error elimination. IEEE Transactions on Image Processing, 31, 2106–2121. https://doi.org/10.1109/TIP.2022.3150297

Van Holland, L., Stotko, P., Krumpen, S., Klein, R., & Weinmann, M. (2023). Efficient 3D reconstruction, streaming and visualization of static and dynamic scene parts for multi-client live-telepresence in large-scale environments. In 2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) (pp. 4260–4274). IEEE. https://doi.org/10.1109/ICCVW60793.2023.00460

Xiao, B. (2023). Making the private public: Regulating content moderation under Chinese law. Computer Law & Security Review, 51, Article 105893. https://doi.org/10.1016/j.clsr.2023.105893

Yu, J., Chen, C., Zhang, C., & Ji, W. (2025). Real-time monitoring and dynamic interaction methods based on digital twin workshop theory. Processes, 13(3), Article 685. https://doi.org/10.3390/pr13030685

Zhang, D. Y., Li, Q., Tong, H., Badilla, J., Zhang, Y., & Wang, D. (2018). Crowdsourcing-based copyright infringement detection in live video streams. In Proceedings of the 2018 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) (pp. 367–374). IEEE. https://doi.org/10.1109/ASONAM.2018.8508523

Downloads

Published

2026-08-02

How to Cite

Polo Martinez, A., Caro Alvárez, M., Barrios Sánchez, J. M., Herrera-García, U., & Acosta-Solano, J. (2026). Systematic Literature Review of 3D Object Replacement Algorithms in Live Broadcasts. International Journal of Combinatorial Optimization Problems and Informatics, 17(4), 171–179. https://doi.org/10.61467/2007.1558.2026.v17i4.1330

Issue

Section

Articles