Reality capture techniques and tools, such as LiDAR, photogrammetry, 360-degree photography, virtual reality (VR) and unmanned aerial system (UAS), have been adopted by the architecture, engineering and construction (AEC) industry with various applications on both new-build and heritage projects.

These applications of reality capture include as-built documentation, construction progress monitoring, project team coordination, quality assurance (QA) and quality control (QC), progress reporting, preservation planning, damage assessment, restoration, rehabilitation, and marketing, etc. The data collected through reality capture processes at historic structures can be further processed and used to develop Heritage Building Information Modeling (HBIM) models, presenting an advanced method for digital preservation and interpretation.

Presented by:

• Dr. Anoop Sattineni, Associate Professor, McWhorter School of Building Science, Auburn University
• Dr. Danielle Willkens, Assistant Professor, School of Architecture, Georgia Institute of Technology
• Dr. Junshan Liu, Associate Professor, McWhorter School of Building Science, Auburn University
• Dr. Scott Kramer, Professor, McWhorter School of Building Science, Auburn University
• Dr. Tom Leathem, Associate Professor, McWhorter School of Building Science, Auburn University

This workshop will showcase the use of Augmented Reality and Reality Capture technologies for emergency inspection, search and rescue. Inspection in confined areas after a disaster, or search and rescue for emergency responses, usually pose significant risks to the on-site personnel. Especially when the on-site activities are affected by occlusions, uncertain hazards can threaten the safety of professionals. Reality capture technologies have the potential to improve emergency responses and forensics engineering.

This workshop will demonstrate the latest technologies developed by the Informatics, Cobots and Intelligent Construction (ICIC) lab at University of Florida. A robot dog carries LiDAR and depth camera sensors to enter into an unknown space. The spatial data and mesh data are captured and optimized by in a ROS system. Then a cloud server is used to transfer the real-time point cloud data to Unity, a game engine. VFX and shaders are applied to the raw point cloud data to optimize the rendering. Finally, the rendered point cloud data is sent to a HoloLens 2 headset. A search tree-based method is applied to register the point cloud model with the HoloLens 2 viewpoints, to generate an illusion of “seeing through walls”. Participants will have an opportunity to experiment with the technologies themselves.

Presented by:

• Dr. Eric Jing Du, Associate Professor, Department of Civil and Coastal Engineering, University of Florida
• Dr. Fei Dai, Associate Professor, Wadsworth Department of Civil and Environmental Engineering, West Virginia University
• Dr. Dong Zhao, Assistant Professor, Construction Management; Adjunct Associate Professor, Department of Civil and Environmental Engineering, School of Planning, Design and Construction, Michigan State University
• Dr. Shuai Li, Assistant Professor, Department of Civil and Environmental Engineering, University of Tennessee
• Yang Ye, PhD candidate, Department of Civil and Coastal Engineering, University of Florida
• Hengxu You, PhD candidate, Department of Civil and Coastal Engineering, University of Florida