4D Scene Reconstruction in Multi-Target Scenarios

Benedek, Csaba and Jankó, Zsolt and Molnár, Dömötör László and Horváth, Csaba and Csetverikov, Dmitrij and Szirányi, Tamás (2013) 4D Scene Reconstruction in Multi-Target Scenarios. Technical Report. MTA SZTAKI. i4D-3


Download (2MB) | Preview


In this report, we introduce a complex approach on 4D reconstruction of dynamic scenarios containing multiple walking pedestrians. The input of the process is a point cloud sequence recorded by a rotating multi-beam Lidar sensor, which monitors the scene from a fixed position. The output is a geometrically reconstructed and textured scene containing moving 4D people models, which can follow in real time the trajectories of the walking pedestrians observed on the Lidar data flow. Our implemented system consists of four main steps. First, we separate foreground and background regions in each point cloud frame of the sequence by a robust probabilistic approach. Second, we perform moving pedestrian detection and tracking, so that among the point cloud regions classified as foreground, we separate the different objects, and assign the corresponding people positions to each other over the consecutive frames of the Lidar measurement sequence. Third, we geometrically reconstruct the ground, walls and further objects of the background scene, and texture the obtained models with photos taken from the scene. Fourth we insert into the scene textured 4D models of moving pedestrians which were preliminary created in a special 4D reconstruction studio. Finally, we integrate the system elements in a joint dynamic scene model and visualize the 4D scenario.

Item Type: Monograph (Technical Report)
Uncontrolled Keywords: rotating multi-beam Lidar, MRF, motion segmentation, 4D reconstruction
Subjects: Q Science > QA Mathematics and Computer Science > QA75 Electronic computers. Computer science / számítástechnika, számítógéptudomány
Divisions: Distributed Events Analysis Research Laboratory
Depositing User: Csaba Benedek
Date Deposited: 10 Feb 2014 12:57
Last Modified: 10 Feb 2014 12:57
URI: https://eprints.sztaki.hu/id/eprint/7768

Update Item Update Item