Road Condition Detection and Emergency Rescue Recognition Using On-Board UAV in the Wildness
Liu, Chang and Szirányi, Tamás (2022) Road Condition Detection and Emergency Rescue Recognition Using On-Board UAV in the Wildness. REMOTE SENSING, 14 (17). ISSN 2072-4292 10.3390/rs14174355
|
Text
Liu_1_33086093_ny.pdf Download (9MB) | Preview |
Abstract
Unmanned aerial vehicle (UAV) vision technology is becoming increasingly important, especially in wilderness rescue. For humans in the wilderness with poor network conditions and bad weather, this paper proposes a technique for road extraction and road condition detection from video captured by UAV multispectral cameras in real-time or pre-downloaded multispectral images from satellites, which in turn provides humans with optimal route planning. Additionally, depending on the flight altitude of the UAV, humans can interact with the UAV through dynamic gesture recognition to identify emergency situations and potential dangers for emergency rescue or re-routing. The purpose of this work is to detect the road condition and identify emergency situations in order to provide necessary and timely assistance to humans in the wild. By obtaining a normalized difference vegetation index (NDVI), the UAV can effectively distinguish between bare soil roads and gravel roads, refining the results of our previous route planning data. In the low-altitude human–machine interaction part, based on media-pipe hand landmarks, we combined machine learning methods to build a dataset of four basic hand gestures for sign for help dynamic gesture recognition. We tested the dataset on different classifiers, and the best results show that the model can achieve 99.99% accuracy on the testing set. In this proof-of-concept paper, the above experimental results confirm that our proposed scheme can achieve our expected tasks of UAV rescue and route planning.
| Item Type: | Article |
|---|---|
| Subjects: | Q Science > QA Mathematics and Computer Science > QA75 Electronic computers. Computer science / számítástechnika, számítógéptudomány |
| Divisions: | Distributed Events Analysis Research Laboratory |
| SWORD Depositor: | MTMT Injector |
| Depositing User: | MTMT Injector |
| Date Deposited: | 06 Oct 2022 08:20 |
| Last Modified: | 11 Sep 2023 15:07 |
| URI: | https://eprints.sztaki.hu/id/eprint/10380 |
 |
Update Item |
