# American Institute of Mathematical Sciences

• Previous Article
Optimal production and emission reduction policies for a remanufacturing firm considering deferred payment strategy
• JIMO Home
• This Issue
• Next Article
Robust observer-based control for discrete-time semi-Markov jump systems with actuator saturation
doi: 10.3934/jimo.2021059

## Stereo visual odometry based on dynamic and static features division

 College of Missile Engineering, Rocket Force University of Engineering, Xi'an, Shaanxi 710025, China

* Corresponding author: Guangbin Cai

Received  June 2020 Revised  December 2020 Published  March 2021

Fund Project: The first author is mainly supported by NSSF of China under Grant (No. 61773387)

Accurate camera pose estimation in dynamic scenes is an important challenge for visual simultaneous localization and mapping, and it is critical to reduce the effects of moving objects on pose estimation. To tackle this problem, a robust visual odometry approach in dynamic scenes is proposed, which can precisely distinguish between dynamic and static features. The key to the proposed method is combining the scene flow and the static features relative spatial distance invariance principle. Moreover, a new threshold is proposed to distinguish dynamic features.Then the dynamic features are eliminated after matching with the virtual map points. In addition, a new similarity calculation function is proposed to improve the performance of loop-closure detection. Finally, the camera pose is optimized after obtaining a closed loop. Experiments have been conducted on TUM datasets and actual scenes, which shows that the proposed method reduces tracking errors significantly and estimates the camera pose precisely in dynamic scenes.

Citation: Hui Xu, Guangbin Cai, Xiaogang Yang, Erliang Yao, Xiaofeng Li. Stereo visual odometry based on dynamic and static features division. Journal of Industrial & Management Optimization, doi: 10.3934/jimo.2021059
##### References:

show all references

##### References:
Stereo camera model
Generation of a visual vocabulary tree
Overview of the proposed algorithm in dynamic scenes
]">Figure 4.  Classification of the scene flow based on angles [26]
Invariance of the relative spatial distance of the static points
Construction of the virtual map points
Three static features selected by the algorithm
Dynamic features obtained by the algorithm
Experiment scene sets
Experimental results of ORB-VO in lab scenes
Experimental results of the proposed method in lab scenes
Loop-closure detection result of the inverse proportional function
Loop-closure detection result of the negative exponential power function
Loop-closure detection result of the negative exponential power function
Comparisons between estimated trajectories and the ground truth in walking sequences
Comparisons between estimated trajectories and the ground truth in sitting sequences
Translation drift and rotational drift of VO method on TUM dataset
 Sequences RMSE of translational drift [m/s] RMSE of rotational drift [$^{\circ}$/s] DVO BaMVO SPW-VO Our Method DVO BaMVO SPW-VO Our Method sitting-static 0.0157 0.0248 0.0231 0.0112 0.6084 0.6977 0.7228 0.3356 sitting-xyz 0.0453 0.0482 0.0219 0.0132 1.4980 1.3885 0.8466 0.5753 sitting-rpy 0.1735 0.1872 0.0843 0.0280 6.0164 5.9834 5.6258 0.6811 sitting-halfsphere 0.1005 0.0589 0.0389 0.0151 4.6490 2.8804 1.8836 0.6103 walking-static 0.3818 0.1339 0.0327 0.0293 6.3502 2.0833 0.8085 0.5500 walking-xyz 0.4360 0.2326 0.0651 0.1034 7.6669 4.3911 1.6442 2.3273 walking-rpy 0.4038 0.3584 0.2252 0.2143 7.0662 6.3898 5.6902 3.9555 walking-halfsphere 0.2628 0.1738 0.0527 0.1061 5.2179 4.2863 2.4048 2.2983
 Sequences RMSE of translational drift [m/s] RMSE of rotational drift [$^{\circ}$/s] DVO BaMVO SPW-VO Our Method DVO BaMVO SPW-VO Our Method sitting-static 0.0157 0.0248 0.0231 0.0112 0.6084 0.6977 0.7228 0.3356 sitting-xyz 0.0453 0.0482 0.0219 0.0132 1.4980 1.3885 0.8466 0.5753 sitting-rpy 0.1735 0.1872 0.0843 0.0280 6.0164 5.9834 5.6258 0.6811 sitting-halfsphere 0.1005 0.0589 0.0389 0.0151 4.6490 2.8804 1.8836 0.6103 walking-static 0.3818 0.1339 0.0327 0.0293 6.3502 2.0833 0.8085 0.5500 walking-xyz 0.4360 0.2326 0.0651 0.1034 7.6669 4.3911 1.6442 2.3273 walking-rpy 0.4038 0.3584 0.2252 0.2143 7.0662 6.3898 5.6902 3.9555 walking-halfsphere 0.2628 0.1738 0.0527 0.1061 5.2179 4.2863 2.4048 2.2983
RMSE of the ATE of camera pose estimation (m$^{-1}$)
 Sequences ORB-SLAM2 MR-SLAM SPW-SLAM SF-SLAM Our Method sitting-static 0.0082 – – 0.0081 0.0073 sitting-xyz 0.0094 0.0482 0.0397 0.0101 0.0090 sitting-rpy 0.0197 – – 0.0180 0.0162 sitting-halfsphere 0.0211 0.0470 0.0432 0.0239 0.0164 walking-static 0.1028 0.0656 0.0261 0.0120 0.0108 walking-xyz 0.4278 0.0932 0.0601 0.2251 0.0884 walking-rpy 0.7407 0.1333 0.1791 0.1961 0.3620 walking-halfsphere 0.4939 0.1252 0.0489 0.0423 0.0411
 Sequences ORB-SLAM2 MR-SLAM SPW-SLAM SF-SLAM Our Method sitting-static 0.0082 – – 0.0081 0.0073 sitting-xyz 0.0094 0.0482 0.0397 0.0101 0.0090 sitting-rpy 0.0197 – – 0.0180 0.0162 sitting-halfsphere 0.0211 0.0470 0.0432 0.0239 0.0164 walking-static 0.1028 0.0656 0.0261 0.0120 0.0108 walking-xyz 0.4278 0.0932 0.0601 0.2251 0.0884 walking-rpy 0.7407 0.1333 0.1791 0.1961 0.3620 walking-halfsphere 0.4939 0.1252 0.0489 0.0423 0.0411
 [1] Xianchao Xiu, Ying Yang, Wanquan Liu, Lingchen Kong, Meijuan Shang. An improved total variation regularized RPCA for moving object detection with dynamic background. Journal of Industrial & Management Optimization, 2020, 16 (4) : 1685-1698. doi: 10.3934/jimo.2019024 [2] Pablo D. Carrasco, Túlio Vales. A symmetric Random Walk defined by the time-one map of a geodesic flow. Discrete & Continuous Dynamical Systems, 2021, 41 (6) : 2891-2905. doi: 10.3934/dcds.2020390 [3] Chris Guiver, Nathan Poppelreiter, Richard Rebarber, Brigitte Tenhumberg, Stuart Townley. Dynamic observers for unknown populations. Discrete & Continuous Dynamical Systems - B, 2021, 26 (6) : 3279-3302. doi: 10.3934/dcdsb.2020232 [4] Yu Jin, Xiao-Qiang Zhao. The spatial dynamics of a Zebra mussel model in river environments. Discrete & Continuous Dynamical Systems - B, 2021, 26 (4) : 1991-2010. doi: 10.3934/dcdsb.2020362 [5] Shi'an Wang, N. U. Ahmed. Optimal control and stabilization of building maintenance units based on minimum principle. Journal of Industrial & Management Optimization, 2021, 17 (4) : 1713-1727. doi: 10.3934/jimo.2020041 [6] Rafael Luís, Sandra Mendonça. A note on global stability in the periodic logistic map. Discrete & Continuous Dynamical Systems - B, 2020, 25 (11) : 4211-4220. doi: 10.3934/dcdsb.2020094 [7] Alexandr Mikhaylov, Victor Mikhaylov. Dynamic inverse problem for Jacobi matrices. Inverse Problems & Imaging, 2019, 13 (3) : 431-447. doi: 10.3934/ipi.2019021 [8] Habib Ammari, Josselin Garnier, Vincent Jugnon. Detection, reconstruction, and characterization algorithms from noisy data in multistatic wave imaging. Discrete & Continuous Dynamical Systems - S, 2015, 8 (3) : 389-417. doi: 10.3934/dcdss.2015.8.389 [9] Yongkun Wang, Fengshou He, Xiaobo Deng. Multi-aircraft cooperative path planning for maneuvering target detection. Journal of Industrial & Management Optimization, 2021  doi: 10.3934/jimo.2021050 [10] Gioconda Moscariello, Antonia Passarelli di Napoli, Carlo Sbordone. Planar ACL-homeomorphisms : Critical points of their components. Communications on Pure & Applied Analysis, 2010, 9 (5) : 1391-1397. doi: 10.3934/cpaa.2010.9.1391 [11] Clara Cufí-Cabré, Ernest Fontich. Differentiable invariant manifolds of nilpotent parabolic points. Discrete & Continuous Dynamical Systems, 2021  doi: 10.3934/dcds.2021053 [12] Teddy Pichard. A moment closure based on a projection on the boundary of the realizability domain: 1D case. Kinetic & Related Models, 2020, 13 (6) : 1243-1280. doi: 10.3934/krm.2020045 [13] Mario Bukal. Well-posedness and convergence of a numerical scheme for the corrected Derrida-Lebowitz-Speer-Spohn equation using the Hellinger distance. Discrete & Continuous Dynamical Systems, 2021, 41 (7) : 3389-3414. doi: 10.3934/dcds.2021001 [14] Shanshan Chen, Junping Shi, Guohong Zhang. Spatial pattern formation in activator-inhibitor models with nonlocal dispersal. Discrete & Continuous Dynamical Systems - B, 2021, 26 (4) : 1843-1866. doi: 10.3934/dcdsb.2020042 [15] Paul Deuring. Spatial asymptotics of mild solutions to the time-dependent Oseen system. Communications on Pure & Applied Analysis, , () : -. doi: 10.3934/cpaa.2021044 [16] Shu-Yu Hsu. Existence and properties of ancient solutions of the Yamabe flow. Discrete & Continuous Dynamical Systems, 2018, 38 (1) : 91-129. doi: 10.3934/dcds.2018005 [17] Simone Cacace, Maurizio Falcone. A dynamic domain decomposition for the eikonal-diffusion equation. Discrete & Continuous Dynamical Systems - S, 2016, 9 (1) : 109-123. doi: 10.3934/dcdss.2016.9.109 [18] Matthias Erbar, Jan Maas. Gradient flow structures for discrete porous medium equations. Discrete & Continuous Dynamical Systems, 2014, 34 (4) : 1355-1374. doi: 10.3934/dcds.2014.34.1355 [19] Zhengchao Ji. Cylindrical estimates for mean curvature flow in hyperbolic spaces. Communications on Pure & Applied Analysis, 2021, 20 (3) : 1199-1211. doi: 10.3934/cpaa.2021016 [20] Bin Pei, Yong Xu, Yuzhen Bai. Convergence of p-th mean in an averaging principle for stochastic partial differential equations driven by fractional Brownian motion. Discrete & Continuous Dynamical Systems - B, 2020, 25 (3) : 1141-1158. doi: 10.3934/dcdsb.2019213

2019 Impact Factor: 1.366

## Tools

Article outline

Figures and Tables