Skip to main content
SpringerLink
Log in

Autonomous Lane Keeping System: Lane Detection, Tracking and Control on Embedded System

  • Original Article
  • Published:
Journal of Electrical Engineering & Technology Aims and scope Submit manuscript

Abstract

Autonomous lane keeping system is the key technique to autonomous driving. It includes lane detection, lane tracking and control. It has been developed enormously, but it is still a challenge work due to different factors such as illumination, general hyper-parameters setting for different road condition and lane boundary correction. In addition, due to imbalance on accuracy and processing time, it is hard to conduct in embedding system. In this study, an autonomous lane keeping system is developed based on deep learning. First, a lane detection and tracking system is designed, which is robust to lane boundary correction. Especially for lane detection, a light-weight network named as LaneFCNet is proposed, which can balance accuracy and processing time. Then, lane tracking was followed by detector to improve the detection performance and create autonomous driving trajectory. Finally, to brief lane fitting problem, it was treated as ridge regression problem, which can enhance the effectiveness to the whole system. Experimental results show that our integrated lane detection and tracking system can trade off accuracy and processing time and the whole line keeping system is robust enough to autonomous driving.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Lee JW, Cho J (2009) An effective lane detection and tracking method using statistical modeling of color and lane edge-orientation. In: The fourth international conference on computer sciences and convergence information technology, pp 1586–1591

  2. Jung S, Youn J, Sull S (2016) Efficient lane detection based on spatiotemporal images. IEEE Trans Intell Transp Syst 17:289–295

    Article  Google Scholar 

  3. Li J, Mei X, Prokhorov D (2018) Deep neural network for structural prediction and lane detection in traffic scene. IEEE Trans Neural Netw Learn Syst 28:690–703

    Article  Google Scholar 

  4. Canny J (1986) A computational approach to edge detection. IEEE Trans Pattern Anal Mach Intell PAMI-8:679–698

    Article  Google Scholar 

  5. McCall J, Wipf D, Trivedi M, Rao B (2007) Lane change intent analysis using robust operators and sparse bayesian learning. IEEE Trans Pattern Anal Mach Intell 8:431–440

    Article  Google Scholar 

  6. Khalifa O, Assidiq A, Hashim A (2009) Vision-based lane detection for autonomous artificial intelligent vehicles. In: IEEE international conference semantic computing, pp 636–641

  7. Wang J, Wu Y, Liang Z, Xi Y (2010) Lane detection based on random hough transform on region of interesting. In: IEEE International conference on information and automation, pp 1735–1740

  8. LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86:2278–2324

    Article  Google Scholar 

  9. Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: IEEE conference on computer vision and pattern recognition (CVPR), pp 3431–3440

  10. Truong Q, Lee B, Heo N, Yum Y, Kim J (2008) Lane boundaries detection algorithm using vector lane concept. In: International conference on control, automation, robotics and vision, pp 2319–2325

  11. Chu Z, Sun Y, Wu C, Sepehri N (2018) Active disturbance rejection control applied to automated steering for lane keeping in autonomous vehicles. Control Eng Pract 74:13–21

    Article  Google Scholar 

  12. Kang C, Lee S, Chung C (2018) Multirate lane-keeping system with kinematic vehicle model. IEEE Trans Veh Technol 67:9211–9222

    Article  Google Scholar 

  13. Kang CM, Lee SH, Kee SC, Chung CC (2018) Kinematics-based fault-tolerant techniques: lane prediction for an autonomous lane keeping system. Int J Control Autom Syst 16:1293–1302

    Article  Google Scholar 

  14. Angelos A (2010) A situation-adaptive lane-keeping support system: overview of the SAFELANE approach. IEEE Trans Intell Transp Syst 11:617–629

    Article  Google Scholar 

  15. McCall J, Trivedi M (2006) Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation. IEEE Trans Intell Transp Syst 7:20–37

    Article  Google Scholar 

  16. Sun TY, Tsai S, Chan V (2006) HSI color model-based lane-marking detection. In: IEEE intelligent transportation systems conference, pp 1168–1172

  17. Nedevschi S, Schmid R, Graf T, Danescu R (2004) 3D lane detection system based on stereovision. In: IEEE conference on intelligent transportation systems, pp 161–166

  18. Huval B, Wang T, Tandon S (2015) An empirical evaluation of deep learning on highway driving, arXiv preprint. arXiv: 1504.01716

  19. Li X, Mei X, Prokhorov D (2016) Deep neural network for structural prediction and lane detection in traffic scene. IEEE Trans Neural Netw Learn Syst 28:690–703

    Article  Google Scholar 

  20. Pan X, Shi J, Luo P, Wang X, Tang X (2017) Spatial as Deep: Spatial CNN for Traffic Scene Understanding, arXiv preprint arXiv: 1712.06080

  21. Lee S (2017) VPGNet: vanishing point guided network for lane and road marking detection and recognition, arXiv preprint arXiv: 1710.06288

  22. Neven D, Brabandere B, Georgoulis S, Proesmans M, Gool L (2018) Towards end-to-end lane detection: an instance segmentation approach. In: IEEE intelligent vehicles symposium (IV), pp 770–778

  23. Mohsen G, Cedric N, Nóra B, Olaf B, Michael H (2018) EL-GAN: embedding loss driven generative adversarial networks for lane detection. arXiv preprint arXiv: 1806.05525

  24. Liang A, Guo Y, Zhang S, Zhang S-H, Hall P, Zhang M, Hu S (2018) LineNet: a zoomable CNN for crowdsourced high definition maps modeling in urban environments. arXiv preprint arXiv: 1807.05696

  25. He B, Ai R, Yan Y, Lang X (2016) Accurate and robust lane detection based on dual-view convolutional neutral network. In: IEEE intelligent vehicles symposium (IV), pp 1041–1046

  26. Shi W, Caballero J, Huszár F, Totz J, Wang Z (2016) Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In: IEEE conference on computer vision and pattern recognition(CVPR), pp 1874–1883

  27. Kim NH, Ha JE (2019) One shot extrinsic calibration of a camera and laser range finder using vertical planes. J Electr Eng Technol 14:917–922

    Article  Google Scholar 

  28. Liu M, Jin C, Yang B, Cui X, Kim H (2019) Online multiple object tracking using confidence score-based appearance model learning and hierarchical data association. IET Comput Vis 13:312–318

    Article  Google Scholar 

  29. Coedts M (2016) The cityscapes dataset for semantic urban scene understanding. In: IEEE conference on computer vision and pattern recognition (CVPR), pp 3213–3223

  30. Paszke A, Chaurasia A, Kim S (2016) ENet: a deep neural network architecture for realtime semantic segmentation. arXiv preprint arXiv:1606.02147

  31. He K, Zhang X, Ren S (2016) Deep residual learning for image recognition. In: IEEE conference on computer vision and pattern recognition(CVPR), pp 770–778

  32. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition, arXiv preprint. arXiv:1409.1556

  33. Krähenbühl P, Koltun V, Krähenbühl P, Koltun V (2011) Efficient inference in fully connected CRFS with Gaussian edge potentials. In: Advances in neural information processing systems, pp 109–117

  34. Aly M (2008) Real time detection of lane markers in urban streets. In: IEEE intelligent vehicles symposium, pp 7–12

  35. Fabio A (2019) Autonomous unmanned aerial vehicles in search and rescue missions using real-time cooperative model predictive control. Sensors 19:4067–4088

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Automation, Chongqing University of Posts and Telecommunications, No. 2 Chongwen Road, Chongqing, China

    Mingjie Liu, Xutao Deng, Zhen Lei & Changhao Piao

  2. Department of Mechanical Engineering, Inha University, 100 Inha-ro Nam-gu, Incheon, Republic of Korea

    Chao Jiang

Authors
  1. Mingjie Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xutao Deng
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhen Lei
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Chao Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Changhao Piao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chao Jiang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, M., Deng, X., Lei, Z. et al. Autonomous Lane Keeping System: Lane Detection, Tracking and Control on Embedded System. J. Electr. Eng. Technol. 16, 569–578 (2021). https://doi.org/10.1007/s42835-020-00570-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s42835-020-00570-y

Keywords

Search

Navigation