An Intelligent Q-Learning-Based Routing Model

Abstract

The rising speed of data transmission requires modern technology to meet its essential requirement of network communication efficiency through effective routing techniques. Routers act as the central elements of this functionality which demonstrates why their optimal performance needs attention. This work introduces an intelligent routing design that applies machine learning approaches for network performance optimization under dynamic network environments. The fluctuating environments decrease the effectiveness of traditional routing protocols including RIP, BGP and OSPF while causing their routing performance to deteriorate. The proposed model implements machine learning-based decision adjustment methods that apply current network information to dynamically reroute data. The routing system uses supervised and unsupervised learning approaches to predict network traffic congestions and choose the most suitable routes. Network performance optimization relies on the incorporation of latency, bandwidth, packet loss, congestion, jitter, reliability, energy efficiency in addition to cost parameters before training occurs using historical network information. Python-based development achieved enhanced network throughput in addition to faster operation with better adaptability and resource-efficient management of changing network conditions. Machine learning arrives as a transformative force for network routing through adaptive intelligent communication systems which surpass traditional protocols for modern networking requirements. 

Country : Iraq

1 Ghazwan F. Yassin2 Ayad H. Abdulqader

  1. Computer Science Department, College of Computer Science and Mathematics, University of Mosul, Iraq
  2. Computer Science Department, College of Computer Science and Mathematics, University of Mosul, Iraq

IRJIET, Volume 9, Issue 2, February 2025 pp. 58-68

doi.org/10.47001/IRJIET/2025.902008

References

  1. A.F. M. Z. Abadin, S. Sarker, M. S. Hosain, M. M. Ahmed, and A. Imtiaz, “A Comprehensive Study and Analysis of Different Routing Protocols for Enterprise LAN,” … J. Sci. …, no. December, pp. 20–28, 2021.
  2. K. Shahid, S. N. Ahmad, and S. T. H. Rizvi, “Optimizing Network Performance: A Comparative Analysis of EIGRP, OSPF, and BGP in IPv6-Based Load-Sharing and Link-Failover Systems,” Futur. Internet, vol. 16, no. 9, 2024.
  3. R. N. Devikar, D. V. Patil, and V. Chandraprakash, “Study of BGP convergence time,” Int. J. Electr. Comput. Eng., vol. 6, no. 1, pp. 413–420, 2016.
  4. A. Srinivasan, “Reinforcement Learning: Advancements, Limitations, and Real-world Applications,” Interantional J. Sci. Res. Eng. Manag., vol. 07, no. 08, 2023.
  5. M. Y. Kashmola and N. R. H. Al-Kadow, “Improving AntNet algorithm in routing protocols to find the optimal path according to time,” 2013 Int. Conf. Electr. Commun. Comput. Power, Control Eng. ICECCPCE 2013, pp. 76–81, 2014.
  6. M. N. A. Al-Hamadani, M. A. Fadhel, L. Alzubaidi, and H. Balazs, “Reinforcement Learning Algorithms and Applications in Healthcare and Robotics: A Comprehensive and Systematic Review,” Sensors, vol. 24, no. 8, 2024.
  7. M. I. Alsaydia, et al., “Analysis and Performance Evaluation of OSPF and RIP Routing Protocols Using QualNet,” Int. J. Comput. Netw. Technol., vol. 4, no. 3, pp. 125–132, 2016.
  8. M. A. Al-Jawaherry, A. A. Abdulmajeed, and T. M. Tawfeeq, “Developing a Heuristic Algorithm to Solve Uncertainty Problem of Resource Allocation in a Software Project Scheduling,” Iraqi J. Sci., vol. 63, no. 5, pp. 2211–2229, 2022.
  9. R. Desai and B. P. Patil, “Adaptive routing based on predictive reinforcement learning,” Int. J. Comput. Appl., vol. 40, no. 2, pp. 73–81, 2018.
  10. Z. Mammeri, “Reinforcement learning based routing in networks: Review and classification of approaches,” IEEE Access, vol. 7, no. June, pp. 55916–55950, 2019.
  11. M. Guo, P. Wang, C. Y. Chan, and S. Askary, “A Reinforcement Learning Approach for Intelligent Traffic Signal Control at Urban Intersections,” 2019 IEEE Intell. Transp. Syst. Conf. ITSC 2019, no. June, pp. 4242–4247, 2019.
  12. H. Yang, X. Xie, and M. Kadoch, “Machine Learning Techniques and A Case Study for Intelligent Wireless Networks,” IEEE Netw., vol. 34, no. 3, pp. 208–215, 2020.
  13. Z. Zhang, Y. Yuan, and X. Yang, “A Hybrid Machine Learning Approach for Freeway Traffic Speed Estimation,” Transp. Res. Rec., vol. 2674, no. 10, pp. 68–78, 2020.
  14. D. J. Shin and J. J. Kim, “Deep reinforcement learning-based network routing technology for data recovery in exa-scale cloud distributed clustering systems,” Appl. Sci., vol. 11, no. 18, 2021.
  15. G. Kim, Y. Kim, and H. Lim, “Deep Reinforcement Learning-Based Routing on Software-Defined Networks,” IEEE Access, vol. 10, pp. 18121–18133, 2022.
  16. K. F. Chu, A. Y. S. Lam, and V. O. K. Li, “Traffic Signal Control Using End-to-End Off-Policy Deep Reinforcement Learning,” IEEE Trans. Intell. Transp. Syst., vol. 23, no. 7, pp. 7184–7195, 2022.
  17. H. Cheng, Y. Luo, L. Zhang, and Z. Liao, “A Reinforcement Learning-Based Traffic Engineering Algorithm for Enterprise Network Backbone Links,” Electron., vol. 13, no. 8, 2024.
  18. A.yaseen Hamoo and S. A. Muhamed, “Designing a Monitoring Tool for Mosul University Network to Detect Worm Infected Computers,” Alrafidian J., vol. 2, pp. 43–60, 2013.
  19. J. Ferdaus and R. Salihi, “Routing: internet routing protocols and algorithms,” no. Sept., no. September, pp. 0–19, 2015.
  20. O. A. Hazim and J. M. Abdul-Jabbar, “An Adaptive Triple-Path Mechanism for Congestion Control in Computer Networks,” AL-Rafdain Eng. J., vol. 22, no. 4, pp. 44–56, 2014.
  21. S. Sendra, P. A. Fernández, M. A. Quilez, and J. Lloret, “Study and Performance of Interior Gateway IP routing Protocols,” Netw. Protoc. Algorithms, vol. 2, no. 4, 2011.
  22. D. Mitra, S. Sarkar, and D. Hati, “A Comparative Study of Routing Protocols,” Int. Res. J. Adv. Eng. Sci., no. January 2021, 2016.
  23. Y. Jiang and J. Zhu, “Environment-Aware Adaptive Reinforcement Learning-Based,” pp. 1–31, 2024.
  24. V. S. R. Kosuru and A. K. Venkitaraman, “Developing a Deep Q-Learning and Neural Network Framework for Trajectory Planning,” Eur. J. Eng. Technol. Res., vol. 7, no. 6, pp. 148–157, 2022.
  25. J. Yang, K. Zhu, Y. Ran, W. Cai, and E. Yang, “Joint Admission Control and Routing Via Approximate Dynamic Programming for Streaming Video Over Software-Defined Networking,” IEEE Trans. Multimed., vol. 19, no. 3, pp. 619–631, 2017.
  26. C. L. Duenas Santos, A. M. Mezher, J. P. Astudillo León, J. Cardenas Barrera, E. Castillo Guerra, and J. Meng, “Q-RPL: Q-Learning-Based Routing Protocol for Advanced Metering Infrastructure in Smart Grids,” Sensors, vol. 24, no. 15, pp. 1–29, 2024.