An Overview of Reinforcement Learning Algorithms for Handover Management in 5G Ultra-Dense Small Cell Networks

Multiagent Q-Learning-Based Mobility Management for Multi-Connectivity in mmWAVE Cellular Systems

Effective mobility management is crucial for efficient operation of next-generation cellular systems in the millimeter wave (mmWave) band. Massive multiple-input-multiple-output (MIMO) systems are seen as necessary to overcome the significant path losses in this band, but the highly directional beam makes the channels more susceptible to radio link failures due to blockages. To meet stringent capacity and reliability requirements, multi-connectivity has attracted significant attention. This paper proposes a multiagent distributed Q learning-based mobility management scheme for multi-connectivity in mmWave cellular systems. A hierarchical structure is adopted to address the model complexity and speed up the learning process. The performance is assessed using a realistic measurement data set collected from Wireless Insite in an urban area and compared with independent Q learning and a heuristic scheme in terms of handover probability and spectral efficiency.

A Survey on Handover and Mobility Management in 5G HetNets: Current State, Challenges, and Future Directions

Fifth-generation (5G) networks offer high-speed data transmission with low latency, increased base station volume, improved quality of service (QoS), and massive multiple-input-multiple-output (M-MIMO) channels compared to 4G long-term evolution (LTE) networks. However, the COVID-19 pandemic has disrupted the achievement of mobility and handover (HO) in 5G networks due to significant changes in intelligent devices and high-definition (HD) multimedia applications. Consequently, the current cellular network faces challenges in propagating high-capacity data with improved speed, QoS, latency, and efficient HO and mobility management. This comprehensive survey paper specifically focuses on HO and mobility management issues within 5G heterogeneous networks (HetNets). The paper thoroughly examines the existing literature and investigates key performance indicators (KPIs) and solutions for HO and mobility-related challenges while considering applied standards. Additionally, it evaluates the performance of current models in addressing HO and mobility management issues, taking into account factors such as energy efficiency, reliability, latency, and scalability. Finally, this paper identifies significant challenges associated with HO and mobility management in existing research models and provides detailed evaluations of their solutions along with recommendations for future research.

An Insight of Deep Learning Based Demand Forecasting in Smart Grids

Smart grids are able to forecast customers' consumption patterns, i.e., their energy demand, and consequently electricity can be transmitted after taking into account the expected demand. To face today's demand forecasting challenges, where the data generated by smart grids is huge, modern data-driven techniques need to be used. In this scenario, Deep Learning models are a good alternative to learn patterns from customer data and then forecast demand for different forecasting horizons. Among the commonly used Artificial Neural Networks, Long Short-Term Memory networks-based on Recurrent Neural Networks-are playing a prominent role. This paper provides an insight into the importance of the demand forecasting issue, and other related factors, in the context of smart grids, and collects some experiences of the use of Deep Learning techniques, for demand forecasting purposes. To have an efficient power system, a balance between supply and demand is necessary. Therefore, industry stakeholders and researchers should make a special effort in load forecasting, especially in the short term, which is critical for demand response.

Binary PSO with Classification Trees Algorithm for Enhancing Power Efficiency in 5G Networks

The dense deployment of small cells (SCs) in the 5G heterogeneous networks (HetNets) fulfills the demand for vast connectivity and larger data rates. Unfortunately, the power efficiency (PE) of the network is reduced because of the elevated power consumption of the densely deployed SCs and the interference that arise between them. An approach to ameliorate the PE is proposed by switching off the redundant SCs using machine learning (ML) techniques while sustaining the quality of service (QoS) for each user. In this paper, a linearly increasing inertia weight-binary particle swarm optimization (IW-BPSO) algorithm for SC on/off switching is proposed to minimize the power consumption of the network. Moreover, a soft frequency reuse (SFR) algorithm is proposed using classification trees (CTs) to alleviate the interference and elevate the system throughput. The results show that the proposed algorithms outperform the other conventional algorithms, as they reduce the power consumption of the network and the interference among the SCs, ameliorating the total throughput and the PE of the system.

Machine Learning-Based Boosted Regression Ensemble Combined with Hyperparameter Tuning for Optimal Adaptive Learning

Over the past couple of decades, many telecommunication industries have passed through the different facets of the digital revolution by integrating artificial intelligence (AI) techniques into the way they run and define their processes. Relevant data acquisition, analysis, harnessing, and mining are now fully considered vital drivers for business growth in these industries. Machine learning, a subset of artificial intelligence (AI), can assist, particularly in learning patterns in big data chunks, intelligent extrapolative extraction of data and automatic decision-making in predictive learning. Firstly, in this paper, a detailed performance benchmarking of adaptive learning capacities of different key machine-learning-based regression models is provided for extrapolative analysis of throughput data acquired at the different user communication distances to the gNodeB transmitter in 5G new radio networks. Secondly, a random forest (RF)-based machine learning model combined with a least-squares boosting algorithm and Bayesian hyperparameter tuning method for further extrapolative analysis of the acquired throughput data is proposed. The proposed model is herein referred to as the RF-LS-BPT method. While the least-squares boosting algorithm is engaged to turn the possible RF weak learners to form stronger ones, resulting in a single strong prediction model, the Bayesian hyperparameter tuning automatically determines the best RF hyperparameter values, thereby enabling the proposed RF-LS-BPT model to obtain desired optimal prediction performance. The application of the proposed RF-LS-BPT method showed superior prediction accuracy over the ordinary random forest model and six other machine-learning-based regression models on the acquired throughput data. The coefficient of determination (Rsq) and mean absolute error (MAE) values obtained for the throughput prediction at different user locations using the proposed RF-LS-BPT method range from 0.9800 to 0.9999 and 0.42 to 4.24, respectively. The standard RF models attained 0.9644 to 0.9944 Rsq and 5.47 to 12.56 MAE values. The improved throughput prediction accuracy of the proposed RF-LS-BPT method demonstrates the significance of hyperparameter tuning/optimization in developing precise and reliable machine-learning-based regression models. The projected model would find valuable applications in throughput estimation and modeling in 5G and beyond 5G wireless communication systems.

Self-Organizing Networks for 5G and Beyond: A View from the Top

We describe self-organizing network (SON) concepts and architectures and their potential to play a central role in 5G deployment and next-generation networks. Our focus is on the basic SON use case applied to radio access networks (RAN), which is self-optimization. We analyze SON applications’ rationale and operation, the design and dimensioning of SON systems, possible deficiencies and conflicts that occur through the parallel operation of functions, and describe the strong reliance on machine learning (ML) and artificial intelligence (AI). Moreover, we present and comment on very recent proposals for SON deployment in 5G networks. Typical examples include the binding of SON systems with techniques such as Network Function Virtualization (NFV), Cloud RAN (C-RAN), Ultra-Reliable Low Latency Communications (URLLC), massive Machine-Type Communication (mMTC) for IoT, and automated backhauling, which lead the way towards the adoption of SON techniques in Beyond 5G (B5G) networks.

Proactive Cross-Layer Framework Based on Classification Techniques for Handover Decision on WLAN Environments

In recent years, modern technology has been increasing, and this has grown a derivate in big challenges related to the network and application infrastructures. New devices have been providing more high functionalities to users than ever before; however, these devices depend on a high functionality of network in order to ensure a correct functioning ability over applications. This is essential for mobile networking systems to evolve in order to meet the future requirements of capacity, coverage, and data rate. In addition, when a network problem happens, it could be converted into somethingmore disastrous and difficult to solve. A crucial point is the network physical change and the difficulties, such as loss continuity of services and the decision to select the future network to be connected. In this article, a new framework is proposed to forecast a future network to be connected through a mobile node in WLAN environments. The proposed framework considers a decision-making process based on five classifiers and the user’s position and acceleration data in order to anticipate the network change, reaching up to 96.75% accuracy in predicting the connection of this future network. In this way, an early change of network is obtained without packet and time loss during the network change.