Solar energy is an unlimited and sustainable energy source that holds great importance during the global shift towards environmentally friendly energy production. However, integrating solar power into electrical grids is challenging due to significant fluctuations in its generation. This research aims to develop a model for predicting solar radiation levels using a hybrid power system in the Gorno-Badakhshan Autonomous Oblast of Tajikistan. This study determined the optimal hyperparameters of a multilayer perceptron neural network to enhance the accuracy of solar radiation forecasting. These hyperparameters included the number of neurons, learning algorithm, learning rate, and activation functions. Since there are numerous combinations of hyperparameters, the neural network training process needed to be repeated multiple times. Therefore, a control algorithm of the learning process was proposed to identify stagnation or the emergence of erroneous correlations during model training. The results reveal that different seasons require different hyperparameter values, emphasizing the need for the meticulous tuning of machine learning models and the creation of multiple models for varying conditions. The absolute percentage error of the achieved mean for one-hour-ahead forecasting ranges from 0.6% to 1.7%, indicating a high accuracy compared to the current state-of-the-art practices in this field. The error for one-day-ahead forecasting is between 2.6% and 7.2%.