The main work of the paper can be summarized as follows : 1 . a mixed hs-fr conjugate gradient algorithm is proposed . two convergence theorems without the sufficient descent condition for the mixed hs-fr algorithm are given 给出了一个混合的hs-fr共轭梯度算法,在无充分下降条件下,得到了关于hs-fr算法的两个收敛性定理。
This paper is devoted to some numerical optimization methods and optimization models for solving practical problems in real world . the methods we concern with are the conjugate gradient algorithms, evolutionary algorithms and goal programming 本文对近年来备受关注的几类最优化方法(共轭梯度算法、进化算法和目标规划法)的理论性质及应用进行了研究,主要研究成果如下:1
As for single objective optimization algorithm, a fast iterative algorithm based on conjugate gradient algorithm is presented, which makes use of extent limit of iterative optimization step in conjugate gradient with the idea of least square 在标量优化图像重建法中,作者以最小二乘为目标,利用共轭梯度法中迭代最优步长的区间性,提出了一种基于共轭梯度法的快速迭代算法。
In this thesis, some kinds of learning algorithms of feed-forward neural network have been analyzed; later a scaled conjugate gradient algorithm is presented to train network, furthermore, modified training methods have been provided to improve the neural network performance 在分析比较了几种前馈神经网络的学习算法后,提出尺度共轭梯度算法对网络进行训练,并针对现有网络训练方法提出了改进。
Under the frame of natural gradient algorithm, an ica algorithm based on adaptive kernel estimation is proposed, which can separate arbitrary mixed signals ( such as super-gaussian and sub-gaussian, symmetric and asymmetric signals ) 摘要在自然梯度算法的框架下,本文利用随机变量概率密度函数非参数估计的自适应核函数法,给出了一种能够对任意混合信号(超高斯和亚高斯信号,对称和非对称分布信号)进行盲分离的算法。
An equivalent integral programming model and a new semidefinite programming relaxation for the max-bisection problem are given . then, we solve the relaxation with a projected gradient algorithm . coupled with the randomized method, an approximate solution of the max-bisection problem is obtained 2.给出图的最大二等分问题的整数规划模型的等价模型及其新的半定规划松弛模型,利用投影梯度算法求解该半定规划松弛模型,然后利用随机扰动算法求得原问题的次优解
And with the results of calculation obtained by the first-order gradient algorithms which is initial value of the neighboring extremal algorithms we can transform the problem into a face to point one, then a good result is attained by the neighboring extremal algorithms . in the end, the course of orbit transfers is depicted 利用梯度法对两点边值问题进行计算,将面对面的问题转化为一个点对点问题,将所得结果作为邻近极值法的初始值并进行精确计算。最后,描绘了最优变轨过程。
In the algorithm level, currently various training algorithms of neural networks, including gradient algorithms, intelligent learning algorithms and hybrid algorithms, are comparatively studied; the optimization principle of bp algorithm for neural networks training is analyzed in detail, and the reasons for serious disadvantages of bp algorithms are found out, moreover, the optimization principle of two kinds of improved bp algorithms is described in a uniform theoretic framework; and the global optimization algorithms of neural networks, mainly genetic algorithm are expounded in detail, it follows that a improved genetic algorithm is proposed; finally the training performances of various algorithms are compared based on a simulation experiment on a benchmark problem of neural network learning, furthermore, a viewpoint that genetic algorithm is subject to " curse of dimension " is proposed 在算法层,本文对目前用于神经网络训练的各种算法,包括梯度算法、智能学习算法和混合学习算法进行了比较研究;对用于神经网络训练的bp算法的优化原理进行了详细的理论分析,找到了bp算法存在严重缺陷的原因,并对其两类改进算法-启发式算法和二次梯度算法的优化原理,在统一的框架之下进行了详尽的理论描述;对神经网络全局优化算法主要是遗传算法进行了详细的阐述,并在此基础上,设计了一种性能改进的遗传算法;最后基于神经网络学习的benchmark问题对各种算法在网络训练中的应用性能进行了仿真研究,并提出了遗传算法受困于“维数灾难”的观点。
In each section, we discuss every method's global convergence properties and numerical behaviors etc . in the second chapter, we develop several new conjugate gradient algorithms, explore their convergence properties and analyze the numerical results . by comparing the numerical results, we can find the advantages of these new algorithms 然后对共轭梯度法理论研究的基础上,得到了几种新的共轭梯度法,并对它们的收敛性进行了分析,证明了新算法的全局收敛性。大量数值试验结果也表明了这些算法的有效性。
Based on artificial neural network technique, a regional economic forecasting system, which has been applied to practical regional medium-and long-term economic forecasting in certain city, is designed . a mixed hs-fr conjugate gradient algorithm is applied to the regional economic forecasting system to train the neural networks effectively 将人工神经网络技术应用于地区经济预测领域,设计了一个“基于人工神经网络的地区经济预测系统”,并利用hs-fr共轭梯度算法对网络的学习算法进行了改进。