What are the optimization algorithms?

Hello, there are many optimization algorithms. The key is to apply different algorithms to different optimization problems, such as the value of feasible solution variables (continuous or discrete), the complexity of objective function and constraints (linear or nonlinear).

For simple problems such as continuity and linearity, we can choose some classical algorithms, such as gradient, Heisenberg matrix, Lagrange multiplier, simplex method and gradient descent method. For more complex problems, we can consider using some intelligent optimization algorithms, such as genetic algorithm and ant colony algorithm, as well as simulated annealing, tabu search, particle swarm optimization and so on.

This is my preliminary understanding of the optimization algorithm for your reference. You can go to Wikipedia if you are interested.