Abstract: In view of the current load balancing algorithm shortcomings, an improved Linux cluster system load balancing algorithm is proposed based on load balancing mechanism.Firstly, the load weight indexes are modified, and the real time server load is collected by the dynamic feedback mechanism, the weights are dynamically adjusted according to the load information of servers collected by the load balancer, finally the optimal server is selected according to the weights to handle the task.The simulation test results show that the improved load balancing algorithm has improved the overall system response capacity and throughput, if greatly improves the comprehensive performance of the system.