Flexibility control and vision of robots are important acquisition and feedback links in robot control, and the study of multi-sensor data fusion is becoming more and more important as the complexity of robot tasks increases. This paper describes the robot kinematics and inverse kinematics process by studying the knowledge of D-H model theory and parameter definitions in the machine kinematics model, reveals the changing relationship between the robot joint control and end pose, and establishes a kinematics-based vision servo control model. On this basis, the coupling error compensation algorithm is used to combine the visual position control quantity as well as the force sensing position correction quantity to form the final visual and force sensing supple control strategy. Meanwhile, for the lack of adaptability of classical impedance force control on unknown constraint environments, a two-fuzzy adaptive sliding mode controller is designed according to the Lyapunov stability theorem to drive the robot end in order to achieve the actual position tracking expectation. The results of simulation experiments and motion contour tracking experiments show that the control algorithm proposed in this paper has better control accuracy and is more robust to noise and uncertainty, and the controller is also able to reduce the effect of torque saturation on the robot system.