For the alignment problem of strapdown inertial navigation system (SINS) under the complex environment of unknown latitude, angular oscillation interference, and line interference, the ant colony simulated annealing algorithm of gravity vector optimization is proposed to obtain the gravity apparent motion vector optimization equation, and the polynomial fitting method is proposed to simultaneously perform latitude estimation and self-alignment in combination with the alignment principle of SINS. Simulations and experiments show that the proposed method has more robust anti-interference capability than the traditional interference-based alignment method, the latitude estimation accuracy is improved by six times, the self-alignment yaw angle error RMSE value after obtaining the latitude is within 0.7°, and the roll angle and pitch angle error values are within 0.1°.