Abstract: We present a video-based 3D body tracking method from multiple cues in multiple cameras environment.By defining the body model,image projection model and similarity measurement model,the tracking object function is proposed,then resolved using the Newton-Gaussian method.The experimental results on simulated data and the real data show the tracking is improved by combining several image cues, and the tracking performance is better than the annealed particle filter algorithm.