Abstract: To further improve the robustness of the multi-channel circulant structure tracking, a novel general multi-channel correlation filter（MCF） is proposed, which can be applied in linear and nonlinear situations. First the general MCF is derived from the time domain; Then the mostly used two forms of MCF under linear and nonlinear situations can be got by means of linear and Gaussian kernel functions. Experiment is held on video sequences by HOG feature. Results show that proposed method has substantially the same robustness compared with frequency domain method under linear situation and is more robust than existing method under nonlinear situation.