Abstract: The ray space based free viewpoint television （FTV） system is reviewed.Various techniques in FTV realization are compared,and three ray space based schemes for FTV are presented. The characteristics and key techniques of the ray space method are discussed,including the ray space interpolation and compression.In addition,the current trends,future perspectives and challenges of the research on the ray space based FTV system are analysed.