Abstract: In order to improve the interaction efficiency of human-computer interface, a set of icon search experiments were conducted to investigate the effects of color, grouping method and panel orientation on visual search efficiency by using the method of within-subject and between-subject mixed design. The experimental results mainly include reaction time and correct rate, and descriptive statistical analysis and variance analysis are for both of them. The results show that the visual search efficiency of color-grouped panels is significantly higher than that of single-color panels. The visual search efficiency of larger grouping methods is not much different, but significantly higher than the visual search efficiency of color-alternating grouping. The visual search efficiency in the horizontal direction is higher than that in the vertical direction. More efficient, compared to the horizontal direction, the visual search efficiency of the grouping method of alternating colors in the vertical direction is lower.