Incremental sheet forming (ISF) is a controlled and die-less forming process that can produce customized products from the sheets layer by layer using the same setup, i.e., forming tools and machine. This novel and emerging forming technique can potentially be useful as a green aspect of manufacturing by reducing the required power and by saving the resources for producing the components of lightweight materials because material is deformed locally during ISF. The surface quality of the formed parts from sheet material affects the aesthetics aspects, stress concentration, fatigue life and their applicability. This review article aims to provide a state-of-the-art review for various aspects and parameters of ISF process that affect the surface roughness significantly by conducting literature survey quantitatively. Furthermore, the techniques of ISF and roles of various parameters responsible for affecting the surface quality of parts have also been explored for providing the critics for existing literature and setting the further guidelines for the researchers. Various instruments used for measuring the surface roughness of parts formed by ISF has also been discussed. Comparative analysis of exiting literature available in the context of various process parameters, ISF hardware, and surface roughness makes this study comprehensive and exhaustive for the researchers to find the gaps and challenges in this field. The relationship of wall angle with other process parameters can be explored in the future to obtain the desired surface quality of a particular material. Significant parameters responsible for the surface quality have also been discussed critically. Further, the new tool paths can be developed for high surface quality and low forming time. A study on the selection of feed rate for various applications and relation with other parameter is also recommended for the future work. The lubricants with additives can further be tested for high surface quality of ISF. Further, significant study on surface roughness is not conducted on hybrid sheet forming and other advanced variants of ISF (like hot forming, friction stir assisted incremental forming, waterjet forming). It is required to develop the comparisons between the different techniques of ISF. Results also showed that majority of researchers used SPIF technique followed by DSIF and hybrid ISF.