Reducing feature dimensionality in spectroscopic data is crucial for efficient analysis and classification. Using all available features for classification typically results in an unacceptably high runtime and poor accuracy. Popular feature extraction methods, such as principal component analysis (PCA), linear discriminant analysis (LDA), and autoencoders, reduce feature dimensionality by extracting latent features that can be challenging to interpret. To enable better human interpretation of the classification model, we avoid extraction methods and instead propose applying feature selection methods. In this work, we develop an innovative PCA-based feature selection method for spectroscopic data, providing an essential subset of the original features. As an important advantage, no prior knowledge about the characteristic signals of the respective target substance is required. In this proof-of-concept study, the proposed method is initially characterized using simulated Raman and infrared absorption datasets. From the top five PCA eigenvectors of spectroscopic data, we identify a set of three top peaks each at specific wavenumbers (features). The compact set of selected features is then used for classification tasks applying a decision tree. Based on two well-defined spectroscopic datasets, our study demonstrates that our new method of PCA-based peak finding outperforms selected other approaches with regard to interpretability and accuracy. For both investigated datasets, accuracies greater than 97% are achieved. Our approach shows large potential for accurate classification combined with interpretability in further scenarios involving spectroscopic datasets.