Data Validation using Sentence Transformers

Abstract

Focusing on the various data quality factors and fulfilling the accuracy requirements is an important step in the implementation of businesses that use data in their decision-making process. The use of inaccurate data by companies can lead to insignificant decisions and judgments that result in higher costs and time consumption. This study talks about how to validate the migrated data by comparing the source and target data in an automated way. The proposed research describes the solution and explain how Artificial Intelligence/ Machine Learning (AI/ML) techniques are implemented using the Sentence Transformer approach to accelerate the data validation process.