{"title":"Solving Hard Mizar Problems with Instantiation and Strategy Invention","authors":"Jan Jakubův, Mikoláš Janota, Josef Urban","doi":"arxiv-2406.17762","DOIUrl":null,"url":null,"abstract":"In this work, we prove over 3000 previously ATP-unproved Mizar/MPTP problems\nby using several ATP and AI methods, raising the number of ATP-solved Mizar\nproblems from 75\\% to above 80\\%. First, we start to experiment with the cvc5\nSMT solver which uses several instantiation-based heuristics that differ from\nthe superposition-based systems, that were previously applied to Mizar,and add\nmany new solutions. Then we use automated strategy invention to develop cvc5\nstrategies that largely improve cvc5's performance on the hard problems. In\nparticular, the best invented strategy solves over 14\\% more problems than the\nbest previously available cvc5 strategy. We also show that different\nclausification methods have a high impact on such instantiation-based methods,\nagain producing many new solutions. In total, the methods solve 3021 (21.3\\%)\nof the 14163 previously unsolved hard Mizar problems. This is a new milestone\nover the Mizar large-theory benchmark and a large strengthening of the hammer\nmethods for Mizar.","PeriodicalId":501033,"journal":{"name":"arXiv - CS - Symbolic Computation","volume":"22 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Symbolic Computation","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2406.17762","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
In this work, we prove over 3000 previously ATP-unproved Mizar/MPTP problems
by using several ATP and AI methods, raising the number of ATP-solved Mizar
problems from 75\% to above 80\%. First, we start to experiment with the cvc5
SMT solver which uses several instantiation-based heuristics that differ from
the superposition-based systems, that were previously applied to Mizar,and add
many new solutions. Then we use automated strategy invention to develop cvc5
strategies that largely improve cvc5's performance on the hard problems. In
particular, the best invented strategy solves over 14\% more problems than the
best previously available cvc5 strategy. We also show that different
clausification methods have a high impact on such instantiation-based methods,
again producing many new solutions. In total, the methods solve 3021 (21.3\%)
of the 14163 previously unsolved hard Mizar problems. This is a new milestone
over the Mizar large-theory benchmark and a large strengthening of the hammer
methods for Mizar.