The design of accurate virtual screening tools is an open challenge in drug discovery. Several structure-based methods have been developed at different levels of approximation. Among them, molecular docking is an established technique with high efficiency, but typically low accuracy. Moreover, docking performances are known to be target-dependent, which makes the choice of the docking program and corresponding scoring function critical when approaching a new protein target. To compare the performances of different docking protocols, we developed ChemFlow_py, an automated tool to perform docking and rescoring. Using four protein systems extracted from DUD-E with 100 known active compounds and 3000 decoys per target, we compared the performances of several rescoring strategies including consensus scoring. We found that the average docking results can be improved by consensus ranking, which emphasizes the relevance of consensus scoring when little or no chemical information is available for a given target. ChemFlow_py is a free toolkit to optimize the performances of virtual high-throughput screening (vHTS). The software is publicly available at https://github.com/IFMlab/ChemFlow_py.