This dataset contains code and data for our paper "Better by default: Strong pre-tuned MLPs and boosted trees on tabular data", specifically, the NeurIPS version which is also the second version on arXiv. The main code is provided in pytabkit_code.zip and contains further documentation in README.md and the docs folder. The main code is also provided on GitHub. Here, we additionally provide the data that is generated by the code as well as the plots. See the documentation in docs/source/bench/download_results.md in the main code for instructions on how/when to download which data, or the documentation hosted here. The code for the old version of the Grinsztajn et al. (2022) benchmark is provided in grinsztajn_benchmarking_code.zip and on GitHub. The code and data for the first arXiv version of the paper are archived here.