Assembling public and private predictions
You can see an example of how we assembled the predictions for both the public and private leaderboards here:
- Public leaderboard example: https://www.kaggle.com/lucamassaron/m5-predict-public-leaderboard
- Private leaderboard example: https://www.kaggle.com/code/lucamassaron/m5-predict-private-leaderboard
What changes between the public and private submissions is just the different last training day: it determines what days we are going to predict. The public leaderboard notebook has the last training day set to 1,913, and the private one has it set to 1,941. You can actually, just for validation purposes, create other versions of the public version notebook using these dates for creating past holdout validation sets: [1885, 1857, 1829, 1577]. Hence the notebook will produce predictions that you can test locally for confirming the predictive capability of the model.
Exercise 6
Please try different holdout...
