Outcome
First place among roughly 70 participants.
Case study
The key was not model complexity. It was understanding the scoring rule, reducing variance in the data, and making conservative forecasts with a simple ARIMA-based approach.
Outcome
First place among roughly 70 participants.
Overview
The competition asked participants to forecast 100 days of future sales for 200 small businesses. It was framed as a lending problem, so the score was not based on plain forecast error alone. Over-forecasting was penalized much more heavily than under-forecasting.
Many participants used more complex modeling approaches, but the scoring setup made problem framing and risk-aware forecasting more important than adding complexity for its own sake.
I used ARIMA, but the real work happened before and after the model step. I cleaned cancellation noise, aggregated transactions to reduce day-level variance, applied log transformation, and then adjusted the forecast direction to fit the competition’s asymmetric objective.
The result was a conservative, interpretable workflow that fit the evaluation rule instead of optimizing a generic notion of accuracy.
Method
The raw data included negative transactions that represented cancellations. I removed those together with their corresponding positive transactions so the series would reflect actual realized sales rather than inflated variance.
Each store’s transaction history was aggregated into 28-day, 14-day, or 7-day buckets depending on how much history was available. That reduced day-of-week noise while preserving enough structure to forecast short series.
Forecasting on the log scale made the aggregated series more stable. When a store showed zero-sales periods, I adjusted the final forecast using the observed probability of no sales rather than ignoring that pattern.
Because over-forecasting was much more expensive under the competition rule, I shifted forecasts downward using the model’s estimated uncertainty instead of submitting the raw point estimate.
Results
Ranking
1stFinished first in the competition.
Field
~70Approximate number of participants in the event.
Lesson
Objective firstThe scoring rule mattered as much as the model choice.
Takeaways
The important choice was not chasing a more fashionable model. It was recognizing that the competition rewarded cautious forecasts under uncertainty, then shaping the preprocessing and prediction logic around that fact.
A restrained ARIMA workflow performed well because the signal was cleaned, the variance was reduced, and the final forecast was adjusted to fit the real scoring objective instead of a generic benchmark.
Related
Case studies and methods that connect to the same operational questions.
Case study
Built a perishable ordering engine that combined forecast with freshness, timing, and warehouse constraints.
Method
An inventory planning method that estimates SKU-level seasonality, groups products into seasonal buckets, and connects those signals back to category planning.