TestSize LOpenExample project · Fictional nonprofit
Evaluate against past events
Know what the prototype would have shown in past floods.
What you do
- 01Pick two or three events with enough data.
- 02Replay them without using later information.
- 03Compare with what actually flooded.
What you learn doing this
How to evaluate without cheating with the future, with an agent checking that no later information leaks in.
What credit it gives
Your reviewed contribution record. If it's your first on this project, its badge too.
Technique you show: Leak-free historical evaluation.
Accepted when
- Runs again with a single command.
- It's shown that no future information is used.
- The report includes the errors.
You deliver
A report per event and the code that reproduces it.
Who reviews
Someone on the team reviews the method. The specialist reviews how the results are read.