Upstream Monitoring

[esheehan-gsl]

Problem

If something goes wrong with delivery from models we will just silently stop providing those models in the UI. The only way we notice that we’re not processing that data is if someone tries to load it in the application and can’t find it, or if we’re looking at the data in S3 and notice something is missing.

Because our pipeline is event driven, it’s hard to detect when something just isn’t delivered.

Solution

Describe the solution to the problem.

No Gos

Describe any features or behaviors that have been considered and rejected as out of scope for this project.

Rabbit Holes

Describe any solutions to problems that pose a risk to completing this project on time.