Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extend Quinn's Data Validation functionality #182

Open
souvik-databricks opened this issue Feb 2, 2024 · 2 comments
Open

Extend Quinn's Data Validation functionality #182

souvik-databricks opened this issue Feb 2, 2024 · 2 comments
Assignees

Comments

@souvik-databricks
Copy link

Add to Quinn a tool to profile incoming data, check if it adheres to registered schema and do custom data quality checks.
At the end of it, a human readable report is autogenerated that can be saved separately.

  • Config driven data profiling and schema validation
  • Autogeneration of report after every run
  • Integration with datadog monitoring system
  • Extensible and highly customizable.
  • Very little boiler plate code.
  • Support for versioned schema validation.
@souvik-databricks
Copy link
Author

@MrPowers I will be working on this. Can we get this assigned to me please. Thanks.

@MrPowers
Copy link
Collaborator

MrPowers commented Feb 2, 2024

Have at it @souvik-databricks !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants