Databricks Lakeflow Designer 10 月更新:数据质量护栏与无代码清洗算子
Databricks 给 Lakeflow Designer 加了一批数据准备新功能,比如质量检查护栏和无代码去重,做数据管道的可以看看能不能少写点代码。
Databricks 为 Lakeflow Designer 推出 10 月更新,新增数据质量检查的 Guardrails,可自定义检查失败后的处理方式。清洗和去重操作新增无代码算子,单个算子即可完成多表 join。更新还支持参数化的输入输出,并提供可视化版本历史来回顾工作流变更。
More ways to build, validate, and manage data preparation workflows in Lakeflow Designer 🫡
Our October roundup highlights the latest enhancements:
• Guardrails for data quality checks, with control over what happens when checks fail • No-code operators for cleaning and deduplication • Multi-table joins in a single operator • Parameterized inputs and outputs • Visual version history to easily review workflow changes
https://t.co/Js97vHhowi