Add Rounding Effect Analysis Feature

[even-wei]

Overview:
This PR introduces a new Rounding Effect Analysis feature, aimed at analyzing and reporting the impacts of rounding in our data processing.

Changes:

• Implemented a new analysis module for rounding effects.
• Integrated this module with existing data processing pipelines.
• Added relevant documentation and examples for usage.

Rationale:
To better understand and mitigate any potential distortions caused by data rounding.

[github-actions]

Recce Summary

Lineage Graph

graph LR
model.jaffle_shop.stg_payments["stg_payments [MODIFIED]"]
style model.jaffle_shop.stg_payments stroke:#ffa502
model.jaffle_shop.stg_payments---->model.jaffle_shop.customers
model.jaffle_shop.stg_payments---->model.jaffle_shop.orders
model.jaffle_shop.stg_payments-...->model.jaffle_shop.rounding_effect
model.jaffle_shop.customers["customers"]
model.jaffle_shop.customers---->model.jaffle_shop.customer_segments
model.jaffle_shop.customers---->model.jaffle_shop.customer_order_pattern
model.jaffle_shop.orders["orders"]
model.jaffle_shop.rounding_effect["rounding_effect [ADDED]"]
style model.jaffle_shop.rounding_effect stroke:#1dce00
model.jaffle_shop.customer_segments["customer_segments"]
model.jaffle_shop.customer_order_pattern["customer_order_pattern"]

Loading

Next Steps

If you want to check more detail inforamtion about the recce result,
please download the artifact file and open it by Recce CLI.

  # Unzip the downloaded artifact file
  tar -xf recce-state-file.zip

  # Launch the recce server based on the state file
  recce server --review recce_state.json

[github-actions]

Recce Summary

Lineage Graph

graph LR
model.jaffle_shop.stg_payments["stg_payments

[What's Changed]
Code, Schema"]
style model.jaffle_shop.stg_payments stroke:#ffa502
model.jaffle_shop.stg_payments---->model.jaffle_shop.orders
model.jaffle_shop.stg_payments---->model.jaffle_shop.customers
model.jaffle_shop.stg_payments-...->model.jaffle_shop.rounding_effect
model.jaffle_shop.orders["orders"]
model.jaffle_shop.customers["customers"]
model.jaffle_shop.customers---->model.jaffle_shop.customer_segments
model.jaffle_shop.customers---->model.jaffle_shop.customer_order_pattern
model.jaffle_shop.rounding_effect["rounding_effect

[What's Changed]
Added Node"]
style model.jaffle_shop.rounding_effect stroke:#1dce00
model.jaffle_shop.customer_segments["customer_segments"]
model.jaffle_shop.customer_order_pattern["customer_order_pattern"]

Loading

Checks Summary

Checks Run	Data Mismatch Detected
5	0

Next Steps

If you want to check more detail inforamtion about the recce result, please download the artifact file and open it by Recce CLI.

How to check the recce result

# Unzip the downloaded artifact file
tar -xf recce-state-file.zip

# Launch the recce server based on the state file
recce server --review recce_state.json

# Open the recce server http://localhost:8000 by your browser

[github-actions]

Recce Summary

Lineage Graph

graph LR
model.jaffle_shop.stg_payments["stg_payments

[What's Changed]
Code, Schema"]
style model.jaffle_shop.stg_payments stroke:#ffa502
model.jaffle_shop.stg_payments---->model.jaffle_shop.orders
model.jaffle_shop.stg_payments---->model.jaffle_shop.customers
model.jaffle_shop.stg_payments-...->model.jaffle_shop.rounding_effect
model.jaffle_shop.orders["orders"]
model.jaffle_shop.customers["customers"]
model.jaffle_shop.customers---->model.jaffle_shop.customer_segments
model.jaffle_shop.customers---->model.jaffle_shop.customer_order_pattern
model.jaffle_shop.rounding_effect["rounding_effect

[What's Changed]
Added Node"]
style model.jaffle_shop.rounding_effect stroke:#1dce00
model.jaffle_shop.customer_segments["customer_segments"]
model.jaffle_shop.customer_order_pattern["customer_order_pattern"]

Loading

Checks Summary

Checks Run	Data Mismatch Detected
5	0

Next Steps

If you want to check more detail inforamtion about the recce result, please download the artifact file and open it by Recce CLI.

How to check the recce result

# Unzip the downloaded artifact file
tar -xf recce-state-file.zip

# Launch the recce server based on the state file
recce server --review recce_state.json

# Open the recce server http://localhost:8000 by your browser

[github-actions]

Recce Summary

Manifest Information

	Manifest	Catalog
Base	2024-11-05 07:49:11	2024-11-05 07:49:12
Current	2024-11-07 05:29:46	2024-11-07 05:29:46

Lineage Graph

graph LR
model.jaffle_shop.stg_payments["stg_payments

[What's Changed]
Code, Schema"]
style model.jaffle_shop.stg_payments stroke:#ffa502
model.jaffle_shop.stg_payments---->model.jaffle_shop.orders
model.jaffle_shop.stg_payments---->model.jaffle_shop.customers
model.jaffle_shop.stg_payments-...->model.jaffle_shop.rounding_effect
model.jaffle_shop.orders["orders

[What's Changed]
"]
model.jaffle_shop.customers["customers

[What's Changed]
"]
model.jaffle_shop.customers---->model.jaffle_shop.customer_segments
model.jaffle_shop.customers---->model.jaffle_shop.customer_order_pattern
model.jaffle_shop.rounding_effect["rounding_effect

[What's Changed]
Added Node"]
style model.jaffle_shop.rounding_effect stroke:#1dce00
model.jaffle_shop.customer_segments["customer_segments"]
model.jaffle_shop.customer_order_pattern["customer_order_pattern"]

Loading

Checks Summary

Checks Run	Data Mismatch Detected
4	2

Checks of Data Mismatch Detected

Name	Type	Mismatched Nodes
Model schema of customers, orders and modified nodes	Schema Diff	rounding_effect, stg_payments
Row count of customers, orders and modified table model	Row Count Diff	rounding_effect

See PR page: https://cloud.datarecce.io/DataRecce/jaffle_shop_duckdb/pulls/3

How to check the recce result

# Launch the recce server based on the state file
recce server --review --cloud --password yummy_jaffle

# Open the recce server http://localhost:8000 by your browser