Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Port Registering of Asset Changes to Task SDK #45752

Open
kaxil opened this issue Jan 17, 2025 · 0 comments
Open

Port Registering of Asset Changes to Task SDK #45752

kaxil opened this issue Jan 17, 2025 · 0 comments
Assignees
Labels
area:task-execution-interface-aip72 AIP-72: Task Execution Interface (TEI) aka Task SDK
Milestone

Comments

@kaxil
Copy link
Member

kaxil commented Jan 17, 2025

Assets are stored in DB after a Task completes execution with SUCCESS state as shown in the following code.

ti._register_asset_changes(events=context["outlet_events"], session=session)

This includes extracting outlets from the task and storing them in the DB.

We should port this and related changes to the Task SDK's task_runner.py

def finalize(log: Logger): ...

@kaxil kaxil added the area:task-execution-interface-aip72 AIP-72: Task Execution Interface (TEI) aka Task SDK label Jan 17, 2025
@kaxil kaxil added this to the Airflow 3.0.0 milestone Jan 17, 2025
@kaxil kaxil self-assigned this Jan 17, 2025
kaxil added a commit that referenced this issue Jan 17, 2025
part of #45717 and #45752

This PR adds support for `outlet_events` in Context dict within the Task SDK by adding an endpoint on the API Server which is fetched when outlet_events is accessed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:task-execution-interface-aip72 AIP-72: Task Execution Interface (TEI) aka Task SDK
Development

No branches or pull requests

1 participant