Airflow Xcom Exclusive -
: A built-in mechanism for tasks to "push" (store) and "pull" (retrieve) small pieces of data.
def transform_data(table_name, **context): # table_name pulled via task_id='extract_api_data' result_table = aggregate_in_bigquery(table_name) return result_table airflow xcom exclusive
XCom does not natively support "pop" or "consume once". You must implement it manually: : A built-in mechanism for tasks to "push"
If a task returns a value, Airflow automatically pushes it to XCom with the key return_value . This is the cleanest method. airflow xcom exclusive