airflow.providers.amazon.aws.triggers.dms¶

Classes¶

`DmsReplicationTerminalStatusTrigger`	Trigger when an AWS DMS Serverless replication is in a terminal state.
`DmsReplicationConfigDeletedTrigger`	Trigger when an AWS DMS Serverless replication config is deleted.
`DmsReplicationCompleteTrigger`	Trigger when an AWS DMS Serverless replication completes.
`DmsReplicationStoppedTrigger`	Trigger when an AWS DMS Serverless replication is stopped.
`DmsReplicationDeprovisionedTrigger`	Trigger when an AWS DMS Serverless replication is de-provisioned.
`DmsTaskModifyCompleteTrigger`	Trigger when a DMS classic replication task modification completes.
`DmsTableReloadCompleteTrigger`	Trigger when AWS DMS finishes reloading or validating a set of tables.

Module Contents¶

class airflow.providers.amazon.aws.triggers.dms.DmsReplicationTerminalStatusTrigger(replication_config_arn, waiter_delay=30, waiter_max_attempts=60, aws_conn_id='aws_default')[source]¶

Bases: airflow.providers.amazon.aws.triggers.base.AwsBaseWaiterTrigger

Trigger when an AWS DMS Serverless replication is in a terminal state.

Parameters:

replication_config_arn (str) – The ARN of the replication config.
waiter_delay (int) – The amount of time in seconds to wait between attempts.
waiter_max_attempts (int) – The maximum number of attempts to be made.
aws_conn_id (str | None) – The Airflow connection used for AWS credentials.

hook()[source]¶

Override in subclasses to return the right hook.

class airflow.providers.amazon.aws.triggers.dms.DmsReplicationConfigDeletedTrigger(replication_config_arn, waiter_delay=30, waiter_max_attempts=60, aws_conn_id='aws_default')[source]¶

Bases: airflow.providers.amazon.aws.triggers.base.AwsBaseWaiterTrigger

Trigger when an AWS DMS Serverless replication config is deleted.

Parameters:

replication_config_arn (str) – The ARN of the replication config.
waiter_delay (int) – The amount of time in seconds to wait between attempts.
waiter_max_attempts (int) – The maximum number of attempts to be made.
aws_conn_id (str | None) – The Airflow connection used for AWS credentials.

hook()[source]¶

Override in subclasses to return the right hook.

class airflow.providers.amazon.aws.triggers.dms.DmsReplicationCompleteTrigger(replication_config_arn, waiter_delay=30, waiter_max_attempts=60, aws_conn_id='aws_default')[source]¶

Bases: airflow.providers.amazon.aws.triggers.base.AwsBaseWaiterTrigger

Trigger when an AWS DMS Serverless replication completes.

Parameters:

replication_config_arn (str) – The ARN of the replication config.
waiter_delay (int) – The amount of time in seconds to wait between attempts.
waiter_max_attempts (int) – The maximum number of attempts to be made.
aws_conn_id (str | None) – The Airflow connection used for AWS credentials.

hook()[source]¶

Override in subclasses to return the right hook.

class airflow.providers.amazon.aws.triggers.dms.DmsReplicationStoppedTrigger(replication_config_arn, waiter_delay=30, waiter_max_attempts=60, aws_conn_id='aws_default')[source]¶

Bases: airflow.providers.amazon.aws.triggers.base.AwsBaseWaiterTrigger

Trigger when an AWS DMS Serverless replication is stopped.

Parameters:

replication_config_arn (str) – The ARN of the replication config.
waiter_delay (int) – The amount of time in seconds to wait between attempts.
waiter_max_attempts (int) – The maximum number of attempts to be made.
aws_conn_id (str | None) – The Airflow connection used for AWS credentials.

hook()[source]¶

Override in subclasses to return the right hook.

class airflow.providers.amazon.aws.triggers.dms.DmsReplicationDeprovisionedTrigger(replication_config_arn, waiter_delay=30, waiter_max_attempts=60, aws_conn_id='aws_default')[source]¶

Bases: airflow.providers.amazon.aws.triggers.base.AwsBaseWaiterTrigger

Trigger when an AWS DMS Serverless replication is de-provisioned.

Parameters:

replication_config_arn (str) – The ARN of the replication config.
waiter_delay (int) – The amount of time in seconds to wait between attempts.
waiter_max_attempts (int) – The maximum number of attempts to be made.
aws_conn_id (str | None) – The Airflow connection used for AWS credentials.

hook()[source]¶

Override in subclasses to return the right hook.

class airflow.providers.amazon.aws.triggers.dms.DmsTaskModifyCompleteTrigger(replication_task_arn, waiter_delay=30, waiter_max_attempts=60, aws_conn_id='aws_default', verify=None, botocore_config=None)[source]¶

Bases: airflow.providers.amazon.aws.triggers.base.AwsBaseWaiterTrigger

Trigger when a DMS classic replication task modification completes.

Parameters:

replication_task_arn (str) – The ARN of the replication task.
waiter_delay (int) – The amount of time in seconds to wait between attempts.
waiter_max_attempts (int) – The maximum number of attempts to be made.
aws_conn_id (str | None) – The Airflow connection used for AWS credentials.
verify (bool | str | None) – Whether or not to verify SSL certificates.
botocore_config (dict | None) – Configuration dictionary (key-values) for botocore client.

hook()[source]¶

Override in subclasses to return the right hook.

class airflow.providers.amazon.aws.triggers.dms.DmsTableReloadCompleteTrigger(*, replication_task_arn, tables_to_reload, reload_option='data-reload', waiter_delay=30, waiter_max_attempts=60, aws_conn_id='aws_default', region_name=None, verify=None, botocore_config=None)[source]¶

Bases: airflow.triggers.base.BaseTrigger

Trigger when AWS DMS finishes reloading or validating a set of tables.

Parameters:

replication_task_arn (str) – The ARN of the replication task.
tables_to_reload (list[dict[str, str]]) – Tables being reloaded, including schema and table names.
reload_option (str) – The reload operation whose completion state should be monitored.
waiter_delay (int) – The amount of time in seconds to wait between attempts.
waiter_max_attempts (int) – The maximum number of attempts to be made.
aws_conn_id (str | None) – The Airflow connection used for AWS credentials.
region_name (str | None) – AWS region name.
verify (bool | str | None) – Whether or not to verify SSL certificates.
botocore_config (dict | None) – Configuration dictionary (key-values) for botocore client.

replication_task_arn[source]¶

tables_to_reload[source]¶

reload_option = 'data-reload'[source]¶

waiter_delay = 30[source]¶

waiter_max_attempts = 60[source]¶

aws_conn_id = 'aws_default'[source]¶

region_name = None[source]¶

verify = None[source]¶

botocore_config = None[source]¶

serialize()[source]¶

Serialize trigger arguments and classpath.

async run()[source]¶

Poll table statistics until all requested operations finish.