Tags ( List ) – List of tags to help filtering DAGS in the UI. User_defined_macros ( dict) – a dictionary of macros that will be exposed Template_undefined ( jinja2.Undefined) – Template undefined type. Note that jinja/airflow includes the path of your DAG file by Template_searchpath ( str or list ) – This list of folders (non relative)ĭefines where jinja will look for your templates. Start_date ( datetime.datetime) – The timestamp from which the scheduler willĮnd_date ( datetime.datetime) – A date beyond which your DAG won’t run, leave to None Timedelta object gets added to your latest task instance’sĮxecution_date to figure out the next schedule Schedule_interval ( datetime.timedelta orĭ or str that acts as a cronĮxpression) – Defines how often that DAG runs, this A task_id can only beĭescription ( str) – The description for the DAG to e.g. Until their previous schedule (and upstream tasks) are completed.ĭAGs essentially act as namespaces for tasks. The property of depending on their own past, meaning that they can’t run For each schedule, (say daily or hourly), the DAG needs to runĮach individual tasks as their dependencies are met. A dag also has a schedule, a start date and an end date DAG ( dag_id, description = None, schedule_interval = timedelta(days=1), start_date = None, end_date = None, full_filepath = None, template_searchpath = None, template_undefined = jinja2.Undefined, user_defined_macros = None, user_defined_filters = None, default_args = None, concurrency = conf.getint('core', 'dag_concurrency'), max_active_runs = conf.getint('core', 'max_active_runs_per_dag'), dagrun_timeout = None, sla_miss_callback = None, default_view = None, orientation = conf.get('webserver', 'dag_orientation'), catchup = conf.getboolean('scheduler', 'catchup_by_default'), on_success_callback = None, on_failure_callback = None, doc_md = None, params = None, access_control = None, is_paused_upon_creation = None, jinja_environment_kwargs = None, tags = None ) ¶īases: _dag.BaseDag, _mixin.LoggingMixinĪ dag (directed acyclic graph) is a collection of tasks with directionalĭependencies. get_last_dagrun ( dag_id, session, include_externally_triggered = False ) ¶ Returns the last dag run for a dag, None if there was none.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |