Tags

Release 2.0.0b3

Major features since beta2:

New features:

* Add description field to connection (#10873)
* Use different deserialization method in XCom init_on_load (#12327)
* Make nav fully accessible y keyboard, fix mobile nav menus (#12351)
* Add metric for scheduling delay between first run task & expected start time (#9544)
* Create DAG-level cluster policy (#12184)

Improvements:

* UI: Improve the layout of TI modal when browser at narrower widths (#12456)
* PR to add 'files' to template-fields in EmailOperator class (#12428)
* JSON Response is returned for invalid API requests (#12305)
* Make K8sPodOperator backwards compatible (#12384)
* Don't display DAG docs when None (#12415)
* Simplify using XComArg in jinja template string (#12405)
* Remove inapplicable configuration section [ldap] (since 2.0.0) (#12386)
* Add info log message about duration taken to load plugins (#12308)
* Manage Flask AppBuilder Tables using Alembic Migrations (#12352)
* UI: Improve presentation of DAG Docs (#12330)
* Wait option for dagrun operator (#12126)
* Use default view in TriggerDagRunLink (#11778)
* Handle naive datetimes in REST APIi (#12248)
* Unify user session lifetime configuration for webserver (#11970)

Bug fixes:

* Fix typo in migrations: RESOURCE_DAGS to RESOURCE_DAG. (#12460)
* UI: Fix bug in server timezone indicator (#12447)
* Fix issues with Gantt View (#12419)
* Proper exit status for failed CLI requests (#12375)
* Check for TaskGroup in _PythonDecoratedOperator (#12312)
* Reject 'connections add' CLI request if URI provided is invalid (#12370)
* Reorder Database Migrations (#12362)
* Refactor root logger handling in task run (#12342)
* Bugfix: REST API Variables update endpoint returns 204 No Content (#12321)
* UI: Fix/Enhancement: Disable forms and communicate to user when no DAG Runs (#12320)
* UI: Get all "tags" parameters not just one (#12324)
* Make dag_id, task_id, and execution_date nullable in event log schema (#12287)
* Don't wrap warrning messages when stderr is not a TTY (#12285)
* Don't treat warning message as rich formatting codes. (#12283)
* UI: Fix pause/unpause toggle to display failed state when unsuccessful (#12267)
* UI: Conditionally update button URL only when it is present (#12268)

Docs:

* Cleanup requirements in README a bit (#12446)
* Synchronization of supported K8S version (#12443)
* Show all Providers in Docs (#12363)
* Restructure documentation for releasing Airflow/Providers (#12350)
* Fix Sample CLI commands for upgrading to 2.0 (#12349)
* Docs installation improvements (#12304)
* Remove providers imports from core examples (#12252)

Misc/Internal:

* Move setup properties out of setup.py in to setup.cfg (#12417)
* Change log level for User's session to DEBUG (#12414)
* Adds mechanism for provider package discovery. (#12383)
* Add success/failed sets to State class (#12359)
* Enable protection for v1-10-stable branch (#12343)
* Fix prod image build (#12314)
* Remove deprecated Elasticsearch Configs (#12296)
* Remove deprecated BashTaskRunner (#12295)
* Added k9s as integrated tool to help with kubernetes testing (#12163)
* Providers in extras are properly configured and verified (#12265)

Batch release providers v1.0.0b2

Batch release providers v1.0.0b2

Release 2.0.0b2

* Update versions in UPDATING.md for 2.0.0b1 release (#12244)
* Remove Unnecessary comprehension (#12221)
* Sign release files with an apache.org key by default (#12241)
* Add back missing api_connextion/__init__.py file (#12240)
* Fixes automated provider installation with extras (#12233)
* Enable markdownlint rule - MD031/blanks-around-fences (#12238)
* Fix spelling in Python files (#12230)
* Add docs about security on GCP (#12187)
* Enable Markdownlint rule - MD022/blanks-around-headings (#12225)
* CSS Changes to adjust content width as per screen size and responsive table with multiline td. (#12227)

Release 2.0.0b1

**Changelog**

New Features

* Adds automated installation of dependent packages
* Render k8s yaml for tasks via the Airflow UI (#11815)
* Remove the ability to add hooks to airflow.hooks namespace (#12108)
* Add ability to specify pod_template_file in executor_config (#11784)
* Add SIGUSR2 handler to Scheduler to dump executor state (#12107)
* Remove the ability to import operators and sensors from plugins (#12072)
* Change Decorated Flow to TaskFlow API (#11895)
* Add Kubernetes cleanup-pods CLI command for Helm Chart (#11802)
* Perform "mini scheduling run" after task has finished (#11589)
* Allow airflow.providers to be installed in multiple python folders (#10806)
* Add Flower Authentication to Helm Chart (#11836)
* Disable XCom pickling by default (#11991)
* Fix: Responsive layout of DAGs (Home) view (#11958)
* Speed up task execution in Celery by pre-loading "expensive" modules (#11956)
* Fix oversized width of DAGs table with hide/reveal of "links" (#11866)
* Use resource permissions for Airflow view access (#11362)
* Make Dag Serialization a hard requirement (#11335)

Improvments

* Extend the same keyword args callable support in PythonOperator to some other sensors/operators (#11922)
* Filter dags by owner (#11121)
* Remove BaseDag and BaseDagBag classes (#12195)
* Don't include provider datafiles in the apache-airflow sdist (#12196)
* Call scheduler "book-keeping" operations less frequently. (#12139)
* Fix broken 'Blocked Highlight' feature in UI (#12183)
* Add authentication to AWS with Google credentials (#12079)
* Proper title for XCom List View page (#12169)
* Make doc_md field nullable and raise json for non-existing dag in dag detail endpoint (#12142)
* Retry Publishing Task to Celery Broker (#12140)
* Update to new helm stable repo (#12137)
* Override FAB table views where table width extends beyond parent containers (#12048)
* Update doc images to reflect latest UI (#11984)
* Allow fractional seconds for timeout values (#11966)
* Log instead of raise an Error for unregistered OperatorLinks (#11959)
* Upgrade FAB to 3.1.1 (#11884)

Bug Fixes

* Include data files in (backport) provider packages (#12200)
* Sync FAB Permissions for all base views (#12162)
* fix spacing between table and pagination (#12160)
* Fix default values for Helm Chart (#12153)
* airflow info fixed for python 3.8+ (#12132)
* Correct failure message in sql_sensor.py. (#12057)
* Avoid unnecessary IF checks when generate Duration & Landing Time views (#12075)
* Retry Dagbag.sync_to_db to avoid Deadlocks (#12046)
* Refine request check in api_connextion Pool endpoints (#12019)
* fix helm scheduler deployment / scheduler logs (#11685)
* fix helm chart worker deployment without kerberos (#11681)
* Unpin werkzeug & set default cookie_samesite to Lax (#11873)

Docs

* Fixed path of the test_core.py file in docs (#12191)
* Move metrics configuration to new section - metrics (#12165)
* Added 1.10.x section to Upgrading to 2.0 doc (#12173)
* Allow Connection Edit View to handle entries with NULL 'extra' (#12149)
* Move docs for max_db_retries option to core (#12167)
* Changed tutorial file to reflect name change to TaskFlow API (#12099)
* Fix typo in docker-context-files/README.md (#12078)
* Delete an environment-dependent value from CLI documentation (#12055)
* Adds updating note to ariflowignore fix (#12043)
* Fix incorrect .airflowignore behavior with multiple nested directories (#11994)
* Replace Docs GIF with updated UI screenshots (#12044)
* Ignore the basepath when ignoring files via .airflowignore (#11993)
* Adds documentation about the optimized PR workflow (#12006)
* Improve formatting in configurations docs (#11987)
* Add docs about Scheduler HA, how to use it and DB requirements (#11467)
* Add readme for core sensors, standardize capitalization schema (#11898)
* Updating 2.0 docs (#11842)
* Add providers, operators, and hooks readmes (#11829)

Misc/Internal

* Format all files (without excepions) by black (#12091)
* Enable Black - Python Auto Formmatter (#9550)
* Use PyUpgrade to use Python 3.6 features (#11447)
* Replace deprecated PythonOperator module with the new one (#12064)
* Remove unused JavaScript function (#12052)
* Code smell fixes for BackfillJob (#12005)
* All k8s object must comply with JSON Schema (#12003)
* Validate airflow chart values.yaml & values.schema.json (#11990)
* Remove unused "poke_exception_cache_ttl" param from SmartSensorOperator (#11972)
* Migrate from helm-unittest to python unittest (#11827)
* Migration commands shouldn't print a bunch of data. (#11961)
* Cache CLI parser objects (#11957)
* Add missing space to log message in task completion logs (#11934)
* Fix issue rendering k8s V1Pod (#11952)
* Make taskinstances pid and duration nullable (#11906)

Airflow 2.0.0-alpha1

Airflow 1.10.12

Airflow 1.10.12rc4

Airflow Version 1.10.12rc3