EDS M25 Release Notes and Test Summary

EDS M25 Patches Releases

Click link to know the fixes:

EDS M25.1 Patches Releases

Patches: 0.28.6 -> 0.28.7

Environment Variable Changes

Patches Release Environment Variable Required

0.28.0, 0.28.1, 0.28.2

Patches Release	Environment Variable Required
0.28.0, 0.28.1, 0.28.2	`core_service_partition_host: https://{{hostname}}/api/partition`
0.28.3, 0.28.4	`core_service_partition_host: https://{{hostname}}/api/partition/v1`
0.28.5 and onwards	`core_service_partition_host: https://{{hostname}} core_service_partition_url: https://{{hostname}}/api/partition/v1`

  core_service_partition_host: https://{{hostname}}/api/partition

0.28.3, 0.28.4

  core_service_partition_host: https://{{hostname}}/api/partition/v1

0.28.5 and onwards

  core_service_partition_host: https://{{hostname}}
  core_service_partition_url: https://{{hostname}}/api/partition/v1

EDS M25 Known Issues

(EDS) EDS: Add release versions in Airflow Logs, Activity Template (#147) · Issue
(EDS Ingest - Activity template logging) EDS Activity template enhancement for Osdu_ingest_by_reference and validation error (#144) · Issues
(EDS Ingest) Check RefreshToken Authentication - auto-refresh token for refresh token (#145) · Issues
(EDS Ingest) Azure M25: EDS Ingestion Failure: Exception thrown while validating for ExternalReferenceValueMapping (#752)
(EDS Ingest) M25 EDS - Mapped Master data - Complex Mapping (#165) · Issue
(EDS Ingest) M25 EDS - Multiple conditions in ParentMatchingRuleSets for same kind ignored (#166) · Issue
(EDS Email Notification) Scalable Email Notification Authentication (#136) · Issue
(EDS Naturalization) EDS Naturalization: Error message hardening during re-naturalization of same record (#156) · Issue
(EDS Naturalization) Airflow run died unexpectedly before EDS Naturalization (#751) · Issue
(Dataset Service) Dataset Service - Documentation Status Code Update (#125)
(Workflow Service) ADR: Workflow Versioning and Update Workflow API (#136) · Issues
(OS Core Common) Enhance Info Endpoints to Display Feature Flag Status (#86) · Issues
(Airflow) ADR: Airflow dependency isolation and KubernetesPodOperators (#55) · Issue

M25 Release - Functionality/Testing Scope

The table below is the new functionality or bugs for M25 (excluding the basic functionality). The basic functionality can be found in the first discussion excel below.

	Feature/Issue Name	Testing Check List	Overview	To Check	Documentation Link	Recording Link	Action Item
1	Airflow DAG: Unable to trigger with parameters (#114)	Primary Secondary Preship KT	Unable to trigger the EDS ingest from Airflow UI	[Airflow UI] Able to trigger DAGs from Airflow UI	Testing Artifact:https://community.opengroup.org/-/project/407/uploads/b8384598dc92141c9734817e460f4b10/EDS-PreShip-Test-Session1.docx	EDS Community meeting: https://opengroup.webex.com/opengroup/ldr.php?RCID=fd45af9cb9a1e99eeda070def42e5825
2	EDS XCOM summary Improvement (#133)	Primary Secondary Preship KT	User is having hard time to understand the xcom summary	[Airflow UI] From Airflow UI, check the xom summary	Testing Artifact:https://community.opengroup.org/-/project/407/uploads/b8384598dc92141c9734817e460f4b10/EDS-PreShip-Test-Session1.docx	EDS Community meeting: https://opengroup.webex.com/opengroup/ldr.php?RCID=fd45af9cb9a1e99eeda070def42e5825
3	eds_naturalization DAG doesn't use correct schema authority (#141)	Primary Secondary Preship KT	On a multiple schema authority instance, we want to honor the trusted schema authority by using the env variable from Airflow	[Airflow UI] [EDS Ingest] [EDS Naturalization] Airflow variable contains schema authority and able to run EDS Ingest and EDS naturalization
4	ADR: EDS Ingest - Push Functionality using Workflow API (#74) ·	Primary Secondary Preship KT	User can manually Trigger via Workflow API with custom filter	[EDS Ingest] Able to trigger workflow API with custom filter	EDS Configuration Guide - OSDU EDS Documentation Testing Artifact:https://community.opengroup.org/-/project/407/uploads/b8384598dc92141c9734817e460f4b10/EDS-PreShip-Test-Session1.docx	EDS Community meeting: https://opengroup.webex.com/opengroup/ldr.php?RCID=fd45af9cb9a1e99eeda070def42e5825
5	Secret Service V2 adoption - EDS fetch and Ingest (#64) · Issues ·	Primary Secondary Preship KT	User's OSDU instance might be running on Secret Service V1/V2	[EDS Ingest] EDS able to run on Secret Service V1 and V2 instance	Testing Artifact:https://community.opengroup.org/-/project/407/uploads/b8384598dc92141c9734817e460f4b10/EDS-PreShip-Test-Session1.docx	EDS Community meeting: https://opengroup.webex.com/opengroup/ldr.php?RCID=fd45af9cb9a1e99eeda070def42e5825
6	EDS - LastSuccesfullRunDateUTC value to include Milliseconds for new records and accommodate old Pattern for Existing Value (#135) · Issues ·	Primary Secondary Preship KT	In the CSDJ record, the `LastSuccesfullRunDateUTC` is not having miliseconds after ingestion of new record via eds ingest	[EDS Ingest] After EDS ingest process is completed, check on the `LastSuccesfullRunDateUTC`in CSDJ. It should contains miliseconds	Testing Artifact:https://community.opengroup.org/-/project/407/uploads/b8384598dc92141c9734817e460f4b10/EDS-PreShip-Test-Session1.docx	EDS Community meeting: https://opengroup.webex.com/opengroup/ldr.php?RCID=fd45af9cb9a1e99eeda070def42e5825
7	EDS- CreateTimeMax Timestamp to include milliseconds (#127) · Issues · OSDU / OSDU Data Platform / Data Flow / Data Ingestion / External Data Sources / Core External Data Workflow DAGs · GitLab	Primary Secondary Preship KT	During an ingestion, the `CreateTimeMax`doesn't have milliseconds	[EDS Ingest] After EDS ingest process is completed, check on the `CreateTimeMax`in CSDJ. It should contains miliseconds	Testing Artifact:https://community.opengroup.org/-/project/407/uploads/b8384598dc92141c9734817e460f4b10/EDS-PreShip-Test-Session1.docx	EDS Community meeting: https://opengroup.webex.com/opengroup/ldr.php?RCID=fd45af9cb9a1e99eeda070def42e5825
8	Id replacement “osdu:” to “osdu:osdu:”. Needs investigation and fix. (#126) · Issues ·	Primary Secondary Preship KT	Before M24, the query should (kind:id). After M24 onwards, the query will be (partition:kind:id)	[EDS Ingest] In CSDJ, `data.filter` should have id to be in the format (partition:kind:id)	Filter Configuration Testing Artifact:https://community.opengroup.org/-/project/407/uploads/b8384598dc92141c9734817e460f4b10/EDS-PreShip-Test-Session1.docx	EDS Community meeting: https://opengroup.webex.com/opengroup/ldr.php?RCID=fd45af9cb9a1e99eeda070def42e5825
9	Implementation of Naturalization for katalyst (#66) ·	Primary Secondary Preship KT	Katalyst would like to pass a signed url so that Naturalization could download the file from the signed url and upload to dataset service	[EDS Naturalization] Pass in the signed url under the `path` of the workflow api request body	EDS Configuration Guide - OSDU EDS Documentation
10	Modify naturalization Dag file to improve time complexity (#111) · Issues ·	Primary Secondary Preship KT	Perform optimization on the naturalization DAG file for optimization	[EDS Naturalization] Able to run Naturalization	N/A
11	EDS Email Notification MVP2 (#67)	Primary Secondary Preship KT	Incremental updates on email notification and without redundancy	[EDS Ingest] [EDS Scheduler] Able to received email notification without redundant jobs updates	EDS Email Notification
12	EDS to support Reference Data Ingestion (#123)	Primary Secondary Preship KT	User would like to ingest reference data into the OSDU system	[EDS Ingest] Able to ingest reference data via manifest ingestion and manifest by reference	Manifest Ingestion Strategy		Todo Secondary testing for manifest by ref
13	Enhancement in Complex Parent data mapping functionality (#134) ·	Primary Secondary Preship KT	User would like to perform various kinds of complex parent data mapping (ie. name alias matching and geoTypeId name matching	[EDS Ingest] Able to run complex parent data mapping logic	Mapped Master data - Complex Mapping
14	Enhance Reference Data Mapping as per XOM suggestion[Techdebt] (#68)	Primary Secondary Preship KT	User would like to have refer to a reference data from a data provider within an CSRE or reference data from the OSDU system	[EDS Ingest] Able to map the reference data based on the configuration of choosing data providers' or OSDU system	Reference Data Mapping
15	RequestBodyTooLarge exception in EDS ingest for large payload. (#125) · Issues	Primary Secondary Preship KT	In Azure Preship, EDS Ingest payload isn't calculated properly that leads to incorrect redirection of ingestion strategy	[EDS Ingest] EDS is able to choose the correct ingestion strategy based on the records size that needs to be ingested	Manifest Ingestion Strategy
16	Store manifest_by_reference Run Details in Activity template (#115) ·	Primary Secondary Preship KT	User is able to search for `work-product-component--Activity` to find the activity template that contains the information about the jobs (similar to XCOM)	[EDS Ingest] The content of the records and XCOM are consistent	Creation of Activity Logs for monitoring ingestion workflow
17	ADR: EDS Triggering & Monitoring Custom Post Processing API (#120)	Primary Secondary Preship KT	User is able to trigger and/or monitor a custom post processing API based on their configuration that should follow EDS implementation requirements	[EDS Ingest] [EDS Naturalization] In post-ingest or post-naturalization, the EDS is able to trigger and/or monitor a custom post processing API	Custom Post-Processing Testing Artifact: https://community.opengroup.org/-/project/407/uploads/b8384598dc92141c9734817e460f4b10/EDS-PreShip-Test-Session1.docx	EDS Community meeting: https://opengroup.webex.com/opengroup/ldr.php?RCID=fd45af9cb9a1e99eeda070def42e5825
18	Community Implementation for EDS Compatibility (#138)	EDS DMS Primary Secondary Preship KT EDS Naturalization Primary Secondary Preship KT	In compliancy with CI environment, EDS DMS and EDS Naturalization should be able to run on CI	[EDS Naturalization] EDS DMS is able to retrieve an external file from provider using Dataset service EDS Naturalization is able to download and upload the external file to the operator OSDU instance	EDS DMS Naturalization

Edited Jul 31, 2025 by Teo Sheng Pu