Review on dataframe serializer (!317) · Merge requests · OSDU Software / OSDU Data Platform / Domain Data Management Services / Wellbore / Wellbore Domain Services

Yannick requested to merge review_dataframeserializer into master Nov 18, 2021

upon team agreement:

remove V3 & alpha V2 support JSON 'columns' format on write bulk APIs
JSON 'columns' still supported on V3 & alpha V2 on read bulk APIs
on legacy V2 read/write bulk APIs, supports unchanged but no convert axes from Pandas.
no try to infer date time type from JSON. This was already the case on V3 & alpha V2. This change impacts only legacy V2 but mainly fix unwanted index & column alteration. Date time passed using JSON will pass stored as-it in plain string. Parquet format must be used for full typed date time index.

Edited Nov 24, 2021 by Yannick

Review on dataframe serializer