Mixed Data Types in Column Cause Parquet Serialization Failure During Search

Raul Isunza
2026-03-20T20:35:32Z

Issue reported by Abhishek.

Description:

When ingesting multiple datasets, if a column (e.g., temperature) contains mixed data types across datasets (such as numbers in one dataset and strings in another), the system does not validate or enforce consistent data types during ingestion. As a result, when performing a GET request to /samplesanalysis/nmr/search/data with content-type application/x-parquet, an internal server error occurs during Parquet serialization. The error message indicates a failure to convert a string value to int64 in the affected column, causing the read/search operation to fail. However, the same operation succeeds with content-type application/json. This highlights a lack of data type validation at ingestion, leading to runtime errors when serializing to Parquet format.