jacob-mathison/doczyai-pipelines
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Activity

Merged in feature/update-postprocessing-columns (pull request #893)

Browse Source 
move column order to final step

* move column order to final step

* Black


Approved-by: Siddhant Medar
This commit is contained in:
Katon Minhas
2026-03-02 19:53:16 +00:00
parent 1eaa17da1a
commit 22c3d80692
1 changed files with 2 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files
src/pipelines/shared/postprocessing/postprocess.py
+2 -3
View File
@@ -136,9 +136,6 @@ def standard_postprocess(df, constants: Constants):
df = postprocessing_funcs.attach_sid_column(df)
# Standardize output column order - this should ALWAYS be the final postprocessing step
df = postprocessing_funcs.reorder_columns(df, FIELD_FORMAT_MAPPING)
df["FILE_NAME"] = df["FILE_NAME"].apply(postprocessing_funcs.standardize_file_name)
# This will remove non-standard characters from every cell in the DataFrame
@@ -147,6 +144,8 @@ def standard_postprocess(df, constants: Constants):
# Remove N/A values from all columns (standard cleaning for all outputs)
df = postprocessing_funcs.clean_na_values(df)
# Standardize output column order - this should ALWAYS be the final postprocessing step
df = postprocessing_funcs.reorder_columns(df, FIELD_FORMAT_MAPPING)
return df