Merged in bugfix/table-error-fix (pull request #444)

Bugfix/table error fix

* handle multipage table data correctly

* same metadata for all tables on the page

* Multiple tables on page, non-continuous, split

* Add back align_and_format_tables

* update unit tests

* Merged main into bugfix/table-error-fix

* improved align and format table prompt

* Successful E2E test on San Joaquin - without running align and format table prompt

* San Joaquin e2e test passed

* Merged main into bugfix/table-error-fix

* Merge branch 'main' into bugfix/table-error-fix

* Add same number of columns condition

* Merged main into bugfix/table-error-fix

* Clean investment_values

* Remove import

* docstrings

* Remove test doc

* Add back original ALIGN_AND_FORMAT_TABLES prompt for client work

* Remove import

* Add config reference

* Merged main into bugfix/table-error-fix

* Move table_utils to investment.table_funcs

* restore table_utils.py

* Update tests

* update preprocess


Approved-by: Alex Galarce

fieldExtraction/src/utils/string_utils.py

@@ -298,7 +298,7 @@ def is_empty(value):
     if pd.isna(value):
         return True
     else:
-        empty_values = [None, "", "N/A", "NA", "null", "none", "NaN", np.nan, "nan"]
+        empty_values = [None, "", "N/A", "NA", "null", "none", "NaN", np.nan, "nan", "None"]
         return value in empty_values