Commit Graph

8 Commits

Author SHA1 Message Date
Alex Galarce ffb4e07c89 Merged in bugfix/reimb-term-issues (pull request #705)
Add time-based rate handling rules and update section labels in prompt templates

* Add time-based rate handling rules and update section labels in prompt templates

* Add mapping for MyCare Ohio in crosswalk_program.json and update state mapping for Ohio in crosswalk_program_lob.json

* Update test parameters and state configuration in testing notebook

* Update exhibit-wide payment constraint prompt to exclude administrative processing language

* Merge remote-tracking branch 'origin/main' into bugfix/reimb-term-issues

* Refine exhibit-wide payment constraint prompt to clarify extraction criteria and examples

* Enhance exhibit-wide payment constraint prompt with guidance for abbreviated terms and clarify acceptable constraints

* Update SERVICE_TERM prompt to specify healthcare services and clarify extraction criteria


Approved-by: Katon Minhas
2025-09-11 21:06:52 +00:00
Alex Galarce 425a8ec86c Merged in feature/per-file-logging (pull request #686)
Feature/per file logging

* Add custom per-file logging handler

* Add close method in PerFileHandler to properly close file handlers

* Add return type annotation to setup_per_file_logging function

* Set up per-file logging in main and process_file functions

* Add per-file logging configuration options and update setup logic

* Refactor logging setup in testing notebook to use per-file logging and improve organization

* Clean up whitespace and improve organization in testing notebook

* Merge remote-tracking branch 'origin/main' into feature/per-file-logging

* Enhance per-file logging setup by adding debug level configuration and informative print statement

* Change logging from info to debug level in table processing functions for improved verbosity control

* isort


Approved-by: Katon Minhas
2025-08-29 14:38:15 +00:00
Alex Galarce c094fa35b0 Merged in feature/further-phase-1-and-2-fixes (pull request #622)
Table Continuation Fix

* Add EXHIBIT_HEADER_MARKERS for improved document header recognition in table handling

* Refactor EXHIBIT_HEADER_MARKERS definition for improved clarity and organization

* remove unused page span tracking code; add unit tests for new functionality

* remove debugging logs from combine_continuous_tables function

* Refactor logging setup and update test file configuration in investment field testing notebook

* Merge remote-tracking branch 'origin/main' into feature/further-phase-1-and-2-fixes


Approved-by: Katon Minhas
2025-07-17 19:39:33 +00:00
Alex Galarce 3be2f44cb1 Merged in feature/global-lesser-of (pull request #553)
Feature/global lesser of

* Merge remote-tracking branch 'origin/feature/reimb-primary-updates'

* First try at global "lesser of"

* Generate reimb_ids further upstream

* Implement global lesser of injection and extraction logic in file processing

* Update logic to change LESSER_OF_IND in-place for global affected rows; add docstrings

* Refactor global lesser of injection logic to create new rows for REIMB_IDs lacking lesser of logic; update original rows in place and improve tracking flags.

* Merge remote-tracking branch 'origin/main' into feature/global-lesser-of

* Add logging for global lesser of logic injection and update handling of original rows

* Refactor global lesser of logic: move functions to one_to_one_funcs.py and update inject_global_lesser_of_rows to use new implementations

* Move imports for METHODOLOGY_BREAKOUT_QUESTIONS and REIMB_TERM_BREAKOUT to the top of one_to_one_funcs.py for better organization and to remove prototype comments.

* isort

* Refactor import statement for generate_reimb_ids to use the full module path for clarity

* load field from JSON instead of hardcoded values

* Update logging levels in investment_field_testing notebook

* Merged main into feature/global-lesser-of

* Remove unnecessary comment from investment_postprocessing_funcs import statement for clarity

* Merge branch 'feature/global-lesser-of' of https://bitbucket.org/aarete/doczy.ai into feature/global-lesser-of

* Merge remote-tracking branch 'origin/main' into feature/global-lesser-of

* Remove debug print statement from process_file function

* fix call to Field.load_from_file

* Merge remote-tracking branch 'origin/main' into feature/global-lesser-of

* Add tracking flag for global lesser of logic when none is found

* explicitly sort by FILE_NAME, EXHIBIT_PAGE, and REIMB_LESSER_OF_ID columns

* Add new field type, "full_context_separate", to make sure that we don't run it twice.  Also formatting fix

* Fix iteration over separate fields in run_full_context_fields function


Approved-by: Katon Minhas
2025-06-04 19:49:10 +00:00
Alex Galarce 04cb261831 Merged in feature/rework_reimb_id (pull request #467)
Rework reimbursement ID to associate parts of "lesser of" (or other such coupled statement) with one another

* refactor reimbursement ID generation with hashed service terms

* reduce hash length for unique reimbursement ID generation

* update reimbursement ID format to include 'exh_pg' for clarity

* clean up testing.ipynb

* one more formatting fix to testing.ipynb

* Move reimb_id generation to postprocessing

* move reimb_id function to postprocessing_funcs.py

* refactor generate_reimb_ids to group by FILE_NAME and EXHIBIT_PAGE for ID generation

* clean testing.ipynb further


Approved-by: Katon Minhas
2025-04-07 20:43:17 +00:00
Katon Minhas f8b8a580ff Merged in fields/additional-initializations (pull request #447)
fields/additional initializations

* Set up test file

* New fields + new field names

* Add initial prompts to json

* Column renaming - remove CONTRACT_ prefix

* update tests

* testing

* Fix regex pattern in json.loads

* Merge branch 'hotfix/file-errors' into refactor/new-field-names

* add UNIT_OF_MEASURE

* initialize new values

* Add rate change interval

* Merge branch 'main' into fields/additional-initializations

* remove test

* replace field names

* update REIMB_ID

* update date columns

* update reimbursement effective dt

* Revert adhoc scripts

* Revert client files

* Update postprocessing_funcs

* revert regex_utils

* Fix valid issue

* UNIT_OF_MEASURE

* REIMB_TERM

* Revert postprocessing funcs tests


Approved-by: Alex Galarce
2025-03-21 18:11:55 +00:00
Alex Galarce a59562950f Merged in test/check-doc-dates-against-test-bed (pull request #385)
Better visibility and testing functionality for optimizing prompts

* first commit

* Enhance prompts and processing for contract termination dates

- Updated prompt to include 'year to year' as a valid example output.
- Implemented case-insensitive processing for contract text and field keywords for smart chunking.
- Clarified prompt for derived termination date to specify it is exclusive of renewals

* Merge remote-tracking branch 'origin/main' into test/check-doc-dates-against-test-bed

* Update termination date prompt tests

* Refine keywords for contract termination date prompt in investment prompts

* Docs on using the testing notebook

* add 'input_files' option to test_params

* Merge remote-tracking branch 'origin/main' into test/check-doc-dates-against-test-bed

* comment out debug line

* refactor: adjust input_files filtering logic in main function


Approved-by: Katon Minhas
2025-02-06 18:26:56 +00:00
Alex Galarce e34262fc86 Merged in test/check-doc-dates-against-test-bed (pull request #380)
Test/check doc dates against test bed

* first commit

* Enhance prompts and processing for contract termination dates

- Updated prompt to include 'year to year' as a valid example output.
- Implemented case-insensitive processing for contract text and field keywords for smart chunking.
- Clarified prompt for derived termination date to specify it is exclusive of renewals

* Merge remote-tracking branch 'origin/main' into test/check-doc-dates-against-test-bed

* Update termination date prompt tests

* Refine keywords for contract termination date prompt in investment prompts


Approved-by: Katon Minhas
2025-02-03 22:49:16 +00:00