Feature/override aa derived eff date
* Implement special handling for AARETE_DERIVED_TERMINATION_DATE based on CONTRACT_AUTO_RENEWAL_IND
* Refine prompts for CONTRACT_AUTO_RENEWAL_IND and CONTRACT_AUTO_RENEWAL_TERM for clarity
* move special handling for derived effective date to postprocess step
* Remove unnecessary blank line in get_crosswalk_and_derived function
Approved-by: Katon Minhas
Feature/standardize column order
* add column reordering
* Standardize column order
* Merged main into feature/standardize-column-order
Approved-by: Alex Galarce
Change from AARETE_DERIVED_ to CONTRACT_- FEE_SCHEDULE_VERSION
* Change from AARETE_DERIVED_ to CONTRACT_- FEE_SCHEDULE_VERSION
Approved-by: Alex Galarce
Hotfix/code description handling
* Update date formatting in prompts to YYYY/MM/DD
* fix tests for new date formatting
* Enhance code parsing to support comma-separated values in get_code_description function
* Merged main into hotfix/code-description-handling
Approved-by: Katon Minhas
Field/reconfigure prov type
* Run One-To-N before One-To-One
* Switch PROV_TYPE to Exhibit-Level
* Modify PROV_TYPE prompt
* Merge branch 'main' into field/reconfigure-prov-type
Approved-by: Alex Galarce
Update date formatting in prompts to YYYY/MM/DD
* Update date formatting in prompts to YYYY/MM/DD
* fix tests for new date formatting
Approved-by: Katon Minhas
StopLoss, Outliers, and Sequestration
* changed any method to all method in list handling
* code mapping moved outside to run once
* Merge branch 'feature/daip2-97' into bugfix/proc-code-lists
* merge conflict fixed
* merge conflicts fixed
* incorporated latest changes from main
* Merged main into bugfix/proc-code-lists
* Move load all dataset to io_utils
* Fix list is_empty
* Updated poetry.lock
* Bugfix
* Docstring
* Docstrings
* Merge branch 'main' into bugfix/proc-code-lists
* Merge branch 'bugfix/proc-code-lists' into bugfix/dynamic-assignment-issue
* Add outliers, stop-loss, and sequestration to reimbursement-level primary prompt template
* Add stop loss fields
* Add outlier fields
* Add sequestration fields
* Remove test
* Docstrings
* Update test for no default exhibit_level_answer_dict
* Merge branch 'bugfix/dynamic-assignment-issue' into field/stop-loss
* Merge branch 'main' into field/stop-loss
* Merged main into field/stop-loss
Approved-by: Alex Galarce
Bugfix/dynamic assignment issue
* Merged main into feature/proc-desc
* Uncomment test code
* Bugfix
* script optimisation for codes
* modified is empty function in string utils
* Remove test.py
* bug fix to handle list of proc_codes
* Merged main into bugfix/proc-code-lists
* changed any method to all method in list handling
* code mapping moved outside to run once
* Merge branch 'feature/daip2-97' into bugfix/proc-code-lists
* merge conflict fixed
* merge conflicts fixed
* incorporated latest changes from main
* Merged main into bugfix/proc-code-lists
* Move load all dataset to io_utils
* Fix list is_empty
* Updated poetry.lock
* Bugfix
* Docstring
* Docstrings
* Merge branch 'main' into bugfix/proc-code-lists
* Merge branch 'bugfix/proc-code-lists' into bugfix/dynamic-assignment-issue
* Update test for no default exhibit_level_answer_dict
* Merged main into bugfix/dynamic-assignment-issue
Approved-by: Alex Galarce
Bugfix/proc code lists
* Add admit type code
* add proc mod description
* Add bill type pos mapping
* Merged main into feature/proc-desc
* Uncomment test code
* Bugfix
* script optimisation for codes
* modified is empty function in string utils
* Remove test.py
* bug fix to handle list of proc_codes
* Merged main into bugfix/proc-code-lists
* changed any method to all method in list handling
* code mapping moved outside to run once
* Merge branch 'feature/daip2-97' into bugfix/proc-code-lists
* merge conflict fixed
* merge conflicts fixed
* incorporated latest changes from main
* Merged main into bugfix/proc-code-lists
* Move load all dataset to io_utils
* Fix list is_empty
* Updated poetry.lock
* Docstring
* Docstrings
* Merge branch 'main' into bugfix/proc-code-lists
* bug fix
Approved-by: Mayank Aamseek
Approved-by: Alex Galarce
Field/initialize prov type
* Code map bug fixes
* docstrings
* Initialize Rev and Diag descriptions
* Add 0 to front for rev codes
* Comments
* Merged main into feature/proc-desc
* Comments
* Separate grouper and diag codes
* add grouper version
* Bugfix"
* Add admit type code
* add proc mod description
* Add bill type pos mapping
* Merged main into feature/proc-desc
* Uncomment test code
* Bugfix
* Remove test.py
* Service Breakout prompt template
* list bugfix
* Merged main into feature/proc-desc
* concurrency
* Merge branch 'feature/proc-desc' into field/initialize-prov-type
* Added service_breakout function - only contains aarete prov-type rn
* Merge branch 'main' into field/initialize-prov-type
* Docstring
Approved-by: Alex Galarce
Feature/test bed facilitation for 1-1 fields
* start comparing output to label data
* Enhance load_test_files.py to merge and reorder labels and predictions, outputting to CSV
* Refactor load_test_files.py to streamline label and prediction loading, sorting, and CSV output for date and TIN/NPI fields
* rename to one_to_one_comparison
* Merged main into feature/test-bed-facilitation
* rename notebook_config
* Merge branch 'feature/test-bed-facilitation' of https://bitbucket.org/aarete/doczy.ai into feature/test-bed-facilitation
* Merged main into feature/test-bed-facilitation
Approved-by: Katon Minhas
Document dates optimization
* simplified file processing for testing
* modified derived_term_date_prompt
* fixed day values with spaces or leading zeros
* modified contract termination date prompt
* updated termination date prompt
* reranking of chunks for better context
* exclude last date while calculating term date
* clean up
* clean up 2
* Merge branch 'main' into document_dates_optimization
pulled latest changes from main
* Merged main into document_dates_optimization
* fix unit tests
* Merged main into document_dates_optimization
* refactor: update termination date prompt for clarity and accuracy
* Merged main into document_dates_optimization
* fix pipeline
* Merge remote-tracking branch 'origin/main' into document_dates_optimization
* Merge branch 'document_dates_optimization' of https://bitbucket.org/aarete/doczy.ai into document_dates_optimization
Approved-by: Katon Minhas
Feature/daip2 95
* testing carveout
* Merge branch 'main' into feature/daip2-95
pulled latest changes from main
* CONTRACT_DEFAULT_IND logic changed
* Merge branch 'main' into feature/daip2-95
pulled latest changes from main
* prompt updated to remove mention of last carveout
* Merged main into feature/daip2-95
* Merged main into feature/daip2-95
* prompt updated
* Merge branch 'feature/daip2-95' of https://bitbucket.org/aarete/doczy.ai into feature/daip2-95
latest changes pulled
Approved-by: Katon Minhas
Feature/daip2 101
* missing group tin fixed
* use tin prompt in full context when N/A
* fixed N/A TIN and applied same to NPI
* null tin fixed
* Merged main into feature/daip2-101
* if PROV_GROUP_TIN is still N/A, pick first value from tin_other
* Merge branch 'feature/daip2-101' of https://bitbucket.org/aarete/doczy.ai into feature/daip2-101
pulled latest changes from main
Approved-by: Katon Minhas
Feature/new prompts for methodology
* Added reimb. effective date and termination date
* Added prompt for identifying 'not to exceed' limitations in investment prompts
* Refactor field names for reimbursement effective and termination dates in investment prompts
* Clarified documentation for handling multiple reimbursement methods in investment prompts
Approved-by: Katon Minhas
Feature/claude cache
* Add Bill Type
* cache for llm_utils invoke_claude
* Merged main into feature/claude-cache
* LRUCache class
* Move to OrderedDict cache
* Remove lru cache call
Approved-by: Alex Galarce
Field group/code primary
* Code breakout function
* Merged main into field-group/code-primary
* Update prompts
* Add admit type
* Merged main into field-group/code-primary
* Updated code primary prompts
* Updated code primary prompt template
Approved-by: Alex Galarce
Feature/daip2 101
* missing group tin fixed
* use tin prompt in full context when N/A
* fixed N/A TIN and applied same to NPI
* Merge remote-tracking branch 'origin/main' into feature/daip2-101
Approved-by: Alex Galarce
DRAFT: missing group tin fixed
* missing group tin fixed
* use tin prompt in full context when N/A
* Merged main into feature/daip2-101
Approved-by: Katon Minhas
Initialize AARETE_DERIVED_NETWORK
* Initialized AARETE_DERIVED_NETWORK
* Updated crosswalk - make all crosswalks capitalized
* Merge branch 'main' into field/aarete_derived_network
* Merged main into field/aarete_derived_network
* Merged main into field/aarete_derived_network
Approved-by: Alex Galarce
Better visibility and testing functionality for optimizing prompts
* first commit
* Enhance prompts and processing for contract termination dates
- Updated prompt to include 'year to year' as a valid example output.
- Implemented case-insensitive processing for contract text and field keywords for smart chunking.
- Clarified prompt for derived termination date to specify it is exclusive of renewals
* Merge remote-tracking branch 'origin/main' into test/check-doc-dates-against-test-bed
* Update termination date prompt tests
* Refine keywords for contract termination date prompt in investment prompts
* Docs on using the testing notebook
* add 'input_files' option to test_params
* Merge remote-tracking branch 'origin/main' into test/check-doc-dates-against-test-bed
* comment out debug line
* refactor: adjust input_files filtering logic in main function
Approved-by: Katon Minhas
Initialized Field group/methodology breakout
* Added fee schedule breakout
* Only run standard methodology breakout on non-carveouts
* Add docstrings
Approved-by: Alex Galarce
Test/check doc dates against test bed
* first commit
* Enhance prompts and processing for contract termination dates
- Updated prompt to include 'year to year' as a valid example output.
- Implemented case-insensitive processing for contract text and field keywords for smart chunking.
- Clarified prompt for derived termination date to specify it is exclusive of renewals
* Merge remote-tracking branch 'origin/main' into test/check-doc-dates-against-test-bed
* Update termination date prompt tests
* Refine keywords for contract termination date prompt in investment prompts
Approved-by: Katon Minhas
Initialize Reimbursement-Level TINs
* Initialized Reimbursement-Level TIN and NPI
* Update unit tests
* Docstrings and cleanup
* Update test
Approved-by: Alex Galarce
Initialize 1:1 TIN and NPI Fields (Using CNC methodology)
* 1:1 TIN and NPI fields added (using CNC methodology)
* Merge branch 'main' into field/tin-npi-initialization
* Merged main into field/tin-npi-initialization
* Merged main into field/tin-npi-initialization
* Merged main into field/tin-npi-initialization
Approved-by: Alex Galarce
Fields/document dates further iteration
* add concise date fix prompt
* Refactor and prepare for postprocessing formatting
* Merged main into fields/document-dates-further-iteration
* Merged main into fields/document-dates-further-iteration
* Implement memoization for date postprocessing and add derived termination date calculation
* Merge branch 'fields/document-dates-further-iteration' of https://bitbucket.org/aarete/doczy.ai into fields/document-dates-further-iteration
* fix mypy error
* tweaks to derived termination date
* Add docstring to derived_term_date_prompt and create unit tests for prompt generation
* fix memoization in postprocess.py
* Merged main into fields/document-dates-further-iteration
Approved-by: Katon Minhas
Initialized CONTRACT_CARVEOUT_IND and CONTRACT_CARVEOUT_CD
* add carveout list
* Write carveout ind prompt and integrated
* Remove None carveouts
* Add TODO for carveout check
* Fill out remaining carveouts
* Merged main into feature/carveout_ind
Approved-by: Alex Galarce
Feature/doc date iterations
* add parse_chunk()
* add stitch_chunks() and tests
* create new constant
* put in new stitch_chunks() function
* resolve output validation TODO
* Merged main into feature/clean-up-smart-chunking
* fix Mayank's callout of noncontiguous chunks, fix typos, add tests
* add comment on test
* Merge remote-tracking branch 'origin/main' into feature/doc-date-iterations
* add 'signature page' to effective date keywords. loosen instructions on termination date.
* enhance prompts with examples and clarify instructions for termination date
* fix for group_fields()
* clean up test imports
Approved-by: Katon Minhas
Feature/clean up smart chunking
* add parse_chunk()
* add stitch_chunks() and tests
* create new constant
* put in new stitch_chunks() function
* resolve output validation TODO
* Merged main into feature/clean-up-smart-chunking
* fix Mayank's callout of noncontiguous chunks, fix typos, add tests
* add comment on test
* Merged main into feature/clean-up-smart-chunking
Approved-by: Katon Minhas
VenkataKrishna Reddy Avula