very small error logging fix
* Handle ValueError in code range parsing and provide fallback
* Implement safe file processing with error handling and concurrent execution
* Merge remote-tracking branch 'origin/main' into bugfix/improve-stability
* more explicit error printing
* Merge remote-tracking branch 'origin/main' into bugfix/improve-stability
Approved-by: Katon Minhas
updated prompt to get the group provider
* updated prompt to get the group provider
* Merged main into bugfix/individual-prov-group-name
Approved-by: Alex Galarce
Bugfix/improve stability
* Handle ValueError in code range parsing and provide fallback
* Implement safe file processing with error handling and concurrent execution
* Merge remote-tracking branch 'origin/main' into bugfix/improve-stability
Approved-by: Katon Minhas
Feature/field renaming
* Update column names
* Update field names
* Update field names
* Merge branch 'main' into feature/field-renaming
* _DATE to _DT in field names
* _CD_DESC to _DESC
* NOT_TO_EXCEED_IND added as valid field
* Remove print statements
Approved-by: Alex Galarce
Fix load_embeddings()
* move datetime_str function to string_utils module
* enhance load_embeddings to create directory structure and handle download errors
* Merged main into feature/reimbursement-primary-optimizization
Approved-by: Katon Minhas
Feature/test 1 to n fields
* Add function to evaluate one-to-n field comparisons and calculate metrics
* Add fuzzy matching for one-to-n field comparisons and enhance evaluation metrics
* Refactor similarity calculation to use token sort ratio for improved field comparison
* Add matched labels to evaluation metrics in one-to-n fuzzy matching
Approved-by: Katon Minhas
Feature/override aa derived eff date
* Implement special handling for AARETE_DERIVED_TERMINATION_DATE based on CONTRACT_AUTO_RENEWAL_IND
* Refine prompts for CONTRACT_AUTO_RENEWAL_IND and CONTRACT_AUTO_RENEWAL_TERM for clarity
* move special handling for derived effective date to postprocess step
* Remove unnecessary blank line in get_crosswalk_and_derived function
Approved-by: Katon Minhas
Feature/standardize column order
* add column reordering
* Standardize column order
* Merged main into feature/standardize-column-order
Approved-by: Alex Galarce
Change from AARETE_DERIVED_ to CONTRACT_- FEE_SCHEDULE_VERSION
* Change from AARETE_DERIVED_ to CONTRACT_- FEE_SCHEDULE_VERSION
Approved-by: Alex Galarce
Hotfix/code description handling
* Update date formatting in prompts to YYYY/MM/DD
* fix tests for new date formatting
* Enhance code parsing to support comma-separated values in get_code_description function
* Merged main into hotfix/code-description-handling
Approved-by: Katon Minhas
Field/reconfigure prov type
* Run One-To-N before One-To-One
* Switch PROV_TYPE to Exhibit-Level
* Modify PROV_TYPE prompt
* Merge branch 'main' into field/reconfigure-prov-type
Approved-by: Alex Galarce
Update date formatting in prompts to YYYY/MM/DD
* Update date formatting in prompts to YYYY/MM/DD
* fix tests for new date formatting
Approved-by: Katon Minhas
StopLoss, Outliers, and Sequestration
* changed any method to all method in list handling
* code mapping moved outside to run once
* Merge branch 'feature/daip2-97' into bugfix/proc-code-lists
* merge conflict fixed
* merge conflicts fixed
* incorporated latest changes from main
* Merged main into bugfix/proc-code-lists
* Move load all dataset to io_utils
* Fix list is_empty
* Updated poetry.lock
* Bugfix
* Docstring
* Docstrings
* Merge branch 'main' into bugfix/proc-code-lists
* Merge branch 'bugfix/proc-code-lists' into bugfix/dynamic-assignment-issue
* Add outliers, stop-loss, and sequestration to reimbursement-level primary prompt template
* Add stop loss fields
* Add outlier fields
* Add sequestration fields
* Remove test
* Docstrings
* Update test for no default exhibit_level_answer_dict
* Merge branch 'bugfix/dynamic-assignment-issue' into field/stop-loss
* Merge branch 'main' into field/stop-loss
* Merged main into field/stop-loss
Approved-by: Alex Galarce
Bugfix/dynamic assignment issue
* Merged main into feature/proc-desc
* Uncomment test code
* Bugfix
* script optimisation for codes
* modified is empty function in string utils
* Remove test.py
* bug fix to handle list of proc_codes
* Merged main into bugfix/proc-code-lists
* changed any method to all method in list handling
* code mapping moved outside to run once
* Merge branch 'feature/daip2-97' into bugfix/proc-code-lists
* merge conflict fixed
* merge conflicts fixed
* incorporated latest changes from main
* Merged main into bugfix/proc-code-lists
* Move load all dataset to io_utils
* Fix list is_empty
* Updated poetry.lock
* Bugfix
* Docstring
* Docstrings
* Merge branch 'main' into bugfix/proc-code-lists
* Merge branch 'bugfix/proc-code-lists' into bugfix/dynamic-assignment-issue
* Update test for no default exhibit_level_answer_dict
* Merged main into bugfix/dynamic-assignment-issue
Approved-by: Alex Galarce
Bugfix/proc code lists
* Add admit type code
* add proc mod description
* Add bill type pos mapping
* Merged main into feature/proc-desc
* Uncomment test code
* Bugfix
* script optimisation for codes
* modified is empty function in string utils
* Remove test.py
* bug fix to handle list of proc_codes
* Merged main into bugfix/proc-code-lists
* changed any method to all method in list handling
* code mapping moved outside to run once
* Merge branch 'feature/daip2-97' into bugfix/proc-code-lists
* merge conflict fixed
* merge conflicts fixed
* incorporated latest changes from main
* Merged main into bugfix/proc-code-lists
* Move load all dataset to io_utils
* Fix list is_empty
* Updated poetry.lock
* Docstring
* Docstrings
* Merge branch 'main' into bugfix/proc-code-lists
* bug fix
Approved-by: Mayank Aamseek
Approved-by: Alex Galarce
Field/initialize prov type
* Code map bug fixes
* docstrings
* Initialize Rev and Diag descriptions
* Add 0 to front for rev codes
* Comments
* Merged main into feature/proc-desc
* Comments
* Separate grouper and diag codes
* add grouper version
* Bugfix"
* Add admit type code
* add proc mod description
* Add bill type pos mapping
* Merged main into feature/proc-desc
* Uncomment test code
* Bugfix
* Remove test.py
* Service Breakout prompt template
* list bugfix
* Merged main into feature/proc-desc
* concurrency
* Merge branch 'feature/proc-desc' into field/initialize-prov-type
* Added service_breakout function - only contains aarete prov-type rn
* Merge branch 'main' into field/initialize-prov-type
* Docstring
Approved-by: Alex Galarce
Client runs dashboard updates
* new dashboard code
* dashboard updates
* Merged main into client-runs-dashboard-updates
* Merged main into client-runs-dashboard-updates
Approved-by: Alex Galarce
Feature/test bed facilitation for 1-1 fields
* start comparing output to label data
* Enhance load_test_files.py to merge and reorder labels and predictions, outputting to CSV
* Refactor load_test_files.py to streamline label and prediction loading, sorting, and CSV output for date and TIN/NPI fields
* rename to one_to_one_comparison
* Merged main into feature/test-bed-facilitation
* rename notebook_config
* Merge branch 'feature/test-bed-facilitation' of https://bitbucket.org/aarete/doczy.ai into feature/test-bed-facilitation
* Merged main into feature/test-bed-facilitation
Approved-by: Katon Minhas
Document dates optimization
* simplified file processing for testing
* modified derived_term_date_prompt
* fixed day values with spaces or leading zeros
* modified contract termination date prompt
* updated termination date prompt
* reranking of chunks for better context
* exclude last date while calculating term date
* clean up
* clean up 2
* Merge branch 'main' into document_dates_optimization
pulled latest changes from main
* Merged main into document_dates_optimization
* fix unit tests
* Merged main into document_dates_optimization
* refactor: update termination date prompt for clarity and accuracy
* Merged main into document_dates_optimization
* fix pipeline
* Merge remote-tracking branch 'origin/main' into document_dates_optimization
* Merge branch 'document_dates_optimization' of https://bitbucket.org/aarete/doczy.ai into document_dates_optimization
Approved-by: Katon Minhas
Feature/daip2 95
* testing carveout
* Merge branch 'main' into feature/daip2-95
pulled latest changes from main
* CONTRACT_DEFAULT_IND logic changed
* Merge branch 'main' into feature/daip2-95
pulled latest changes from main
* prompt updated to remove mention of last carveout
* Merged main into feature/daip2-95
* Merged main into feature/daip2-95
* prompt updated
* Merge branch 'feature/daip2-95' of https://bitbucket.org/aarete/doczy.ai into feature/daip2-95
latest changes pulled
Approved-by: Katon Minhas
Feature/daip2 101
* missing group tin fixed
* use tin prompt in full context when N/A
* fixed N/A TIN and applied same to NPI
* null tin fixed
* Merged main into feature/daip2-101
* if PROV_GROUP_TIN is still N/A, pick first value from tin_other
* Merge branch 'feature/daip2-101' of https://bitbucket.org/aarete/doczy.ai into feature/daip2-101
pulled latest changes from main
Approved-by: Katon Minhas
Feature/new prompts for methodology
* Added reimb. effective date and termination date
* Added prompt for identifying 'not to exceed' limitations in investment prompts
* Refactor field names for reimbursement effective and termination dates in investment prompts
* Clarified documentation for handling multiple reimbursement methods in investment prompts
Approved-by: Katon Minhas
Feature/claude cache
* Add Bill Type
* cache for llm_utils invoke_claude
* Merged main into feature/claude-cache
* LRUCache class
* Move to OrderedDict cache
* Remove lru cache call
Approved-by: Alex Galarce
Field group/code primary
* Code breakout function
* Merged main into field-group/code-primary
* Update prompts
* Add admit type
* Merged main into field-group/code-primary
* Updated code primary prompts
* Updated code primary prompt template
Approved-by: Alex Galarce
Feature/daip2 101
* missing group tin fixed
* use tin prompt in full context when N/A
* fixed N/A TIN and applied same to NPI
* Merge remote-tracking branch 'origin/main' into feature/daip2-101
Approved-by: Alex Galarce
DRAFT: missing group tin fixed
* missing group tin fixed
* use tin prompt in full context when N/A
* Merged main into feature/daip2-101
Approved-by: Katon Minhas
Initialize AARETE_DERIVED_NETWORK
* Initialized AARETE_DERIVED_NETWORK
* Updated crosswalk - make all crosswalks capitalized
* Merge branch 'main' into field/aarete_derived_network
* Merged main into field/aarete_derived_network
* Merged main into field/aarete_derived_network
Approved-by: Alex Galarce
Better visibility and testing functionality for optimizing prompts
* first commit
* Enhance prompts and processing for contract termination dates
- Updated prompt to include 'year to year' as a valid example output.
- Implemented case-insensitive processing for contract text and field keywords for smart chunking.
- Clarified prompt for derived termination date to specify it is exclusive of renewals
* Merge remote-tracking branch 'origin/main' into test/check-doc-dates-against-test-bed
* Update termination date prompt tests
* Refine keywords for contract termination date prompt in investment prompts
* Docs on using the testing notebook
* add 'input_files' option to test_params
* Merge remote-tracking branch 'origin/main' into test/check-doc-dates-against-test-bed
* comment out debug line
* refactor: adjust input_files filtering logic in main function
Approved-by: Katon Minhas
Initialized Field group/methodology breakout
* Added fee schedule breakout
* Only run standard methodology breakout on non-carveouts
* Add docstrings
Approved-by: Alex Galarce
VenkataKrishna Reddy Avula