1837 Commits

Author SHA1 Message Date
ppanchigar 5b619b2f5f fixed code implicit special and ran black for CI 2026-02-04 10:57:40 -06:00
Katon Minhas 6751a5ab7a Merge branch 'feature/standardize-list-format' into DEV 2026-02-04 03:40:23 -05:00
Katon Minhas f8783ae968 Update prov_info 2026-02-04 03:37:23 -05:00
Katon Minhas f0da944ade update tin_npi_funcs dedups 2026-02-04 02:42:21 -05:00
Katon Minhas ee85884dce Refactor llm call to prompt_calls 2026-02-04 02:23:55 -05:00
Katon Minhas 2c76b8a92b Resolve PROV_INFO issue 2026-02-04 01:41:09 -05:00
Katon Minhas bafb92c684 Refactor - sub functions 2026-02-04 00:34:53 -05:00
Katon Minhas 32c667ad49 Revert 2026-02-04 00:15:50 -05:00
ppanchigar 7e3d8ea2fe Remove debug print statements for CLAIM_TYPE_CD and provider info 2026-02-03 22:49:12 -06:00
ppanchigar deffb639cf Fix CLAIM_TYPE_CD being converted to list in get_crosswalk_fields and add debug prints for troubleshooting 2026-02-03 22:44:32 -06:00
Katon Minhas 0882a79b5a Merged in bugfix/list-of-lists (pull request #866)
Bugfix/list of lists

* Revert tin_npi_funcs.py to DEV

* update bill type mapping

* Remove test.py

* Prep for merge
2026-02-04 04:27:03 +00:00
ppanchigar cff0472717 Latest updates 2026-02-03 21:12:50 -06:00
ppanchigar 90b1ea283f refactor: complete JSON format standardization updates
- Updated all prompt_calls.py files (saas, bcbs_promise, clover) to use new parser pattern
- Updated prompt_templates.py with JSON format instructions
- Updated crosswalk_utils.py to handle JSON lists
- Updated json_utils.py with improved parsing
- Updated aarete_derived.py for JSON compatibility
- Updated tin_npi_funcs.py and qa_qc_utils.py for JSON parsing
- All changes align with Phase 4 completion of JSON standardization
2026-02-03 17:29:52 -06:00
ppanchigar 3c89aecfaf chore: remove debug statements and update PRD
- Removed all debug print statements from prompt_calls.py and one_to_n_funcs.py
- Updated PRD to reflect Phase 4 completion and recent bug fixes
- Documented REIMB_TERM normalization fixes and cleanup work
- Updated Phase 6 status to 25% complete (debug removal done)
2026-02-03 17:27:45 -06:00
ppanchigar a633f67c62 Fix REIMB_TERM being converted to list in lesser_of_distribution
- Fixed prompt_lesser_of_distribution to extract string from list when parser returns list
- Added debug print statements to trace REIMB_TERM format through processing pipeline
- Removed defensive normalization checks that are no longer needed upstream
- Added debug output in reimbursement_level and methodology_breakout_single_row to track data flow
2026-02-03 17:15:14 -06:00
Sha Brown 05b00ab6a1 Merged in bugfix/max_workers_and_batch_id (pull request #864)
Trigger error when batch_id is not specified or when max_workers is negative

* Trigger error when batch_id is not specified or when max_workers is negative


Approved-by: Katon Minhas
2026-02-03 21:12:27 +00:00
Rahul Ailaboina 1865e75c47 few enhancement in the output needed 2026-02-03 13:50:06 -06:00
Siddhant Medar 8fbe64e42e Merged in feature/adding_contract_admenment_num_pc (pull request #863)
Feature/adding contract admenment num pc

* Updated contract amendment

* Format code with Black

* updated to have letters

* format fixes

* Adjusted unit testing

* Merge remote-tracking branch 'origin/DEV' into feature/adding_contract_admenment_num_pc

* apply formatting
2026-02-03 17:59:01 +00:00
ppanchigar 4c0d2930d5 docs: update PRD - Phase 4 now 100% complete
- Updated progress table: Phase 4 is now 100% complete
- Marked model_evaluation_utils.py as complete (commit 13f3cbea)
- Verified testbed/QC files process internal data (out of scope)
- Updated remaining work section
- Updated overall status to Phase 4 of 6 Complete
2026-02-03 11:08:06 -06:00
ppanchigar 13f3cbeac6 fix: Phase 4 - update model_evaluation_utils.py for JSON parsing
- Fixed DYNAMIC_PRIMARY_TEXT: now unpacks (prompt, parser) tuple and uses parser
- Fixed REIMBURSEMENT_PRIMARY: corrected function signature (only takes context)
- Replaced extract_text_from_delimiters with JSON parser
- Replaced universal_json_load with parser from tuple
- Added proper instruction caching for both prompts

Other testbed/QC files verified: they process internal data formats (out of scope per PRD)
2026-02-03 11:07:18 -06:00
ppanchigar 8339dea499 docs: update PRD - Phase 3 now 100% complete
- Updated progress table: Phase 3 is now 100% complete
- Marked code_funcs.py as complete (commit a7a32b90)
- Updated remaining work section
- Added latest commit to commit history
2026-02-03 11:02:57 -06:00
ppanchigar a7a32b9092 fix: complete Phase 3 - replace remaining universal_json_load calls in code_funcs.py
- Line 498: Changed from universal_json_load to use _parser from FILL_BILL_TYPE tuple
- Line 856: Updated GROUPER_BREAKOUT call to unpack tuple and use grouper_parser
- Removed unused GROUPER_QUESTIONS variable (fields now in INSTRUCTION function for caching)
- All universal_json_load calls in code_funcs.py have been replaced
- Phase 3 is now 100% complete
2026-02-03 11:01:47 -06:00
ppanchigar 2e307347fd refactor: update investment_prompts.json to use JSON format instead of pipes
- Updated EFFECTIVE_DT field: Replaced all pipe format examples (|date|) with JSON dictionary format
  - Changed examples from 'return |3-1  , , 03|' to 'return "3-1  , , 03"'
  - Updated final answer format from 'ENCLOSED in |pipes|' to JSON dict: {"EFFECTIVE_DT": "date"}
- Updated PROVIDER_NAME field: Replaced pipe-separated format with JSON list format
  - Changed from 'separated by |' to JSON list: ["Provider A", "Provider B"]
  - Updated to return JSON dict: {"PROVIDER_NAME": [...]} or {"PROVIDER_NAME": "single"}
- All pipe references removed from investment_prompts.json
- Updated PRD to document this change in Phase 2 checklist
- JSON file validated and syntax confirmed correct
2026-02-03 10:53:58 -06:00
ppanchigar 9e3fe81fe5 docs: update PRD with actual implementation progress
- Updated progress table: Phase 3 is 95% complete, Phase 4 is 60% complete
- Marked all prompt_calls.py files as complete (saas, clover, bcbs_promise)
- Marked tin_npi_funcs.py, hybrid_smart_chunking_funcs.py, postprocessing_funcs.py, crosswalk_utils.py, dynamic_funcs.py as complete
- Noted 2 remaining universal_json_load calls in code_funcs.py (lines 498, 856)
- Documented aarete_derived.py dual-format support (intentional backward compatibility)
- Added comprehensive implementation status summary section
- Updated Phase 3 and Phase 4 checklists with actual completion status
- Added statistics: 26 files modified, ~350 lines net reduction, 20+ commits
2026-02-03 10:32:58 -06:00
Venkat df103579b7 updated postprocessing funcs 2026-02-03 15:06:41 +00:00
Venkat 0d9f9314e9 updated tin npi funcs and page funcs 2026-02-03 14:55:05 +00:00
Venkat 8399dbdf1f updated crosswalk reverse mapping 2026-02-03 14:16:56 +00:00
Venkat 18c094568b fixed clean provider info 2026-02-03 14:01:17 +00:00
Venkat 2aa68f75b9 black format 2026-02-03 13:41:09 +00:00
Katon Minhas e8e8f1ba5a Strip out dynamic postprocessing 2026-02-03 01:38:49 -05:00
Katon Minhas 03fda6013b Resolve split reimb dates 2026-02-03 01:24:58 -05:00
Katon Minhas ef70ddf3be Resolve Lesser of Check issue 2026-02-03 01:10:41 -05:00
Katon Minhas 4701f7039a Fix carveout code error 2026-02-03 00:34:53 -05:00
Katon Minhas b5b19d81a0 Update reimbursement cleaning parser 2026-02-03 00:21:10 -05:00
Katon Minhas bb96edb7c5 Clean crosswalk function 2026-02-03 00:08:36 -05:00
Katon Minhas 4af0e26990 Update AARETE_DERIVED_PRODUCT processing 2026-02-03 00:07:12 -05:00
Katon Minhas cdce35739b Update fill_na_mapping 2026-02-02 23:44:27 -05:00
Katon Minhas 62605981c1 resolve hsc issue 2026-02-02 22:23:23 -05:00
Katon Minhas 9b30c5f282 Resolve circular import of prompt_hsc_single_field 2026-02-02 21:57:22 -05:00
Katon Minhas bb440acd7e Correct reference 2026-02-02 21:54:50 -05:00
Katon Minhas 6c3f3f6f96 Update code_funcs.py 2026-02-02 21:47:30 -05:00
Katon Minhas 309fa49ac6 Update codes 2026-02-02 21:36:25 -05:00
Katon Minhas e538af4076 UPdate logging levels 2026-02-02 21:28:32 -05:00
Katon Minhas 28afc7fedf Minor refactor 2026-02-02 21:24:20 -05:00
Katon Minhas 3e9d7b08b7 Remove excess print 2026-02-02 20:53:45 -05:00
Katon Minhas dba611469d Update prompt_calls 2026-02-02 20:53:23 -05:00
ppanchigar cbff139ce9 docs: update PRD with tuple-returning architecture and progress
- Updated section 4.1.2 with actual implementation details
- All 35 prompt templates now return (prompt, parser) tuples
- Added implementation progress table showing Phase 1 & 2 complete
- Documented benefits of tuple-returning approach
- Listed all updated functions and their parser types
- Updated work items checklist to reflect completed phases
- Added commit references: 98554afc (architecture), 5d1024e (templates)
- Marked Phase 3 as next step: update prompt_calls.py files
2026-02-02 17:16:56 -06:00
ppanchigar 98554afc05 refactor: update all prompt templates to return (prompt, parser) tuples
- Updated 24 prompt template functions to return (prompt_string, parser_function) tuples
- Added type hints: Tuple[str, Callable[[str], dict/list]]
- Changed return pattern from 'return f"""..."""' to 'prompt = f"""..."""' followed by 'return (prompt, parser)'
- Added parser functions: _json_dict_parser and _json_list_parser
- Updated docstrings to include Returns section explaining the tuple structure
- Functions updated include: LESSER_OF_CHECK, EXHIBIT_TITLE_MATCH, OUTLIER_BREAKOUT, CODE_EXPLICIT, CODE_CATEGORY, CODE_IMPLICIT_SPECIAL, CODE_IMPLICIT, CODE_LAST_CHECK, FILL_BILL_TYPE, ONE_TO_ONE_SINGLE_FIELD_TEMPLATE, TIN_NPI_TEMPLATE, CHECK_PROVIDER_NAME_MATCH_PROMPT, EXTRACT_AMENDMENT_NUM_FROM_FILENAME, EXHIBIT_HEADER, EXHIBIT_LINKAGE, DATE_FIX_PROMPT, EFFECTIVE_DATE_FIX_PROMPT, SPLIT_REIMB_DATES, DERIVED_TERM_DATE_PROMPT, and all breakout functions
- All changes verified with linter and Python compilation
- No syntax errors or linter issues
2026-02-02 17:12:10 -06:00
ppanchigar f633922381 feat: Add JSON parsers infrastructure (Phase 1)
- Create json_utils.py with parse_json_dict() and parse_json_list() functions
- Add comprehensive unit tests (49 tests, all passing)
- Add deprecation warnings to string_utils.py for pipe-delimited parsing
- Follows PRD Phase 1: Parser Infrastructure

This is the first step in replacing pipe-delimited LLM output format with
structured JSON format as per PRD_STANDARDIZE_LIST_FORMATS.md
2026-02-02 16:44:29 -06:00
ppanchigar 5d1024e9dc prompt changes 2026-02-02 16:25:45 -06:00