Files
doczyai-pipelines/.gitignore
T
Praneel Panchigar bff8e103b0 Merged in bugfix/molina_ut_dynamic_primary (pull request #991)
Bugfix/molina ut dynamic primary

* Prompt changes for dynamic primary

* Route cover-sheet-only files to ERRORS.csv instead of leaking phantom rows

When every page of a contract was filtered out as a cover sheet / quick-review
form, process_file silently returned a FILE_NAME-only DataFrame. Because the
runner routes by checking for an "error" column, that file landed in
RESULTS.csv as a near-empty row and no ERRORS.csv was generated for the run.

- saas/file_processing.py: raise ValueError when text_dict is empty after
  cover-sheet filtering, so safe_process_file produces a proper error row.
- runner.py: add _is_phantom_result defense-in-depth — promote any result
  with no extracted fields beyond FILE_NAME to error_results with
  error_type=PhantomSuccess.

* Merged dev into bugfix/molina_ut_dynamic_primary

* Tighten PRODUCT prompt: restrict to valid_values, prune LOB/PROGRAM examples

* Merge branch 'bugfix/molina_ut_dynamic_primary' of bitbucket.org:aarete/doczy.ai into bugfix/molina_ut_dynamic_primary

* Add PROVIDER_NAME and DISCOUNT_TERM to FIELD_FORMAT_MAPPING

* Revert "Route cover-sheet-only files to ERRORS.csv instead of leaking phantom rows"

This reverts commit de79a1391511acaf78c92a6bee53697f419d3996.

* Drop internal-only columns from final output

Four columns were leaking into RESULTS.csv that have no entry in
FIELD_FORMAT_MAPPING and shouldn't ship to production:
  - DOCUMENT_TYPE: from the document classification stage, not a contract field
  - REIMB_PAGE / EXHIBIT_TEXT: internal extraction-trace columns
  - CODE_MAPPING_SOURCE: debug column

Drop them in standard_postprocess just before reorder_columns. Done after
attach_sid_column so AARETE_DERIVED_SID (which reads DOCUMENT_TYPE) still
gets populated correctly. Uses errors='ignore' so the drop is a no-op
when a column isn't present.

* Strict-filter columns to FIELD_FORMAT_MAPPING and tighten PRODUCT prompt

* Merged dev into bugfix/molina_ut_dynamic_primary

* Dedupe values within LOB/PROGRAM/PRODUCT/NETWORK fields

* Move hard-codes to within function


Approved-by: Katon Minhas
2026-05-01 21:27:39 +00:00

125 lines
1.4 KiB
Plaintext

# Python
*.py[cod]
*.pyo
__pycache__/
.mypy_cache/
.pytest_cache/
myenv/
*.egg-info/
# IDE
.idea/
.cursor/
.vscode/
.claude/
CLAUDE.md
# Claude (local agent notes)
.claude/
CLAUDE.md
# OS
.DS_Store
Thumbs.db
*:Zone.Identifier
# Logs
*.log
# Environment
.env
*.env
# Data files (general exclusion)
*.csv
*.xlsx
*.xlsb
*.zip
*.json
*.txt
*.pdf
*.PDF
*.TXT
# Allow tracked data files in src/
!src/constants/**/*.csv
!src/constants/**/*.json
!src/prompts/*.json
!requirements.txt
# Build artifacts
dist/
build/
target/
*.class
*.jar
*.war
*.app
*.exe
# Large media files
*.mp4
*.tiff
*.avi
*.flv
*.mov
*.wmv
# Terraform
.terraform/
terraform.tfstate*
.terraform.lock.hcl
*.tfplan
*.pem
textract-pipeline/terraform/builds/
# Outputs
output/
outputs/
# Local/temporary
subset/
docs/
local_scripts/
untracked_tests/
new/
textfiles/
texts/
# Streamlit (legacy)
streamlit/history.csv
streamlit/RESULTS
streamlit/DB/
streamlit/RAW_DOCUMENTS/
streamlit/SOURCE_DOCUMENTS/
streamlit/contract_field_values.csv
streamlit/contract_fields.csv
streamlit/sample.csv
streamlit/temp*.csv
streamlit/results.csv
streamlit/venv
# Legacy paths
fieldExtraction/embeddings/
# Node (if any)
node_modules/
# Test reports
TEST*.xml
# Shell scripts (debugging/utility)
*.sh
!resolve_source_branch.sh
# PRD Documents
*.prd
*prd.md
.git.instructions.md
# Local code index
.claude/index/
# Local output / offline study artifacts
out/