Files
doczyai-pipelines/fieldExtraction/crosswalk
Katon Minhas f8b8a580ff Merged in fields/additional-initializations (pull request #447)
fields/additional initializations

* Set up test file

* New fields + new field names

* Add initial prompts to json

* Column renaming - remove CONTRACT_ prefix

* update tests

* testing

* Fix regex pattern in json.loads

* Merge branch 'hotfix/file-errors' into refactor/new-field-names

* add UNIT_OF_MEASURE

* initialize new values

* Add rate change interval

* Merge branch 'main' into fields/additional-initializations

* remove test

* replace field names

* update REIMB_ID

* update date columns

* update reimbursement effective dt

* Revert adhoc scripts

* Revert client files

* Update postprocessing_funcs

* revert regex_utils

* Fix valid issue

* UNIT_OF_MEASURE

* REIMB_TERM

* Revert postprocessing funcs tests


Approved-by: Alex Galarce
2025-03-21 18:11:55 +00:00
..

This framework allows flexible serialization and application of crosswalk tables.

Features

  • Create crosswalks from Excel files or dictionaries
  • Save crosswalks as JSON for easy reuse
  • Apply crosswalks with customizable default behavior
  • Metadata tracking for column mappings

Creating a Crosswalk

from crosswalk_utils import CrosswalkBuilder

# From Excel
builder = CrosswalkBuilder()
builder.from_excel(
    path="CROSSWALK_PROVIDER_TYPE.20220106.xlsx",
    sheet_name='Prac',
    from_col="Practitioner Specialty",
    to_col="Taxonomy"
).save('crosswalk_provider_type.json')

# You can also create from a dictionary
builder.from_dict(
    mapping={'Acupuncturist': '171100000X'},
    from_col='Specialty',
    to_col='Taxonomy'
)

Applying a Crosswalk

import json
from crosswalk_utils import apply_crosswalk

# Load the mapping
with open('crosswalk_provider_type.json') as f:
    data = json.load(f)
    
# Apply the crosswalk
result = apply_crosswalk(
    val="Acupuncturist",
    mapping=data['mapping'],
    default=None  # Optional: specify default for unmapped values
)
# Result: '171100000X'

Reversing a Crosswalk

from crosswalk_utils import CrosswalkBuilder
builder = CrosswalkBuilder()
builder.from_json("mappings/crosswalk_program_lob.json").create_reverse_mapping()

# Result: 
# {'Commercial-Group': 'Administrative Services Only (ASO), Third-Party '
#                      'Administrator (TPA), Self-Funded, Employer Funded',
#  'Marketplace-Exchange-Individual & Family': 'Platinum, Gold, Silver, Bronze',
#  'Medicaid': 'Aged, Blind, Disabled (ABD), Childrens Health Insurance Program '
#              '(CHIP), Childrens Health Insurance Program Perinate '
#              '(CHIP-Perinate), Foster Care, Intellectual and Developmental '
#              'Disability (IDD), Temporary Assistance Needy Families (TANF)',
#  'Medicare': 'Medicare Advantage, Supplemental',
#  'Medicare-Medicaid': 'Chronic Condition Special Needs Plan (C-SNP), Dual '
#                       'Eligible Special Needs Plan (D-SNP), Institutional '
#                       'Special Needs Plan (I-SNP), Long-Term Services and '
#                       'Supports (LTSS), Program of All-Inclusive Care for the '
#                       'Elderly (PACE), Special Needs Plan (SNP)'}