Files
doczyai-pipelines/fieldExtraction/crosswalk
VenkataKrishna Reddy Avula a5f54a2a48 Merged in feature/daip2-17 (pull request #362)
Feature/daip2- 17 - Aarete derived field values and crosswalk mapping

* fix pipeline error

* fix pipeline error

* fix pipeline error

* fix pipeline error

* fix pipeline error

* Update fieldSet unit test

* Update test_from_values

* Fix circular import

* Added NLTK

* Add NLTK to path

* Update gitignore

* included txt files for nltk_data

* move nltk_data to src

* Fix last upload count

* Last upload count bugfix

* Fixed B processing

* Remove client-specific postprocessing

* split consolidate_output

* aarete derived AC fields mapping

* chnages reverted

* AC Croasswalk Mapping

* Merge branch 'main' into feature/daip2-17

* Update poetry.lock

* Add init for crosswalk

* Complete paths


Approved-by: Alex Galarce
2025-01-27 21:27:15 +00:00
..

This framework allows flexible serialization and application of crosswalk tables.

Features

  • Create crosswalks from Excel files or dictionaries
  • Save crosswalks as JSON for easy reuse
  • Apply crosswalks with customizable default behavior
  • Metadata tracking for column mappings

Creating a Crosswalk

from crosswalk_utils import CrosswalkBuilder

# From Excel
builder = CrosswalkBuilder()
builder.from_excel(
    path="CROSSWALK_PROVIDER_TYPE.20220106.xlsx",
    sheet_name='Prac',
    from_col="Practitioner Specialty",
    to_col="Taxonomy"
).save('crosswalk_provider_type.json')

# You can also create from a dictionary
builder.from_dict(
    mapping={'Acupuncturist': '171100000X'},
    from_col='Specialty',
    to_col='Taxonomy'
)

Applying a Crosswalk

import json
from crosswalk_utils import apply_crosswalk

# Load the mapping
with open('crosswalk_provider_type.json') as f:
    data = json.load(f)
    
# Apply the crosswalk
result = apply_crosswalk(
    val="Acupuncturist",
    mapping=data['mapping'],
    default=None  # Optional: specify default for unmapped values
)
# Result: '171100000X'

Reversing a Crosswalk

from crosswalk_utils import CrosswalkBuilder
builder = CrosswalkBuilder()
builder.from_json("mappings/crosswalk_program_lob.json").create_reverse_mapping()

# Result: 
# {'Commercial-Group': 'Administrative Services Only (ASO), Third-Party '
#                      'Administrator (TPA), Self-Funded, Employer Funded',
#  'Marketplace-Exchange-Individual & Family': 'Platinum, Gold, Silver, Bronze',
#  'Medicaid': 'Aged, Blind, Disabled (ABD), Childrens Health Insurance Program '
#              '(CHIP), Childrens Health Insurance Program Perinate '
#              '(CHIP-Perinate), Foster Care, Intellectual and Developmental '
#              'Disability (IDD), Temporary Assistance Needy Families (TANF)',
#  'Medicare': 'Medicare Advantage, Supplemental',
#  'Medicare-Medicaid': 'Chronic Condition Special Needs Plan (C-SNP), Dual '
#                       'Eligible Special Needs Plan (D-SNP), Institutional '
#                       'Special Needs Plan (I-SNP), Long-Term Services and '
#                       'Supports (LTSS), Program of All-Inclusive Care for the '
#                       'Elderly (PACE), Special Needs Plan (SNP)'}