Files
doczyai-pipelines/fieldExtraction
Alex Galarce 6bc345ef9e Merged in tin-npi-acc-testing (pull request #516)
Update testbed data sources and enhance metric calculations for blank fields

* Update testbed data sources and enhance metric calculations for blank fields

* Add order-independent provider analysis

* add tin-npi normalization and verbose

* Enhance provider field evaluation by excluding "UNKNOWN" and "NO_IDENTIFIERS_FOUND" values

* List-based method

* Enhance provider field evaluation by incorporating frequency-based metrics and excluding "UNKNOWN" values

* Fix splits

* fix headers

* fix comma splitting

* Merged main into tin-npi-acc-testing

* Merged main into tin-npi-acc-testing

* Refine provider metrics logging to exclude empty predicted values

* Merge branch 'tin-npi-acc-testing' of https://bitbucket.org/aarete/doczy.ai into tin-npi-acc-testing

* Merged main into tin-npi-acc-testing

* last commit before changing back to sets

* Refactor evaluation metrics calculation to use set operations (while still displaying counters for info)

* Merge branch 'tin-npi-acc-testing' of https://bitbucket.org/aarete/doczy.ai into tin-npi-acc-testing


Approved-by: Katon Minhas
2025-05-12 18:23:50 +00:00
..

Field Extraction

Running the Code

This project uses Python's module system for imports. To run the code properly:

  1. DO NOT run files directly like this:

    python src/client/main.py  # ❌ This won't work
    
  2. INSTEAD, use Python's module flag (-m) from the project root:

    python -m src.client.main  # ✅ This is correct
    

Why?

The code uses absolute imports (e.g., from src.utils import llm_utils) to maintain a clear and consistent package structure. Running with python -m ensures Python can properly resolve these imports.

Development

  • All imports should use the src. prefix (e.g., from src.utils import llm_utils)
  • Always run code from the project root directory using the -m flag
  • Tests are configured to handle these imports automatically via pytest settings in pyproject.toml

Configuration

The project uses poetry for dependency management and pytest for testing. Key configurations in pyproject.toml:

[tool.pytest.ini_options]
pythonpath=["."]
testpaths = [
    "tests"
]

Dependencies

To install dependencies:

poetry install

To run tests:

poetry run pytest

To run type checking:

poetry run mypy .