Commit Graph

1114 Commits

Author SHA1 Message Date
Michael McGuinness 5928ee0116 Merged in feature/add-dotenv (pull request #266)
Feature/add dotenv

* transferred sensitive information to .env file from src/config.py

* replace model IDs, AWS account info

* Merge remote-tracking branch 'origin/main' into feature/add-dotenv

* add explanatory comment

* Merge remote-tracking branch 'origin/main' into feature/add-dotenv

* remove tests that were just for local


Approved-by: Katon Minhas
2024-11-14 16:35:33 +00:00
Karan Desai dfff68e9c8 Merged in bugfix/clean_full_context_in_smart_chunking (pull request #269)
Bugfix/clean full context in smart chunking

* move full context bugfix to clean branch

* took out commented code

* black formating

* Add explanatory comments to file_processing.py

Approved-by: Alex Galarce
2024-11-13 21:33:17 +00:00
Alex Galarce 001c2e45b5 Merged in hotfix/plan_state (pull request #267)
plan state hotfix

* updated state_check function

* added a wrapper function apply_state_check_to_df function to enable state_check function to work with dataframe and also wrote unit tests for both the functions.

* Merged main into hotfix/plan_state

* append extra column with new health plan state corrected

* Merge remote-tracking branch 'refs/remotes/origin/hotfix/plan_state' into hotfix/plan_state

* fix tests

* move apply_state_check_to_df() to cnc_hotfix.py

* move all functionality out of utils and into cnc_hotfix.py

* Merge remote-tracking branch 'origin/main' into hotfix/plan_state

* remove duplicated pythonpath in pyproject.toml

* format cnc_hotfix.py

* changed to use valid.STATE_MAP to not duplicate functionality


Approved-by: Katon Minhas
2024-11-13 20:12:40 +00:00
Karan Desai 1098be5cf5 Merged in feature_ac_chunking_clean (pull request #265)
grouped keywords and IRS regex chunking

* abandon old branch and rebuild

* removed print for field names, prompts

* pushing as part of  leftovers

* IRS regex chunking

* Merged in feature/chunk_term_clean (pull request #262)

chunk_log_added

* chunk_log_added

* Merge remote-tracking branch 'remotes/origin/feature_ac_chunking_clean' into feature/chunk_term_clean


Approved-by: Alex Galarce

* added function for regex based IRS chunking

* shifted regex_match_chunk function to utils

* added helper functions for regex based chunking

* replaced tin_regex function to ac_funcs

* removed prompt for irs_others

* added regex chunking for irs

* removed irs group from smart chunking

* testing functionality for regex based irs fields

* updated return N/A condition

* Merged main into feature_ac_chunking_clean

* file_processing.py edited online with Bitbucket
* added back conditional prompts

* minor fixed for PR

* remove install types

* mering clean branch

* with passed test casses

* added flag for regex based tin execution


Approved-by: Michael McGuinness
2024-11-13 17:08:19 +00:00
Katon Minhas 8c6867800a Merged in feature/outputSplit (pull request #263)
Add split_and_write_csv function to utils

* Add split_and_write_csv function to utils

* Merge branch 'main' into feature/outputSplit


Approved-by: Alex Galarce
2024-11-11 19:45:07 +00:00
Katon Minhas 39219d0cea Merged in hotfix/filterFalse (pull request #260)
Fix input_dict_ac issue when filter=False

* Fix input_dict_ac issue when filter=False

* Update comments


Approved-by: Alex Galarce
2024-11-06 16:44:41 +00:00
Michael McGuinness 4989dcbbf7 Merged in bugfix/rmsrc (pull request #259)
Remove src

* rm


Approved-by: Alex Galarce
Approved-by: Katon Minhas
2024-11-04 23:23:32 +00:00
Katon Minhas bb279b45fd Merged in cnc_fl_main (pull request #258)
Cnc fl main

* prov type moved

* comment out invalid prov2 bc it's overly restrictive

* Update prompt template to ensure N/A rather than blanks

* Update AC multi-prompt template. Update prompts to ensure all keys are present and N/As are filled

* Update AC postprocessing

* Update clean_tin() to add N/A for values other than 10 digits

* update tin postprocessing

* Update npi postprocessing

* Add 'Filename:' to the start of all filenames

* Update group TIN/NPI postprocessing

* Update parent agreement code

* fix health plan state mapping

* Update B postprocessing

* Updated indicators, re-ordering

* Update postprocessing - all columns included and reordered

* Ensure Pages is included in AC-only output

* Remove excess print statements

* remove example_test to pass pipeline

* Fix parent agreement code for AC

* Updated postprocessing for NPI/TIN other

* Update prompts for N explicitely on AC prompt-based indicators

* Updated main and utils for more intuitive filtering

* Updated file_counting to match new main process

* update test

* Add example_test


Approved-by: Michael McGuinness
2024-11-04 22:54:31 +00:00
Alex Galarce de41567da0 Merged in feature/reformat_jenkins_output (pull request #256)
DRAFT: reformat jenkins output

* dockerfile

* noreadme

* Merged main into feature/fieldExtractionDockerfile

* allow output bucket to be changed, change formatting of prefixes

* Merged main into feature/reformat_jenkins_output

* check if bucket exists and throw error if not

* only check bucket if writing to s3

* Merge remote-tracking branch 'refs/remotes/origin/feature/reformat_jenkins_output' into feature/reformat_jenkins_output

* remove circular import


Approved-by: Michael McGuinness
2024-11-01 18:52:15 +00:00
Michael McGuinness 8860a78436 Merged in feature/fieldExtractionDockerfile (pull request #254)
Create Dockerfile

* dockerfile

* noreadme

* Merged main into feature/fieldExtractionDockerfile


Approved-by: Alex Galarce
2024-11-01 13:44:32 +00:00
Alex Galarce 218cafd274 Merged in feature/write-to-s3 (pull request #255)
write to S3, quick and dirty

* write to S3, quick and dirty


Approved-by: Michael McGuinness
2024-10-31 15:36:55 +00:00
Alex Galarce 95636ae307 Merged in bugfix/create_output_consolidated (pull request #250)
create output_consolidated if it doesn't exist

* create output_consolidated if it doesn't exist

* Merged main into bugfix/create_output_consolidated


Approved-by: Michael McGuinness
Approved-by: Faizan Mohiuddin
2024-10-29 16:43:25 +00:00
Michael McGuinness 533ddc38a9 Merged in bugfix/actualPipes (pull request #251)
Bugfix/actualPipes

* actual

* actual


Approved-by: Alex Galarce
2024-10-29 15:45:48 +00:00
Michael McGuinness ee3e3eb538 Merged in feature/mergeIntoMain (pull request #249)
Merge Prep

* mergePRep


Approved-by: Katon Minhas
2024-10-28 23:39:36 +00:00
Michael McGuinness acef40ee19 Merged in festure/removefieldExtraction (pull request #247)
Remove Field Extraction

* rmfieldExtraction


Approved-by: Katon Minhas
2024-10-28 22:15:57 +00:00
Michael McGuinness 7cb0b485ad Merged in feature/unittestframe (pull request #240)
Unit Testing Framework

* emptyframe

* fixstatic

* save

* exampletest

* rmreqs

* rmUto


Approved-by: Alex Galarce
2024-10-22 13:45:53 +00:00
Michael McGuinness 815fa7f0bc Merged in feature/poetry (pull request #238)
Draft: Adding Poetry

* addpoetry

* pipes

* mypy

* streamlit

* searchforchange


Approved-by: Alex Galarce
2024-10-15 16:20:27 +00:00
Michael McGuinness 168d197349 Merged in feature/lightStaticTypes (pull request #234)
Add static type check

* artifacts

* dockerfileforall

* examplemypystep

* reqs

* baseMain

* oneperservice

* somebasicchanges

* deps

* removedeps

* removeerrs

* singlecommand

* lessargs

* 312base

* versionanderr

* pythonversion

* ithinkfinalerrs

* numpyv

* versionsandconditional

* changesets

* tryagain

* lint

* numpyagain

* init

* clearstreamlit

* forcestreamlit


Approved-by: Umang Mistry
2024-10-11 15:26:16 +00:00
Michael McGuinness 38366dadeb Merged in feature/dockerImages (pull request #189)
Lambda Function using Docker

* baseImage

* testfindlamdafunctions

* fixstep

* yamlsyntax

* servicestructure

* nameplacement

* testdockerbuild

* definecaches

* onelinebash

* uniquecaches

* listsyntax

* cachebasedir

* resetcaches

* cachebycommit

* artifacts

* dockerfileforall

* removePipe


Approved-by: Umang Mistry
2024-10-11 14:14:15 +00:00
Michael McGuinness edd4fe61ba Merged in feature/addReqs (pull request #233)
Add Requirements.txt

* requirements


Approved-by: Alex Galarce
2024-10-10 16:44:16 +00:00
Michael McGuinness 20b01d442c Merged in feature/dryRuns (pull request #232)
Add dry runs

* adddryruns

* status


Approved-by: Umang Mistry
2024-10-09 14:03:16 +00:00
Michael McGuinness 4fa9ee74c4 Merged in feature/removePlanningPreProd (pull request #230)
Remove PreUAT

Approved-by: Umang Mistry
2024-10-07 17:22:11 +00:00
Michael McGuinness 8cee69372b keepUATplan 2024-10-07 18:04:17 +01:00
Michael McGuinness 550bfcc0ed changes 2024-10-07 18:02:57 +01:00
Michael McGuinness a58bf71bd1 Merged in bugfix/syncConfig (pull request #229)
Sync Config

Approved-by: Umang Mistry
2024-10-07 16:29:28 +00:00
Michael McGuinness 2ca5fa5f4c removedeploy 2024-10-07 17:27:37 +01:00
Michael McGuinness 9dfccfa3db location 2024-10-07 17:21:20 +01:00
Michael McGuinness 64ffdcfcbf removedev 2024-10-07 17:06:54 +01:00
Michael McGuinness cc8e268c98 namereplace 2024-10-07 17:03:20 +01:00
Michael McGuinness 479a877973 syntax 2024-10-07 16:58:45 +01:00
Michael McGuinness 7f952c0a2c allowDeploy 2024-10-07 16:57:55 +01:00
Michael McGuinness 59934af0c9 useterra 2024-10-07 16:55:47 +01:00
Michael McGuinness d0b785d0bb Merged in bugfix/testprod (pull request #227)
testprod

Approved-by: Umang Mistry
2024-10-04 15:48:36 +00:00
Michael McGuinness fb8f242387 testprod 2024-10-04 16:45:10 +01:00
Michael McGuinness 935adfec95 Merged in feature/prodpreuat (pull request #226)
Feature/prodpreuat

Approved-by: Umang Mistry
2024-10-04 15:39:43 +00:00
Michael McGuinness d5d5866a9e plan 2024-10-04 16:38:59 +01:00
Michael McGuinness 1c8ab82793 Merged in feature/prodpreuat (pull request #225)
Prod Pre UAT

* merge


Approved-by: Umang Mistry
2024-10-04 15:33:17 +00:00
Michael McGuinness b5d400dfe2 Merged in bugfix/deployConfigProperties (pull request #224)
Bugfix/deployConfigProperties

* syncconfig

* copydir

* specbucket

* pipplusdevdeploy

* struct

* script

* image

* cleanup

* testplan

* addallplans

* stepnames
2024-10-04 15:26:57 +00:00
Michael McGuinness fa5e80c8cd Merged in feature/applyBeforeDeploy (pull request #223)
Apply Before Deploy

* firstround

* rerun


Approved-by: Umang Mistry
2024-10-04 12:13:41 +00:00
Michael McGuinness 938a5329e9 Merged in bugfix/pipeline (pull request #219)
Bugfix/pipeline

Approved-by: Umang Mistry
2024-09-30 15:27:02 +00:00
Michael McGuinness 4abcd2dd16 onlydeployfrommain 2024-09-30 16:26:01 +01:00
Michael McGuinness dccadf980f clean 2024-09-30 16:26:01 +01:00
Michael McGuinness 1b4759a6a1 validateloc 2024-09-30 16:26:01 +01:00
Michael McGuinness 14139df124 pipelineorder 2024-09-30 16:26:01 +01:00
Michael McGuinness cc99ab10f3 addsessionname 2024-09-30 16:26:01 +01:00
Michael McGuinness 150aa0b4b3 envvars 2024-09-30 16:26:01 +01:00
Michael McGuinness c2300a7c35 awslogin 2024-09-30 16:26:01 +01:00
Michael McGuinness 34e9e40605 stagingtouat 2024-09-30 16:26:01 +01:00
Michael McGuinness 5952f8f185 isolatesteps 2024-09-30 16:26:01 +01:00
Michael McGuinness bb5b010cde isolatesteps 2024-09-30 16:26:01 +01:00