Better visibility and testing functionality for optimizing prompts
* first commit
* Enhance prompts and processing for contract termination dates
- Updated prompt to include 'year to year' as a valid example output.
- Implemented case-insensitive processing for contract text and field keywords for smart chunking.
- Clarified prompt for derived termination date to specify it is exclusive of renewals
* Merge remote-tracking branch 'origin/main' into test/check-doc-dates-against-test-bed
* Update termination date prompt tests
* Refine keywords for contract termination date prompt in investment prompts
* Docs on using the testing notebook
* add 'input_files' option to test_params
* Merge remote-tracking branch 'origin/main' into test/check-doc-dates-against-test-bed
* comment out debug line
* refactor: adjust input_files filtering logic in main function
Approved-by: Katon Minhas
Alex Galarce
a59562950f