Merged in feature/textextraction (pull request #110)

Text Extraction

* bases

* go

* splitting

* structure

* movetoasync

* movetoasync

* settinguptrigger

* reorder

* storevent

* standardisepollingvalidation

* unittests

* fixlint

* fixlint

* awscfg

* generatesample

* followthrough

* tests

* clena

* store

* externalidcleanup

* clientid

* local

* baseunittests

* putobjecttests

* tests
This commit is contained in:
Michael McGuinness
2025-04-02 18:50:03 +00:00
parent e6a4cb3990
commit 81e7223560
226 changed files with 17283 additions and 2744 deletions
+22 -2
View File
@@ -48,15 +48,25 @@ By validating: the client can_sync parameter.
If eligible, send an event to the DOCCLEAN queue.
## docTextProcessRunner
**Listens For**: Body Containing Textract Result Document Metadata
**Action**.
Process textract output.
An event with the document id is pushed to the QUERYSYNC queue.
## docTextRunner
**Listens For**: Body Containing Document ID
**Action**.
If the document text is not already extracted according to the collector standards, the text is extracted.
If the document text is not already extracted according to the collector standards, trigger the textract job for text detection.
An event with the document id is pushed to the QUERYSYNC queue.
Otherwise, add an event to the QUERYSYNC queue.
## metricsExample\_test
@@ -126,4 +136,14 @@ An event with the document id is pushed to the DOCTEXT queue.
Adds an event for each client into the CLIENTSYNC queue for the given query, i.e. each client that contains the query in its dependency tree.
## storeEventRunner
**Listens For**: S3 Event
**Action**.
It will identify the type of event and the location of said event, and forward the task accordingly.
It supports the document initialisation and document text processing stages. Events may be pushed to the DOCINIT and DOCTEXTPROCESS queues.
Generated by Doczy