Merged in feature/textextraction (pull request #110)
Text Extraction * bases * go * splitting * structure * movetoasync * movetoasync * settinguptrigger * reorder * storevent * standardisepollingvalidation * unittests * fixlint * fixlint * awscfg * generatesample * followthrough * tests * clena * store * externalidcleanup * clientid * local * baseunittests * putobjecttests * tests
This commit is contained in:
+22
-2
@@ -48,15 +48,25 @@ By validating: the client can_sync parameter.
|
||||
|
||||
If eligible, send an event to the DOCCLEAN queue.
|
||||
|
||||
## docTextProcessRunner
|
||||
|
||||
**Listens For**: Body Containing Textract Result Document Metadata
|
||||
|
||||
**Action**.
|
||||
|
||||
Process textract output.
|
||||
|
||||
An event with the document id is pushed to the QUERYSYNC queue.
|
||||
|
||||
## docTextRunner
|
||||
|
||||
**Listens For**: Body Containing Document ID
|
||||
|
||||
**Action**.
|
||||
|
||||
If the document text is not already extracted according to the collector standards, the text is extracted.
|
||||
If the document text is not already extracted according to the collector standards, trigger the textract job for text detection.
|
||||
|
||||
An event with the document id is pushed to the QUERYSYNC queue.
|
||||
Otherwise, add an event to the QUERYSYNC queue.
|
||||
|
||||
## metricsExample\_test
|
||||
|
||||
@@ -126,4 +136,14 @@ An event with the document id is pushed to the DOCTEXT queue.
|
||||
|
||||
Adds an event for each client into the CLIENTSYNC queue for the given query, i.e. each client that contains the query in its dependency tree.
|
||||
|
||||
## storeEventRunner
|
||||
|
||||
**Listens For**: S3 Event
|
||||
|
||||
**Action**.
|
||||
|
||||
It will identify the type of event and the location of said event, and forward the task accordingly.
|
||||
|
||||
It supports the document initialisation and document text processing stages. Events may be pushed to the DOCINIT and DOCTEXTPROCESS queues.
|
||||
|
||||
Generated by Doczy
|
||||
|
||||
Reference in New Issue
Block a user