Commit Graph

80 Commits

Author SHA1 Message Date
Michael McGuinness 752fb2e2c0 Merged in feature/chc_1 (pull request #120)
Text Extraction Clean Up + Parallelization

* merged_Call

* directchildren

* bitofimprovements

* go

* parallel

* fixfullsuite

* pondforconcurrency

* comments

* muchdone

* bitsofclean

* stabilisedtests

* snappy

* threadpooltests

* childelements

* testspassed
2025-04-25 17:02:50 +00:00
parity-error 28211710cc Merge branch 'main' of bitbucket.org:aarete/query-orchestration into feature/cognito 2025-04-23 11:04:14 -07:00
Michael McGuinness 47fec079e5 Merged in feature/demo (pull request #116)
Demo prep + Fix client sync

* firstversion

* clientsync

* configlint

* fixtests
2025-04-22 19:57:35 +00:00
jay brown f28561dac6 merge main 2025-04-22 12:09:51 -07:00
Michael McGuinness fee71e7740 Merged in feature/postprocessing (pull request #114)
Feature/postprocessing

* tests

* passtest

* fixshorttests

* mosttests

* improvingbasedockerfile

* testspeeds

* testing

* host

* canparallel

* clean

* passfullsuite

* singlepagemax

* test

* findfeatures

* findstables

* tbls

* tablestoo

* tablestoo

* lateraltests

* tableloc

* cleanup

* inlinetable

* childids

* cleanup

* tests
2025-04-22 14:40:16 +00:00
jay brown fa37ba7a92 changes for PR 2025-04-21 15:12:38 -07:00
jay brown c229fb5a13 pr fixes part 1 2025-04-17 11:53:26 -07:00
jay brown bf98a0971f auth fixes
middleware handles logout
2025-04-15 12:04:54 -07:00
parity-error 1bbfa95a40 Merge branch 'main' of bitbucket.org:aarete/query-orchestration into feature/cognito 2025-04-15 05:37:38 -07:00
Michael McGuinness edc50c7510 Merged in feature/part (pull request #113)
Size Import Parts

* parts

* think

* workingpart

* textout
2025-04-08 12:44:09 +00:00
jay brown 73709878d9 openapi changes 2025-04-07 14:10:39 -07:00
Michael McGuinness 60812aba91 Merged in feature/richname (pull request #112)
Standardised rich name for Files

* tests
2025-04-03 19:17:24 +00:00
Michael McGuinness 1d49313a9f Merged in feature/standardisefilepath (pull request #111)
Feature/standardisefilepath

* baseprocessing

* generalstructure
2025-04-03 12:13:16 +00:00
Michael McGuinness 81e7223560 Merged in feature/textextraction (pull request #110)
Text Extraction

* bases

* go

* splitting

* structure

* movetoasync

* movetoasync

* settinguptrigger

* reorder

* storevent

* standardisepollingvalidation

* unittests

* fixlint

* fixlint

* awscfg

* generatesample

* followthrough

* tests

* clena

* store

* externalidcleanup

* clientid

* local

* baseunittests

* putobjecttests

* tests
2025-04-02 18:50:03 +00:00
Michael McGuinness 53ea7d34e6 Merged in feature/textextract (pull request #108)
Start adding Textract + UUID changes

* base

* startclient

* ts

* short

* tests
2025-03-20 11:06:41 +00:00
Michael McGuinness 1587da9d11 Merged in bugfix/tests (pull request #107)
Fix Fullsuite

* save

* foundthefix..

* codeandrequire
2025-03-19 11:54:14 +00:00
Michael McGuinness 3dd0c718cd Merged in feature/openapifixes (pull request #106)
OpenAPI Middleware & Fixes

* updates
2025-03-18 13:06:42 +00:00
Michael McGuinness 555b6d420b Merged in feature/docresult (pull request #105)
Document Result Endpoint

* testing

* cleantesting

* progress

* query

* lint

* readme

* dockerclient

* api

* passtest

* tests

* test
2025-03-17 18:14:15 +00:00
Michael McGuinness d60eb9b16b Merged in feature/openapiowasp (pull request #101)
Remove OWASP Errors

* started

* somewarns

* somewarns

* gen
2025-03-12 00:59:58 +00:00
Michael McGuinness bbd86fb4ea Merged in feature/CollectorBuildVersion (pull request #100)
Collector Build Version

* lint

* fixtests
2025-03-11 18:15:49 +00:00
Michael McGuinness 6648cdf1cb Merged in feature/clientexternalid (pull request #99)
Client External ID

* normalizeexternalid

* cleanopenapi

* cleanopenapi

* changingpublic

* noprecommit

* testing

* precommit

* processtest

* nodb

* tests

* tests
2025-03-11 16:31:06 +00:00
Michael McGuinness ed8cfbbee4 Merged in feature/collectorset (pull request #96)
Set Collector

* set
2025-03-10 13:00:57 +00:00
Michael McGuinness 62886dbba8 Merged in feature/removejob (pull request #95)
Remove Job

* removejob

* rmjob

* sync

* cleanup

* precommit

* startslow

* startslow

* startslow

* openapi

* clean

* test

* scripts

* littlecleanercmds

* mermaid
2025-03-10 11:03:00 +00:00
Michael McGuinness 8f409e60a8 Merged in bugfix/errhandling (pull request #89)
Error handling

* basic
2025-03-05 19:49:03 +00:00
Michael McGuinness c78ca26a6f Merged in feature/export (pull request #91)
export

* export
2025-03-05 19:37:06 +00:00
Michael McGuinness 0815cb35fb Merged in feature/lint (pull request #87)
Basic Lint Checks

* basic
2025-03-05 12:05:46 +00:00
Michael McGuinness 1232ed528f Merged in feature/simplifystatus (pull request #86)
Simplify Statuses

* simple
2025-03-04 16:44:18 +00:00
Michael McGuinness a07037b018 Merged in feature/jobstatusendpoint (pull request #85)
Job Status Endpoint

* edpoint
2025-03-04 16:20:54 +00:00
Michael McGuinness d91ef1832b Merged in feature/functestcov (pull request #84)
Function Test Coverage

* test

* scripts
2025-03-04 15:51:03 +00:00
Michael McGuinness 2061543fc9 Merged in feature/newclean (pull request #81)
Same Clean Output

* bitoftesting

* cleantest
2025-03-03 21:56:17 +00:00
Michael McGuinness f11f4def43 Merged in feature/clean (pull request #76)
Clean Set Up

* fail

* starteddb

* constraint

* cleantest

* fixqueries

* fixtests

* storemimetype

* buffer

* tests

* setup

* passingtests

* pdfHElloWorld

* rm

* test

* notodos

* tests

* clean

* testpdf
2025-02-28 13:11:53 +00:00
Michael McGuinness 08d2296717 Merged in feature/e2etest (pull request #74)
Feature/e2etest

* e2etest

* testcleanups
2025-02-21 17:05:37 +00:00
Michael McGuinness 3d434eedb8 Merged in feature/jobsynced (pull request #72)
Job Status Get and DB tidy up

* initalquery

* tests

* shorttests

* testing queries

* job

* solvedthequery

* updatingdb

* fixingtests

* repotests

* shorttests

* docker

* testspassed
2025-02-20 19:02:44 +00:00
Michael McGuinness 4bbc24e8aa Merged in feature/codeversions (pull request #69)
Code Versions

* split

* latestVersion

* test

* config

* codeversions
2025-02-17 14:30:37 +00:00
Michael McGuinness 806c0f74eb Merged in feature/collectorversions (pull request #68)
Strict Collector Versions

* version
2025-02-17 11:44:51 +00:00
Michael McGuinness 750abe1be3 Merged in feature/entitylogs (pull request #67)
Query Version Update
2025-02-14 18:43:26 +00:00
Michael McGuinness 0df3d16976 Merged in feature/testwithlogs (pull request #65)
Query Version Sync Runner

* testing

* queryversiosyncworking

* update

* tests

* fixtests
2025-02-14 10:56:24 +00:00
Jay Brown 477518e5eb Merged in feature/prometheus (pull request #52)
API instrumentation - metrics and logging

* api instrumentation

prometheus metrics and logging for all routes

* Merge branch 'main' of bitbucket.org:aarete/query-orchestration into feature/prometheus

* add log_level

and sync the config initialize

* docs

* cleanup

* add to compose:up:test

* docs for prometheus testing

* custom metrics

* cleanup

* merge main

* add tests

* cleanup docs

* cleanup

* lint

* fix unit tests (attempt)

* fix tests

* resolvesetlogger

* expose 8080

* compose changes

* bugfixesformichael

* don't build _test

* merge in main

* job_sync_runner
2025-02-13 15:44:08 +00:00
Michael McGuinness c1e9d93037 Merged in feature/jobsync (pull request #63)
Document Sync and Job Sync

* docsyncfunc

* startedQueryWork

* morefixes

* jobsyncsvcstart

* save

* jobsynctext

* save

* save

* docsync

* shorttest

* jobsync

* jobsyncupdateoncollectorupdate

* passlivetest

* collectortest

* lint
2025-02-12 19:00:25 +00:00
Michael McGuinness 71f9802e1a Merged in feature/splitqueryrunning (pull request #57)
Split Query Running + Debugging Full Flow

* completedquerysyncrunner

* spliitinglogic

* synccomplete

* informdependents

* only push same collector

* deps

* livetesting

* foundissue

* some issues resolved

* activeupdate

* collectorupdatefixes

* fix dbquesries

* tests

* tests

* pollingdebug
2025-02-11 15:22:59 +00:00
Michael McGuinness 24a038ec3d Merged in feature/doctextstructure (pull request #56)
DocTextRunner Structure

* firstround

* shorttests
2025-02-07 14:15:06 +00:00
Michael McGuinness 90353d8161 Merged in feature/docclean (pull request #55)
Doc Clean Structure

* outline

* isdocclean

* placeholder for clean log

* versionplustesting

* versionplustesting

* testspassed
2025-02-07 12:12:51 +00:00
Michael McGuinness e146725825 Merged in feature/localstackands3object (pull request #54)
LocalStack and S3 Objects

* firstround

* cleanupintegration

* tidyports
2025-02-06 15:00:26 +00:00
Michael McGuinness 5c253b3592 Merged in feature/docinit (pull request #48)
Feature/docinit

* createunittests

* cleanup

* skip

* cleanup
2025-02-05 17:44:01 +00:00
Michael McGuinness e51afedf32 Merged in feature/openapilint (pull request #42)
Add OpenAPI linting

* removeerrs

* removeerrs
2025-02-03 17:45:00 +00:00
Michael McGuinness 7001ca854c Merged in feature/docinitialisation (pull request #41)
Queuing Changes and Cfg Testing

* staarting

* staarting

* startedpush

* note

* save

* mocking

* removederrs

* fixtests

* cleanuperrs

* newenvsetup

* preppingtests

* queue

* mmovetocfgpassunittests

* sortoutconfig

* passinginteg

* deps

* fixtests
2025-02-03 17:30:50 +00:00
Jay Brown 15adaebfcd Merged in feature/serviceconfig-integration (pull request #38)
DRAFT PR : WIP working through ideas for integration

* movearound

* attempttwo

* openapi

* further sanding

* fix

* start on tests

* runthroughsingleconfig

* somechanges

* reflectissue

* removeerrs

* mostlyremovepanic

* removeenv

* noncfgtests

* go

* repo

* fix service config test

* add PWD to all

* test fix

* fix lint

* todo for later

* passingunittests

* alltests

* testlogger

* testloggername

* clean
2025-01-31 13:43:55 +00:00
Michael McGuinness 058f8dba7f Merged in feature/logVersioning (pull request #40)
Can Sync Versioning

* started

* client

* jobcansync

* tests
2025-01-29 16:26:11 +00:00
Michael McGuinness 0ac5ff9e15 Merged in feature/testquery (pull request #39)
Test Query

* depstextandclean

* startedcleaningresult

* resulttidyup

* roundone

* cleaning

* unsyncedquery

* startedtestsandsimplification

* api

* querytests

* resultprocessortests

* unittests

* cleanup
2025-01-29 11:52:37 +00:00
Michael McGuinness b16ff55afa Merged in feature/document (pull request #36)
Document CRUD

* doccreate

* dochashlocandget

* depsandtodo
2025-01-24 16:12:25 +00:00