64 Commits

Author SHA1 Message Date
Jay Brown 451da3d26d Merged in feature/service-accounts-1 (pull request #227)
Support for service accounts with static credentials

* feature complete

* tests and docs

* lint fix
2026-05-21 19:40:04 +00:00
Jay Brown aafe7d5b5f Merged in feature/batch-status (pull request #215)
Implement and test the batch status feature

* working
2026-03-12 18:53:42 +00:00
Jay Brown c668485e6f Merged in feature/cognito-shared-environments (pull request #211)
cognito and permit shared prod environment support

* code complete

* user creattion tool

test harness
2026-02-26 12:33:35 +00:00
Jay Brown 63c12a2f44 Merged in feature/eula.part1 (pull request #206)
eula support

* eula support

* docs
2026-01-22 18:17:27 +00:00
Jay Brown 35d72fccbe Merged in feature/remove-mocks (pull request #202)
Feature/remove mocks

* remove mocks

* cleanup db migrations
2026-01-15 20:39:32 +00:00
Jay Brown ebf47c6013 Merged in feature/track-filesize (pull request #200)
track file sizes for all documents in system

* feature complete

needs dev testing
2026-01-12 17:46:07 +00:00
Jay Brown a94637ab13 Merged in feature/fix_test_timeouts (pull request #194)
text extractions tests

* increase timeout

for slow ci/cd systems

* add tests
2025-12-04 22:45:15 +00:00
Jay Brown c45e1dd427 Merged in feature/textExtractionsPart1 (pull request #192)
all schema and rest apis for text extraction support

* in progress

* stage 8 complete

* phase 9 completed

* phase 9 complete

* ongoing - s3 path fix

* working

* optimize ci build

* e2e tests

* missing test
2025-11-26 19:23:42 +00:00
Jay Brown 2b43799f56 Merged in feature/admin-api (pull request #191)
admin api and associated tools

* in progress

admin api started and permit.io setup tool started

* docs

* build fix

* integration tests passing

* new permit variables

* fix permit

* fix delete regex

* fix delete response

* docs

* docs
2025-10-23 22:57:15 +00:00
Jay Brown 7638fd3a90 Merged in feature/rate-limiting (pull request #190)
Implement global and per ip rate limiting

* all tests passing

* test fix

* Enhances test environment for rate limiting

Updates the test environment to better support rate limiting tests.

- Increases rate limits in test container to avoid interference with legitimate test traffic.
- Increases the polling interval for client status checks to reduce load on the rate limiter.
- Adds logic to retry status checks if rate limiting is encountered.

* Merge branch 'main' of bitbucket.org:aarete/query-orchestration into feature/rate-limiting

* build fix

* test fix
2025-10-13 22:13:15 +00:00
Jay Brown 720a84be92 Merged in feature/doc_import (pull request #177)
integration of background processor

* integration part 1

* feature working

* fix mimetype issue
2025-08-20 19:01:13 +00:00
jay brown 00a46eb629 fix incremental logic 2025-07-22 11:42:47 -07:00
Jay Brown 2ff6e05ffc Merged in feature/permit-integration-1 (pull request #172)
Permit integration - part 1

* WIP permit integration

* slim down build

* Merge branch 'main' of bitbucket.org:aarete/query-orchestration into feature/permit-integration-1

* omit swagger from auth

* clean build

* comment

* part 1 completed

this is the initial permitio parts and tests without integration. Also testing.md since we have a new test target `task test:permitio`

* feature flag for no jwt validation

* permit integration

* fix ci unit tests

* ci fix

* build fix

* fix home handler

* fix redirect

* test fix

* update docs for auth
2025-07-11 19:27:14 +00:00
Jay Brown 673ba503c8 Merged in feature/minimal-test-parallelism (pull request #173)
Minimal test parallelism

* Minimal test parallelism

to fix issues with ci/cd memory
2025-07-01 17:28:17 +00:00
Michael McGuinness e0d91d17e1 Merged in feature/incrementalfullsuite (pull request #166)
Feature/incrementalfullsuite

* makeincremental

* don

* passfullsuite

* simpler
2025-06-11 12:01:04 +00:00
Michael McGuinness b8302344b4 Merged in feature/ecr (pull request #159)
Test

* tests

* tar

* go

* tmp

* test

* go

* go

* go

* config

* goup

* versioning

* order

* cleanup

* git

* smallopts

* flags

* lessisgood

* go

* order

* ordermatters

* order

* cc

* test
2025-06-02 10:44:45 +00:00
Michael McGuinness 007c32a58d Merged in feature/memory (pull request #155)
Memory Scripts

* tests

* cleanermemtest

* files

* tests
2025-05-26 09:24:38 +00:00
Michael McGuinness e23ada9a8e Merged in bugfix/querytest (pull request #147)
Pass Test Query

* passfullsutie
2025-05-21 11:25:17 +00:00
Michael McGuinness 418a2761b3 Merged in feature/mergecell (pull request #142)
Merged Cell

* mergecellv1

* buildimg

* merging

* addfile

* justmergedcell
2025-05-13 12:33:34 +00:00
Michael McGuinness 125b9e3c31 Merged in feature/splittests (pull request #141)
Always Race and Split Tests

* addrace

* noraceinfull
2025-05-13 08:51:16 +00:00
Michael McGuinness 9dfd867906 Merged in feature/splittests (pull request #140)
Split Tests

* split
2025-05-12 20:54:16 +00:00
Michael McGuinness f5061f53db Merged in feature/timeout (pull request #138)
Remove race conditions from -race in tests

* timeout

* raceconditions

* nobuildgp

* build

* perf
2025-05-12 15:11:50 +00:00
Michael McGuinness b5c30b4af7 Merged in feature/splittest (pull request #137)
Split Slow DB Test

* split
2025-05-09 23:49:02 +00:00
Michael McGuinness e84454b46f Merged in bugfix/toomanythreads (pull request #136)
Too Many Threads

* dropthreads

* assertstatus

* assertstatus
2025-05-06 13:49:49 +00:00
Michael McGuinness efe87321b2 Merged in feature/parallellogqueries (pull request #132)
Testing Tweaks

* parallel

* slowestquery

* split

* cleanup

* health

* dynamiccores

* go

* profile

* timeout

* commitmychanges

* taskfile

* sqlcheckstart

* client

* cost

* ctxtimeout
2025-05-05 09:31:21 +00:00
Michael McGuinness dd2eebf13a Merged in feature/testingopts (pull request #129)
Testing Options and Clean Up

* bitsandbobs

* lint

* healthchecks

* imgintests

* singlegenerate

* testclean

* network

* networkclean

* cmds
2025-05-03 01:16:53 +00:00
Michael McGuinness af361b4a67 Merged in feature/testclean (pull request #126)
Bit of test clean up

* fixes
2025-04-29 17:13:09 +00:00
Michael McGuinness 752fb2e2c0 Merged in feature/chc_1 (pull request #120)
Text Extraction Clean Up + Parallelization

* merged_Call

* directchildren

* bitofimprovements

* go

* parallel

* fixfullsuite

* pondforconcurrency

* comments

* muchdone

* bitsofclean

* stabilisedtests

* snappy

* threadpooltests

* childelements

* testspassed
2025-04-25 17:02:50 +00:00
parity-error e55585bae1 Merge branch 'main' of bitbucket.org:aarete/query-orchestration into feature/cognito 2025-04-24 06:33:17 -07:00
Michael McGuinness d54c823d77 Merged in feature/tableandtests (pull request #119)
Stabilise tests and CNC_1 Sample

* testspeedup

* notyet

* replacebits

* noflake
2025-04-24 13:31:47 +00:00
parity-error 28211710cc Merge branch 'main' of bitbucket.org:aarete/query-orchestration into feature/cognito 2025-04-23 11:04:14 -07:00
Michael McGuinness bbe6f4188e Merged in feature/tests (pull request #117)
Feature/tests

* improvetests

* generation

* simplifiedtesting

* simplifiedtesting

* longfile
2025-04-23 17:51:44 +00:00
jay brown f28561dac6 merge main 2025-04-22 12:09:51 -07:00
jay brown b23b17ac53 auth tests 2025-04-22 10:01:37 -07:00
Michael McGuinness fee71e7740 Merged in feature/postprocessing (pull request #114)
Feature/postprocessing

* tests

* passtest

* fixshorttests

* mosttests

* improvingbasedockerfile

* testspeeds

* testing

* host

* canparallel

* clean

* passfullsuite

* singlepagemax

* test

* findfeatures

* findstables

* tbls

* tablestoo

* tablestoo

* lateraltests

* tableloc

* cleanup

* inlinetable

* childids

* cleanup

* tests
2025-04-22 14:40:16 +00:00
jay brown fa37ba7a92 changes for PR 2025-04-21 15:12:38 -07:00
jay brown a50d935c33 fix tests
add feature flag for Auth
2025-04-14 14:46:28 -07:00
jay brown 7f9618cb14 test coverage 2025-04-14 13:39:13 -07:00
jay brown 94eabf7588 merge main 2025-04-03 14:23:49 -07:00
Michael McGuinness 81e7223560 Merged in feature/textextraction (pull request #110)
Text Extraction

* bases

* go

* splitting

* structure

* movetoasync

* movetoasync

* settinguptrigger

* reorder

* storevent

* standardisepollingvalidation

* unittests

* fixlint

* fixlint

* awscfg

* generatesample

* followthrough

* tests

* clena

* store

* externalidcleanup

* clientid

* local

* baseunittests

* putobjecttests

* tests
2025-04-02 18:50:03 +00:00
jay brown e88d2f4be5 fix tests 2025-03-19 14:54:21 -07:00
Michael McGuinness 62886dbba8 Merged in feature/removejob (pull request #95)
Remove Job

* removejob

* rmjob

* sync

* cleanup

* precommit

* startslow

* startslow

* startslow

* openapi

* clean

* test

* scripts

* littlecleanercmds

* mermaid
2025-03-10 11:03:00 +00:00
Jay Brown 7d78e65d0c Merged in feature/semver (pull request #93)
Add semantic versioning to all services

* working

* Merge branch 'main' of bitbucket.org:aarete/query-orchestration into feature/semver

* 1.24 mod

* go upgrade

* tool

* Merge branch 'main' of bitbucket.org:aarete/query-orchestration into feature/semver
2025-03-06 22:33:39 +00:00
Jay Brown ab28cf30db Merged in feature/common-metrics (pull request #73)
Add common metrics

* add common metrics

and sample for using

* updates

* attempt integration

* wip

* working

stubs generate

* docs

* comments

* Merge branch 'main' of bitbucket.org:aarete/query-orchestration into feature/common-metrics

* runner metrics all

* exclude generated

from the coverage

* fix lint

* refactor metrics

* change .gen filename

* new gen

* Merge branch 'main' of bitbucket.org:aarete/query-orchestration into feature/common-metrics

* docs

* main merge

* refactor

* add to generate

* merge main
2025-03-05 16:59:01 +00:00
Michael McGuinness d91ef1832b Merged in feature/functestcov (pull request #84)
Function Test Coverage

* test

* scripts
2025-03-04 15:51:03 +00:00
Michael McGuinness c1e9d93037 Merged in feature/jobsync (pull request #63)
Document Sync and Job Sync

* docsyncfunc

* startedQueryWork

* morefixes

* jobsyncsvcstart

* save

* jobsynctext

* save

* save

* docsync

* shorttest

* jobsync

* jobsyncupdateoncollectorupdate

* passlivetest

* collectortest

* lint
2025-02-12 19:00:25 +00:00
Michael McGuinness 9e6328d8f9 Merged in feature/localstackclean (pull request #53)
Clean Up Compose, Tasks, Fullsuite

* splitfiles
2025-02-05 22:45:32 +00:00
Michael McGuinness 92334ad1dd Merged in feature/s3integration (pull request #47)
Set Up S3 integration

* cfginterfaceandfirsts3funcs

* addlocalstack

* generallypassesfullsuite

* addedmultipleattemptedpings

* cleanup

* stabiliseplusskip
2025-02-05 12:52:41 +00:00
Michael McGuinness 7001ca854c Merged in feature/docinitialisation (pull request #41)
Queuing Changes and Cfg Testing

* staarting

* staarting

* startedpush

* note

* save

* mocking

* removederrs

* fixtests

* cleanuperrs

* newenvsetup

* preppingtests

* queue

* mmovetocfgpassunittests

* sortoutconfig

* passinginteg

* deps

* fixtests
2025-02-03 17:30:50 +00:00
Michael McGuinness 4ec1d51a12 Merged in feature/jobcrud (pull request #35)
Job CRUD + Collector Integration

* startedcreate

* openapispec

* createjobintegration

* jobgetcontroller

* jobcreateclient

* updatejob

* job

* collector
2025-01-24 14:52:56 +00:00