Commit Graph

96 Commits

Author SHA1 Message Date
Jay Brown 7638fd3a90 Merged in feature/rate-limiting (pull request #190)
Implement global and per ip rate limiting

* all tests passing

* test fix

* Enhances test environment for rate limiting

Updates the test environment to better support rate limiting tests.

- Increases rate limits in test container to avoid interference with legitimate test traffic.
- Increases the polling interval for client status checks to reduce load on the rate limiter.
- Adds logic to retry status checks if rate limiting is encountered.

* Merge branch 'main' of bitbucket.org:aarete/query-orchestration into feature/rate-limiting

* build fix

* test fix
2025-10-13 22:13:15 +00:00
Jay Brown a6e081e5cd Merged in feature/log-version (pull request #185)
inject and print version at startup for all services

* inject and print version

* coverage
2025-09-18 21:06:21 +00:00
Jay Brown 8a13b6d3b1 Merged in feature/aws-config-fix3 (pull request #184)
Make AWS variables optional

* comment

* aws vars optional
2025-09-17 18:12:51 +00:00
Jay Brown 720a84be92 Merged in feature/doc_import (pull request #177)
integration of background processor

* integration part 1

* feature working

* fix mimetype issue
2025-08-20 19:01:13 +00:00
jay brown fa41884e84 package docs 2025-07-23 09:47:01 -07:00
Jay Brown 2ff6e05ffc Merged in feature/permit-integration-1 (pull request #172)
Permit integration - part 1

* WIP permit integration

* slim down build

* Merge branch 'main' of bitbucket.org:aarete/query-orchestration into feature/permit-integration-1

* omit swagger from auth

* clean build

* comment

* part 1 completed

this is the initial permitio parts and tests without integration. Also testing.md since we have a new test target `task test:permitio`

* feature flag for no jwt validation

* permit integration

* fix ci unit tests

* ci fix

* build fix

* fix home handler

* fix redirect

* test fix

* update docs for auth
2025-07-11 19:27:14 +00:00
Michael McGuinness 3028fe7eaa Merged in feature/linting (pull request #168)
Linting Updates

* precommit

* smallerchecks

* govuln
2025-06-23 15:58:20 +00:00
Michael McGuinness 693457ce2d Merged in feature/movefromtrigger (pull request #164)
Single Text Queue

* notrigger
2025-06-10 12:57:30 +00:00
Michael McGuinness 76e4f5790f Merged in feature/health (pull request #163)
Health Endpoint

* health
2025-06-09 23:30:06 +00:00
Michael McGuinness 7ce7c9df4d Merged in feature/ecr (pull request #161)
Feature/ecr

* nosave

* repo

* awscli

* unzip

* ignore

* moreram

* 14k

* ref

* deployment

* 12k

* uselocal

* go

* dockercomd

* reorder

* iamgename

* installs

* tart

* cli

* clideps

* y

* dockerce

* nodock

* multi

* rmecr

* dev
2025-06-03 13:52:10 +00:00
Michael McGuinness b8302344b4 Merged in feature/ecr (pull request #159)
Test

* tests

* tar

* go

* tmp

* test

* go

* go

* go

* config

* goup

* versioning

* order

* cleanup

* git

* smallopts

* flags

* lessisgood

* go

* order

* ordermatters

* order

* cc

* test
2025-06-02 10:44:45 +00:00
Michael McGuinness cc2278086f Merged in feature/import (pull request #157)
Feature/import

* importstart

* pp

* tests

* importtests

* 100GB

* lint

* passtests

* utc

* awsprofile

* doublequotes

* host
2025-05-27 15:28:46 +00:00
Michael McGuinness b2cfeb3078 Merged in feature/lessmocks (pull request #151)
Less Mocks

* lessmocks
2025-05-23 10:10:48 +00:00
Michael McGuinness 33d68b7e04 Merged in feature/momocks (pull request #150)
Decrease Mocks

* feature/nomocks

* nonet

* assertsaws

* assert
2025-05-23 00:20:01 +00:00
Michael McGuinness 731b68e4af Merged in bugfix/pathstandard (pull request #146)
Change Path Separator

* clientid
2025-05-20 17:00:50 +00:00
Michael McGuinness 61d12bf8df Merged in feature/checkbox (pull request #145)
Checkbox Primary Edge Cases

* hascheckboxlogic

* gen

* preppinggen

* exploringcheckbox

* removeunselected

* tests

* failingtest

* failintests

* nomockqueryapi

* db

* name

* nocontainer

* deleterow

* cnc

* extradocsandupdatetextracts

* moretables

* appndedtables

* baseversion
2025-05-20 12:47:22 +00:00
Michael McGuinness f5061f53db Merged in feature/timeout (pull request #138)
Remove race conditions from -race in tests

* timeout

* raceconditions

* nobuildgp

* build

* perf
2025-05-12 15:11:50 +00:00
Michael McGuinness c4c0b9bd32 Merged in update/ci (pull request #127)
added CI

* onlywherenecessary

* export

* dockersocketoverride

* disablecleanup

* networkfromenv

* fullsuite

* ci

* dockerhost

* name

* network

* buildfirst

* rm

* caches

* additionalcaches

* additionalcaches

* cachenix

* nix

* requiredprofile

* nonixcache

* nobuild

* moremem

* rmgomodules

* buildfirst

* faster

* clean
2025-05-08 16:04:45 +00:00
Michael McGuinness ee776d2681 Merged in feature/mockserver (pull request #135)
Single Mock Server

* mockserver

* mockserver

* reqs

* mockserver

* slowrunner

* someoptimisedqueries

* passedfullsuite

* passedfullsuite
2025-05-06 01:59:52 +00:00
Michael McGuinness efe87321b2 Merged in feature/parallellogqueries (pull request #132)
Testing Tweaks

* parallel

* slowestquery

* split

* cleanup

* health

* dynamiccores

* go

* profile

* timeout

* commitmychanges

* taskfile

* sqlcheckstart

* client

* cost

* ctxtimeout
2025-05-05 09:31:21 +00:00
Michael McGuinness 721ca8a6e6 Merged in feature/dockerfileintest (pull request #130)
Dockerfile in Test

* dockerfile

* network

* const
2025-05-03 11:29:10 +00:00
Michael McGuinness dd2eebf13a Merged in feature/testingopts (pull request #129)
Testing Options and Clean Up

* bitsandbobs

* lint

* healthchecks

* imgintests

* singlegenerate

* testclean

* network

* networkclean

* cmds
2025-05-03 01:16:53 +00:00
Michael McGuinness af361b4a67 Merged in feature/testclean (pull request #126)
Bit of test clean up

* fixes
2025-04-29 17:13:09 +00:00
Michael McGuinness 76cc547bd6 Merged in feature/stabilisetimeNow (pull request #125)
inject time.now for tesability

* inject
2025-04-29 14:11:10 +00:00
Michael McGuinness e4bdb968ba Merged in feature/threadpoolchanges (pull request #121)
Thread Pool Changes

* commentresponses
2025-04-27 15:54:52 +00:00
Michael McGuinness 752fb2e2c0 Merged in feature/chc_1 (pull request #120)
Text Extraction Clean Up + Parallelization

* merged_Call

* directchildren

* bitofimprovements

* go

* parallel

* fixfullsuite

* pondforconcurrency

* comments

* muchdone

* bitsofclean

* stabilisedtests

* snappy

* threadpooltests

* childelements

* testspassed
2025-04-25 17:02:50 +00:00
jay brown 525d3e0b7b docs 2025-04-24 13:28:49 -07:00
parity-error 28211710cc Merge branch 'main' of bitbucket.org:aarete/query-orchestration into feature/cognito 2025-04-23 11:04:14 -07:00
Michael McGuinness 47fec079e5 Merged in feature/demo (pull request #116)
Demo prep + Fix client sync

* firstversion

* clientsync

* configlint

* fixtests
2025-04-22 19:57:35 +00:00
jay brown f28561dac6 merge main 2025-04-22 12:09:51 -07:00
Michael McGuinness fee71e7740 Merged in feature/postprocessing (pull request #114)
Feature/postprocessing

* tests

* passtest

* fixshorttests

* mosttests

* improvingbasedockerfile

* testspeeds

* testing

* host

* canparallel

* clean

* passfullsuite

* singlepagemax

* test

* findfeatures

* findstables

* tbls

* tablestoo

* tablestoo

* lateraltests

* tableloc

* cleanup

* inlinetable

* childids

* cleanup

* tests
2025-04-22 14:40:16 +00:00
jay brown fa37ba7a92 changes for PR 2025-04-21 15:12:38 -07:00
jay brown 2ef116fe1a pr cleanup 2025-04-18 13:00:08 -07:00
jay brown 948f693130 test fix 2025-04-17 17:37:47 -07:00
jay brown 882112a3f6 fix tests 2025-04-17 16:38:15 -07:00
jay brown f5c5e23d12 bugfix after cleanup 2025-04-17 16:08:26 -07:00
jay brown 55c569baeb pr cleanup
config consolidation
2025-04-17 15:59:14 -07:00
parity-error 1bbfa95a40 Merge branch 'main' of bitbucket.org:aarete/query-orchestration into feature/cognito 2025-04-15 05:37:38 -07:00
jay brown a50d935c33 fix tests
add feature flag for Auth
2025-04-14 14:46:28 -07:00
jay brown 7f9618cb14 test coverage 2025-04-14 13:39:13 -07:00
jay brown 61accd4dd4 partial working 2025-04-11 16:46:05 -07:00
jay brown ba6f624299 auth.configprovider 2025-04-11 15:23:53 -07:00
jay brown 87d2dce06d fix tests
add new cognito vars
2025-04-11 14:30:58 -07:00
jay brown f620118b59 merge authconfig 2025-04-11 11:13:07 -07:00
jay brown 4f40a7e6ea config integration
begin cognito config integration
2025-04-09 17:19:19 -07:00
Michael McGuinness edc50c7510 Merged in feature/part (pull request #113)
Size Import Parts

* parts

* think

* workingpart

* textout
2025-04-08 12:44:09 +00:00
jay brown 9b8101dea1 build fix 2025-04-03 16:01:40 -07:00
jay brown 94eabf7588 merge main 2025-04-03 14:23:49 -07:00
Michael McGuinness 60812aba91 Merged in feature/richname (pull request #112)
Standardised rich name for Files

* tests
2025-04-03 19:17:24 +00:00
Michael McGuinness 1d49313a9f Merged in feature/standardisefilepath (pull request #111)
Feature/standardisefilepath

* baseprocessing

* generalstructure
2025-04-03 12:13:16 +00:00