41 Commits

Author SHA1 Message Date
Jay Brown 17fc813823 Merged in feature/mutable-metadata1 (pull request #221)
M1, M2 and M3 complete

* M1, M2 and M3 complete

* review changes

* docs

* docs
2026-04-16 23:11:26 +00:00
Jay Brown b71a28d3c0 Merged in feature/support-more-types (pull request #219)
support new types for import

* tests pass

* missing file

* bug fixes
2026-03-31 17:40:42 +00:00
Jay Brown 35d72fccbe Merged in feature/remove-mocks (pull request #202)
Feature/remove mocks

* remove mocks

* cleanup db migrations
2026-01-15 20:39:32 +00:00
Jay Brown 0ddae4f91e Merged in feature/remove-query (pull request #201)
remove query from codebase part 1

* remove query

* fix localstack run
2026-01-14 17:59:04 +00:00
Jay Brown 2b43799f56 Merged in feature/admin-api (pull request #191)
admin api and associated tools

* in progress

admin api started and permit.io setup tool started

* docs

* build fix

* integration tests passing

* new permit variables

* fix permit

* fix delete regex

* fix delete response

* docs

* docs
2025-10-23 22:57:15 +00:00
Jay Brown 0ad41de26b Merged in feature/textract-fix (pull request #178)
fix textract accuracy issue

* fix textract
2025-09-03 20:43:27 +00:00
jay brown 3de3d0a7b3 swagger part 1 2025-08-05 07:03:35 -07:00
Jay Brown daf4d4b94b Merged in feature/permit-io-demo (pull request #144)
draft pr for the test demo harness for permit.io

* harness working

for permit.io demo

* user is const

* aws profile

* permit import code

for research

* cleanup

* create user tool poc

* Merge branch 'main' of bitbucket.org:aarete/query-orchestration into feature/permit-io-demo

* tests for user creation

* add audit logs

and dry-run

* add tests

sanity check the requested roles

* update docs for delete

* disable/enable users

and test

* more tests

and make user name required only for create operations

* clean up

* add docs

* aws tag tests

* audit -> slog

* attempt build fix devbox

* edit

* just devbox

* remove lock change for merge

* Merge branch 'main' of bitbucket.org:aarete/query-orchestration into feature/permit-io-demo
2025-06-13 19:42:24 +00:00
Michael McGuinness cc2278086f Merged in feature/import (pull request #157)
Feature/import

* importstart

* pp

* tests

* importtests

* 100GB

* lint

* passtests

* utc

* awsprofile

* doublequotes

* host
2025-05-27 15:28:46 +00:00
Michael McGuinness dd2eebf13a Merged in feature/testingopts (pull request #129)
Testing Options and Clean Up

* bitsandbobs

* lint

* healthchecks

* imgintests

* singlegenerate

* testclean

* network

* networkclean

* cmds
2025-05-03 01:16:53 +00:00
Michael McGuinness 752fb2e2c0 Merged in feature/chc_1 (pull request #120)
Text Extraction Clean Up + Parallelization

* merged_Call

* directchildren

* bitofimprovements

* go

* parallel

* fixfullsuite

* pondforconcurrency

* comments

* muchdone

* bitsofclean

* stabilisedtests

* snappy

* threadpooltests

* childelements

* testspassed
2025-04-25 17:02:50 +00:00
parity-error e55585bae1 Merge branch 'main' of bitbucket.org:aarete/query-orchestration into feature/cognito 2025-04-24 06:33:17 -07:00
Michael McGuinness d54c823d77 Merged in feature/tableandtests (pull request #119)
Stabilise tests and CNC_1 Sample

* testspeedup

* notyet

* replacebits

* noflake
2025-04-24 13:31:47 +00:00
jay brown f28561dac6 merge main 2025-04-22 12:09:51 -07:00
Michael McGuinness fee71e7740 Merged in feature/postprocessing (pull request #114)
Feature/postprocessing

* tests

* passtest

* fixshorttests

* mosttests

* improvingbasedockerfile

* testspeeds

* testing

* host

* canparallel

* clean

* passfullsuite

* singlepagemax

* test

* findfeatures

* findstables

* tbls

* tablestoo

* tablestoo

* lateraltests

* tableloc

* cleanup

* inlinetable

* childids

* cleanup

* tests
2025-04-22 14:40:16 +00:00
jay brown 87d2dce06d fix tests
add new cognito vars
2025-04-11 14:30:58 -07:00
jay brown 3911cbbcc1 merge main 2025-03-28 13:51:30 -07:00
jay brown dda6d7ee8c initial cognito
actual
2025-03-20 15:25:13 -07:00
Michael McGuinness 53ea7d34e6 Merged in feature/textextract (pull request #108)
Start adding Textract + UUID changes

* base

* startclient

* ts

* short

* tests
2025-03-20 11:06:41 +00:00
jay brown 5232c6e5ac Merge remote-tracking branch 'origin/main' into feature/cognito 2025-03-19 16:43:27 -07:00
Michael McGuinness 3dd0c718cd Merged in feature/openapifixes (pull request #106)
OpenAPI Middleware & Fixes

* updates
2025-03-18 13:06:42 +00:00
jay brown 989db0486a wip 2025-03-12 17:12:48 -07:00
Jay Brown 7d78e65d0c Merged in feature/semver (pull request #93)
Add semantic versioning to all services

* working

* Merge branch 'main' of bitbucket.org:aarete/query-orchestration into feature/semver

* 1.24 mod

* go upgrade

* tool

* Merge branch 'main' of bitbucket.org:aarete/query-orchestration into feature/semver
2025-03-06 22:33:39 +00:00
Michael McGuinness f11f4def43 Merged in feature/clean (pull request #76)
Clean Set Up

* fail

* starteddb

* constraint

* cleantest

* fixqueries

* fixtests

* storemimetype

* buffer

* tests

* setup

* passingtests

* pdfHElloWorld

* rm

* test

* notodos

* tests

* clean

* testpdf
2025-02-28 13:11:53 +00:00
Michael McGuinness 0df3d16976 Merged in feature/testwithlogs (pull request #65)
Query Version Sync Runner

* testing

* queryversiosyncworking

* update

* tests

* fixtests
2025-02-14 10:56:24 +00:00
Jay Brown 477518e5eb Merged in feature/prometheus (pull request #52)
API instrumentation - metrics and logging

* api instrumentation

prometheus metrics and logging for all routes

* Merge branch 'main' of bitbucket.org:aarete/query-orchestration into feature/prometheus

* add log_level

and sync the config initialize

* docs

* cleanup

* add to compose:up:test

* docs for prometheus testing

* custom metrics

* cleanup

* merge main

* add tests

* cleanup docs

* cleanup

* lint

* fix unit tests (attempt)

* fix tests

* resolvesetlogger

* expose 8080

* compose changes

* bugfixesformichael

* don't build _test

* merge in main

* job_sync_runner
2025-02-13 15:44:08 +00:00
Michael McGuinness 92334ad1dd Merged in feature/s3integration (pull request #47)
Set Up S3 integration

* cfginterfaceandfirsts3funcs

* addlocalstack

* generallypassesfullsuite

* addedmultipleattemptedpings

* cleanup

* stabiliseplusskip
2025-02-05 12:52:41 +00:00
Jay Brown 8e66e55119 Merged in feature/serviceconfig (pull request #33)
DRAFT PR: Prototype for serviceconfig

* in progress

* in progress

* extract common methods

* Merge remote-tracking branch 'origin/feature/serviceconfig' into feature/serviceconfig

* fix types

* cleanup

* add tests

* Merged main into feature/serviceconfig


Approved-by: Michael McGuinness
2025-01-27 17:59:03 +00:00
Jay Brown 174644b63c Merged in jb/openapi (pull request #22)
add openapi infra

* add openapi infra

Includes generated stubs and all deps

* generatetolocation

* basesetupoffunctionsandclient

* round1controllertests

* passintegrationtests

* cleanupfromfullsuite

* storedjson

* fixjsonyaml

* fixtests


Approved-by: Michael McGuinness
2025-01-15 19:45:51 +00:00
Michael McGuinness 6e5c7aedc8 Merged in feature/devbox (pull request #11)
Add Devbox

* adddevbox

* cleanupdockerfile

* testscripts
2025-01-10 12:58:14 +00:00
Michael McGuinness d53611c6c5 passedTestingThreshhold 2024-12-24 18:11:25 +00:00
Michael McGuinness 827d973053 a bit more testing 2024-12-24 12:47:40 +00:00
Michael McGuinness 1a5fab87c6 validate inputs 2024-12-23 16:49:53 +00:00
Michael McGuinness a54a70047b apicontext 2024-12-23 16:01:54 +00:00
Michael McGuinness 339ce185ad jsonextractionv0 2024-12-23 12:26:05 +00:00
Michael McGuinness 66fcc78887 can grab all queries required to fulfill a collector 2024-12-19 18:49:22 +00:00
Michael McGuinness fc4214336e normaliseeol 2024-12-19 11:44:19 +00:00
Michael McGuinness 2209b877f5 putting in base query and collector framework 2024-12-19 11:44:13 +00:00
Michael McGuinness a2db93ca48 eol 2024-12-19 11:41:35 +00:00
Michael McGuinness 358341e89b Merged in feature/otel (pull request #2)
Adding otel func

* otel
2024-12-17 14:04:14 +00:00
Michael McGuinness b1f8ac453b Merged in feature/baseTemplate (pull request #1)
feat!: base template

* first bit of templating

* codeowners

* linuxbased

* restart

* baseline project

* add grpc api and basic integration test

* startqueue

* queueMsg

* splitscripts

* migrations

* queueintegrationtest

* gateway
2024-12-06 14:38:42 +00:00