70 Commits

Author SHA1 Message Date
Jay Brown 72de690894 Merged in feature/chatbot1 (pull request #223)
Chatbot functionality

* baseline working

* missing test file

* more tests
2026-05-07 20:56:18 +00:00
Jay Brown 17fc813823 Merged in feature/mutable-metadata1 (pull request #221)
M1, M2 and M3 complete

* M1, M2 and M3 complete

* review changes

* docs

* docs
2026-04-16 23:11:26 +00:00
Jay Brown 35d72fccbe Merged in feature/remove-mocks (pull request #202)
Feature/remove mocks

* remove mocks

* cleanup db migrations
2026-01-15 20:39:32 +00:00
Jay Brown 0ddae4f91e Merged in feature/remove-query (pull request #201)
remove query from codebase part 1

* remove query

* fix localstack run
2026-01-14 17:59:04 +00:00
Jay Brown ebf47c6013 Merged in feature/track-filesize (pull request #200)
track file sizes for all documents in system

* feature complete

needs dev testing
2026-01-12 17:46:07 +00:00
Jay Brown c45e1dd427 Merged in feature/textExtractionsPart1 (pull request #192)
all schema and rest apis for text extraction support

* in progress

* stage 8 complete

* phase 9 completed

* phase 9 complete

* ongoing - s3 path fix

* working

* optimize ci build

* e2e tests

* missing test
2025-11-26 19:23:42 +00:00
Jay Brown 7638fd3a90 Merged in feature/rate-limiting (pull request #190)
Implement global and per ip rate limiting

* all tests passing

* test fix

* Enhances test environment for rate limiting

Updates the test environment to better support rate limiting tests.

- Increases rate limits in test container to avoid interference with legitimate test traffic.
- Increases the polling interval for client status checks to reduce load on the rate limiter.
- Adds logic to retry status checks if rate limiting is encountered.

* Merge branch 'main' of bitbucket.org:aarete/query-orchestration into feature/rate-limiting

* build fix

* test fix
2025-10-13 22:13:15 +00:00
Jay Brown 720a84be92 Merged in feature/doc_import (pull request #177)
integration of background processor

* integration part 1

* feature working

* fix mimetype issue
2025-08-20 19:01:13 +00:00
jay brown 7014fa790b batch upload impl 2025-08-06 15:06:18 -07:00
jay brown a9d81a1094 remove parallel
remove parallel to stabilize ci/cd
2025-07-22 10:29:44 -07:00
Michael McGuinness 3028fe7eaa Merged in feature/linting (pull request #168)
Linting Updates

* precommit

* smallerchecks

* govuln
2025-06-23 15:58:20 +00:00
Michael McGuinness 693457ce2d Merged in feature/movefromtrigger (pull request #164)
Single Text Queue

* notrigger
2025-06-10 12:57:30 +00:00
Michael McGuinness 76e4f5790f Merged in feature/health (pull request #163)
Health Endpoint

* health
2025-06-09 23:30:06 +00:00
Michael McGuinness 7ce7c9df4d Merged in feature/ecr (pull request #161)
Feature/ecr

* nosave

* repo

* awscli

* unzip

* ignore

* moreram

* 14k

* ref

* deployment

* 12k

* uselocal

* go

* dockercomd

* reorder

* iamgename

* installs

* tart

* cli

* clideps

* y

* dockerce

* nodock

* multi

* rmecr

* dev
2025-06-03 13:52:10 +00:00
Michael McGuinness b8302344b4 Merged in feature/ecr (pull request #159)
Test

* tests

* tar

* go

* tmp

* test

* go

* go

* go

* config

* goup

* versioning

* order

* cleanup

* git

* smallopts

* flags

* lessisgood

* go

* order

* ordermatters

* order

* cc

* test
2025-06-02 10:44:45 +00:00
Michael McGuinness db469e7491 Merged in feature/assertions (pull request #158)
Assertions + Gen Text

* assert
2025-05-28 12:36:47 +00:00
Michael McGuinness cc2278086f Merged in feature/import (pull request #157)
Feature/import

* importstart

* pp

* tests

* importtests

* 100GB

* lint

* passtests

* utc

* awsprofile

* doublequotes

* host
2025-05-27 15:28:46 +00:00
Michael McGuinness 33d68b7e04 Merged in feature/momocks (pull request #150)
Decrease Mocks

* feature/nomocks

* nonet

* assertsaws

* assert
2025-05-23 00:20:01 +00:00
Michael McGuinness 36ff8096f3 Merged in bugfix/dockerbuild (pull request #149)
Doc Build Update

* dockerbuild
2025-05-22 09:16:09 +00:00
Michael McGuinness e23ada9a8e Merged in bugfix/querytest (pull request #147)
Pass Test Query

* passfullsutie
2025-05-21 11:25:17 +00:00
Michael McGuinness 731b68e4af Merged in bugfix/pathstandard (pull request #146)
Change Path Separator

* clientid
2025-05-20 17:00:50 +00:00
Michael McGuinness 61d12bf8df Merged in feature/checkbox (pull request #145)
Checkbox Primary Edge Cases

* hascheckboxlogic

* gen

* preppinggen

* exploringcheckbox

* removeunselected

* tests

* failingtest

* failintests

* nomockqueryapi

* db

* name

* nocontainer

* deleterow

* cnc

* extradocsandupdatetextracts

* moretables

* appndedtables

* baseversion
2025-05-20 12:47:22 +00:00
Michael McGuinness 418a2761b3 Merged in feature/mergecell (pull request #142)
Merged Cell

* mergecellv1

* buildimg

* merging

* addfile

* justmergedcell
2025-05-13 12:33:34 +00:00
Michael McGuinness 9dfd867906 Merged in feature/splittests (pull request #140)
Split Tests

* split
2025-05-12 20:54:16 +00:00
Michael McGuinness f5061f53db Merged in feature/timeout (pull request #138)
Remove race conditions from -race in tests

* timeout

* raceconditions

* nobuildgp

* build

* perf
2025-05-12 15:11:50 +00:00
Michael McGuinness c4c0b9bd32 Merged in update/ci (pull request #127)
added CI

* onlywherenecessary

* export

* dockersocketoverride

* disablecleanup

* networkfromenv

* fullsuite

* ci

* dockerhost

* name

* network

* buildfirst

* rm

* caches

* additionalcaches

* additionalcaches

* cachenix

* nix

* requiredprofile

* nonixcache

* nobuild

* moremem

* rmgomodules

* buildfirst

* faster

* clean
2025-05-08 16:04:45 +00:00
Michael McGuinness e84454b46f Merged in bugfix/toomanythreads (pull request #136)
Too Many Threads

* dropthreads

* assertstatus

* assertstatus
2025-05-06 13:49:49 +00:00
Michael McGuinness ee776d2681 Merged in feature/mockserver (pull request #135)
Single Mock Server

* mockserver

* mockserver

* reqs

* mockserver

* slowrunner

* someoptimisedqueries

* passedfullsuite

* passedfullsuite
2025-05-06 01:59:52 +00:00
Michael McGuinness efe87321b2 Merged in feature/parallellogqueries (pull request #132)
Testing Tweaks

* parallel

* slowestquery

* split

* cleanup

* health

* dynamiccores

* go

* profile

* timeout

* commitmychanges

* taskfile

* sqlcheckstart

* client

* cost

* ctxtimeout
2025-05-05 09:31:21 +00:00
Michael McGuinness 40061ee2e9 Merged in feature/longtest (pull request #131)
Long Test

* parallel
2025-05-03 14:59:21 +00:00
Michael McGuinness 721ca8a6e6 Merged in feature/dockerfileintest (pull request #130)
Dockerfile in Test

* dockerfile

* network

* const
2025-05-03 11:29:10 +00:00
Michael McGuinness dd2eebf13a Merged in feature/testingopts (pull request #129)
Testing Options and Clean Up

* bitsandbobs

* lint

* healthchecks

* imgintests

* singlegenerate

* testclean

* network

* networkclean

* cmds
2025-05-03 01:16:53 +00:00
Michael McGuinness af361b4a67 Merged in feature/testclean (pull request #126)
Bit of test clean up

* fixes
2025-04-29 17:13:09 +00:00
Michael McGuinness 752fb2e2c0 Merged in feature/chc_1 (pull request #120)
Text Extraction Clean Up + Parallelization

* merged_Call

* directchildren

* bitofimprovements

* go

* parallel

* fixfullsuite

* pondforconcurrency

* comments

* muchdone

* bitsofclean

* stabilisedtests

* snappy

* threadpooltests

* childelements

* testspassed
2025-04-25 17:02:50 +00:00
parity-error 28211710cc Merge branch 'main' of bitbucket.org:aarete/query-orchestration into feature/cognito 2025-04-23 11:04:14 -07:00
Michael McGuinness bbe6f4188e Merged in feature/tests (pull request #117)
Feature/tests

* improvetests

* generation

* simplifiedtesting

* simplifiedtesting

* longfile
2025-04-23 17:51:44 +00:00
Michael McGuinness 47fec079e5 Merged in feature/demo (pull request #116)
Demo prep + Fix client sync

* firstversion

* clientsync

* configlint

* fixtests
2025-04-22 19:57:35 +00:00
jay brown f28561dac6 merge main 2025-04-22 12:09:51 -07:00
Michael McGuinness fee71e7740 Merged in feature/postprocessing (pull request #114)
Feature/postprocessing

* tests

* passtest

* fixshorttests

* mosttests

* improvingbasedockerfile

* testspeeds

* testing

* host

* canparallel

* clean

* passfullsuite

* singlepagemax

* test

* findfeatures

* findstables

* tbls

* tablestoo

* tablestoo

* lateraltests

* tableloc

* cleanup

* inlinetable

* childids

* cleanup

* tests
2025-04-22 14:40:16 +00:00
jay brown 5aff28d1b6 flip feature flag 2025-04-14 15:40:01 -07:00
jay brown 87d2dce06d fix tests
add new cognito vars
2025-04-11 14:30:58 -07:00
Michael McGuinness 60812aba91 Merged in feature/richname (pull request #112)
Standardised rich name for Files

* tests
2025-04-03 19:17:24 +00:00
Michael McGuinness 1d49313a9f Merged in feature/standardisefilepath (pull request #111)
Feature/standardisefilepath

* baseprocessing

* generalstructure
2025-04-03 12:13:16 +00:00
Michael McGuinness 81e7223560 Merged in feature/textextraction (pull request #110)
Text Extraction

* bases

* go

* splitting

* structure

* movetoasync

* movetoasync

* settinguptrigger

* reorder

* storevent

* standardisepollingvalidation

* unittests

* fixlint

* fixlint

* awscfg

* generatesample

* followthrough

* tests

* clena

* store

* externalidcleanup

* clientid

* local

* baseunittests

* putobjecttests

* tests
2025-04-02 18:50:03 +00:00
Michael McGuinness 53ea7d34e6 Merged in feature/textextract (pull request #108)
Start adding Textract + UUID changes

* base

* startclient

* ts

* short

* tests
2025-03-20 11:06:41 +00:00
Michael McGuinness 1587da9d11 Merged in bugfix/tests (pull request #107)
Fix Fullsuite

* save

* foundthefix..

* codeandrequire
2025-03-19 11:54:14 +00:00
Michael McGuinness 555b6d420b Merged in feature/docresult (pull request #105)
Document Result Endpoint

* testing

* cleantesting

* progress

* query

* lint

* readme

* dockerclient

* api

* passtest

* tests

* test
2025-03-17 18:14:15 +00:00
Michael McGuinness 65c0df50e6 Merged in feature/testing (pull request #102)
Minimum Testing Threshold

* mintests
2025-03-12 12:36:44 +00:00
Michael McGuinness 6648cdf1cb Merged in feature/clientexternalid (pull request #99)
Client External ID

* normalizeexternalid

* cleanopenapi

* cleanopenapi

* changingpublic

* noprecommit

* testing

* precommit

* processtest

* nodb

* tests

* tests
2025-03-11 16:31:06 +00:00
Michael McGuinness 62886dbba8 Merged in feature/removejob (pull request #95)
Remove Job

* removejob

* rmjob

* sync

* cleanup

* precommit

* startslow

* startslow

* startslow

* openapi

* clean

* test

* scripts

* littlecleanercmds

* mermaid
2025-03-10 11:03:00 +00:00