Jacob Mathison
a080ca59d8
Merged in jmathison/v2-upload-batch (pull request #224 )
...
Implement v2 upload batch cleanup
* Implement v2 upload batch cleanup
* Merge remote-tracking branch 'origin/main' into jmathison/v2-upload-batch
* Address upload batch review feedback
* Raise batch worker coverage
* Fix batch cleanup review issues
Approved-by: Jay Brown
2026-05-08 21:42:46 +00:00
Jay Brown
72de690894
Merged in feature/chatbot1 (pull request #223 )
...
Chatbot functionality
* baseline working
* missing test file
* more tests
2026-05-07 20:56:18 +00:00
Jay Brown
17fc813823
Merged in feature/mutable-metadata1 (pull request #221 )
...
M1, M2 and M3 complete
* M1, M2 and M3 complete
* review changes
* docs
* docs
2026-04-16 23:11:26 +00:00
Jay Brown
b71a28d3c0
Merged in feature/support-more-types (pull request #219 )
...
support new types for import
* tests pass
* missing file
* bug fixes
2026-03-31 17:40:42 +00:00
Jay Brown
aafe7d5b5f
Merged in feature/batch-status (pull request #215 )
...
Implement and test the batch status feature
* working
2026-03-12 18:53:42 +00:00
Jacob Mathison
8a4029058b
Merged in jmathison/demo-table (pull request #213 )
...
Add demo dashboard settings table and CRUD API
* Add demo dashboard settings table and CRUD API
- Migration 00000000000123: create demoDashboardSettings table (id, guid, key, value JSONB, isDeleted, timestamps)
- SQLC queries and repository for create, list, listByGuid, get, update, soft delete
- OpenAPI paths and schemas in queryAPI.yaml; regenerate api.gen.go (embedded spec)
- Handlers in api/queryAPI/demodashboardsettings.go; ConfigProvider GetDBQueries for repo access
- Unit tests for demo dashboard settings CRUD
* Fix sqlc-generated demo dashboard setting types
Align demo dashboard settings handlers with sqlc output (DemoDashboardSetting model + pointer slices) so CI codegen/build succeeds.
* Fix CI gosec and gofmt issues
- Suppress gosec G115 for TotalCount len->int32 cast (consistent with other list endpoints)
- gofmt mock GetDBQueries() in test helpers
* gofmt query API demo settings
* Tighten demo dashboard settings OpenAPI constraints
* Regenerate query API embedded spec
* refactor: generic UI settings (table, API, service) and three-layer architecture
- Replace demo-dashboard-settings with generic UI settings:
- Table uiSettings with namespace (was guid), key, value JSONB; UNIQUE(namespace, key)
- Migration 123: create_ui_settings (single migration, no rename)
- OpenAPI: /ui-settings, UISettingsService, UISetting schemas with namespace
- API types and handlers: CreateUISetting, ListUISettings, GetUISetting, UpdateUISetting, DeleteUISetting
- Add service layer (architecture fix):
- internal/uisettings: Service with Create, List, ListByNamespace, Get, Update, SoftDelete
- Controllers call s.svc.UISettings only; remove GetDBQueries from queryAPI ConfigProvider
- Wire UISettings in Services, main.go, and testutils
- Repository: uisettings.sql + uisettings.sql.go, UISetting model; remove demodashboardsettings
- Controller: uisettings.go (replaces demodashboardsettings.go), ErrNotFound from uisettings package
- Tests: uisettings_test.go with namespace-based list/cre…
* Add UISetting model and generated queries for uiSettings table
- models.go: add UISetting struct (sqlc 1.30.0)
- uisettings.sql.go: generated CRUD for ui_settings feature
Made-with: Cursor
* Use repository.UiSetting to match sqlc-generated type
- service and API use repository.UiSetting (sqlc struct name for uiSettings table)
- uisettings.sql.go: keep CreateUISetting/GetUISetting etc. from query names, return *UiSetting
- Fixes Docker/CI build undefined repository.UISetting
* Fix import formatting for golangci-lint
* Lint fix
* uisettings list test
* tests fixes
* Merge main: resolve api.gen.go conflicts (UI settings + DeleteDocument)
* Doc updates and elimination of index redundancy
Approved-by: Jay Brown
2026-03-04 23:00:50 +00:00
Jay Brown
63c12a2f44
Merged in feature/eula.part1 (pull request #206 )
...
eula support
* eula support
* docs
2026-01-22 18:17:27 +00:00
Jay Brown
35d72fccbe
Merged in feature/remove-mocks (pull request #202 )
...
Feature/remove mocks
* remove mocks
* cleanup db migrations
2026-01-15 20:39:32 +00:00
Jay Brown
0ddae4f91e
Merged in feature/remove-query (pull request #201 )
...
remove query from codebase part 1
* remove query
* fix localstack run
2026-01-14 17:59:04 +00:00
Jay Brown
ebf47c6013
Merged in feature/track-filesize (pull request #200 )
...
track file sizes for all documents in system
* feature complete
needs dev testing
2026-01-12 17:46:07 +00:00
Jay Brown
3bdc27f4de
Merged in feature/textExtractionsPart2 (pull request #193 )
...
Continue finishing the parts of the text extraction plan
* add missing fields
2025-12-02 19:13:08 +00:00
Jay Brown
c45e1dd427
Merged in feature/textExtractionsPart1 (pull request #192 )
...
all schema and rest apis for text extraction support
* in progress
* stage 8 complete
* phase 9 completed
* phase 9 complete
* ongoing - s3 path fix
* working
* optimize ci build
* e2e tests
* missing test
2025-11-26 19:23:42 +00:00
Jay Brown
730f3ba11a
Merged in feature/preserve-folder-paths (pull request #179 )
...
support folder paths
* support folder paths
* s3 storage docs
2025-09-05 18:25:31 +00:00
jay brown
7014fa790b
batch upload impl
2025-08-06 15:06:18 -07:00
jay brown
56fb9b4ab6
schema
2025-08-04 10:54:22 -07:00
Michael McGuinness
cc2278086f
Merged in feature/import (pull request #157 )
...
Feature/import
* importstart
* pp
* tests
* importtests
* 100GB
* lint
* passtests
* utc
* awsprofile
* doublequotes
* host
2025-05-27 15:28:46 +00:00
Michael McGuinness
efe87321b2
Merged in feature/parallellogqueries (pull request #132 )
...
Testing Tweaks
* parallel
* slowestquery
* split
* cleanup
* health
* dynamiccores
* go
* profile
* timeout
* commitmychanges
* taskfile
* sqlcheckstart
* client
* cost
* ctxtimeout
2025-05-05 09:31:21 +00:00
Michael McGuinness
fee71e7740
Merged in feature/postprocessing (pull request #114 )
...
Feature/postprocessing
* tests
* passtest
* fixshorttests
* mosttests
* improvingbasedockerfile
* testspeeds
* testing
* host
* canparallel
* clean
* passfullsuite
* singlepagemax
* test
* findfeatures
* findstables
* tbls
* tablestoo
* tablestoo
* lateraltests
* tableloc
* cleanup
* inlinetable
* childids
* cleanup
* tests
2025-04-22 14:40:16 +00:00
Michael McGuinness
edc50c7510
Merged in feature/part (pull request #113 )
...
Size Import Parts
* parts
* think
* workingpart
* textout
2025-04-08 12:44:09 +00:00
Michael McGuinness
81e7223560
Merged in feature/textextraction (pull request #110 )
...
Text Extraction
* bases
* go
* splitting
* structure
* movetoasync
* movetoasync
* settinguptrigger
* reorder
* storevent
* standardisepollingvalidation
* unittests
* fixlint
* fixlint
* awscfg
* generatesample
* followthrough
* tests
* clena
* store
* externalidcleanup
* clientid
* local
* baseunittests
* putobjecttests
* tests
2025-04-02 18:50:03 +00:00
Michael McGuinness
53ea7d34e6
Merged in feature/textextract (pull request #108 )
...
Start adding Textract + UUID changes
* base
* startclient
* ts
* short
* tests
2025-03-20 11:06:41 +00:00
Michael McGuinness
bbd86fb4ea
Merged in feature/CollectorBuildVersion (pull request #100 )
...
Collector Build Version
* lint
* fixtests
2025-03-11 18:15:49 +00:00
Michael McGuinness
6648cdf1cb
Merged in feature/clientexternalid (pull request #99 )
...
Client External ID
* normalizeexternalid
* cleanopenapi
* cleanopenapi
* changingpublic
* noprecommit
* testing
* precommit
* processtest
* nodb
* tests
* tests
2025-03-11 16:31:06 +00:00
Michael McGuinness
62886dbba8
Merged in feature/removejob (pull request #95 )
...
Remove Job
* removejob
* rmjob
* sync
* cleanup
* precommit
* startslow
* startslow
* startslow
* openapi
* clean
* test
* scripts
* littlecleanercmds
* mermaid
2025-03-10 11:03:00 +00:00
Michael McGuinness
2061543fc9
Merged in feature/newclean (pull request #81 )
...
Same Clean Output
* bitoftesting
* cleantest
2025-03-03 21:56:17 +00:00
Michael McGuinness
f11f4def43
Merged in feature/clean (pull request #76 )
...
Clean Set Up
* fail
* starteddb
* constraint
* cleantest
* fixqueries
* fixtests
* storemimetype
* buffer
* tests
* setup
* passingtests
* pdfHElloWorld
* rm
* test
* notodos
* tests
* clean
* testpdf
2025-02-28 13:11:53 +00:00
Michael McGuinness
3d434eedb8
Merged in feature/jobsynced (pull request #72 )
...
Job Status Get and DB tidy up
* initalquery
* tests
* shorttests
* testing queries
* job
* solvedthequery
* updatingdb
* fixingtests
* repotests
* shorttests
* docker
* testspassed
2025-02-20 19:02:44 +00:00
Michael McGuinness
4bbc24e8aa
Merged in feature/codeversions (pull request #69 )
...
Code Versions
* split
* latestVersion
* test
* config
* codeversions
2025-02-17 14:30:37 +00:00
Michael McGuinness
806c0f74eb
Merged in feature/collectorversions (pull request #68 )
...
Strict Collector Versions
* version
2025-02-17 11:44:51 +00:00
Michael McGuinness
750abe1be3
Merged in feature/entitylogs (pull request #67 )
...
Query Version Update
2025-02-14 18:43:26 +00:00
Michael McGuinness
71f9802e1a
Merged in feature/splitqueryrunning (pull request #57 )
...
Split Query Running + Debugging Full Flow
* completedquerysyncrunner
* spliitinglogic
* synccomplete
* informdependents
* only push same collector
* deps
* livetesting
* foundissue
* some issues resolved
* activeupdate
* collectorupdatefixes
* fix dbquesries
* tests
* tests
* pollingdebug
2025-02-11 15:22:59 +00:00
Michael McGuinness
24a038ec3d
Merged in feature/doctextstructure (pull request #56 )
...
DocTextRunner Structure
* firstround
* shorttests
2025-02-07 14:15:06 +00:00
Michael McGuinness
90353d8161
Merged in feature/docclean (pull request #55 )
...
Doc Clean Structure
* outline
* isdocclean
* placeholder for clean log
* versionplustesting
* versionplustesting
* testspassed
2025-02-07 12:12:51 +00:00
Michael McGuinness
5c253b3592
Merged in feature/docinit (pull request #48 )
...
Feature/docinit
* createunittests
* cleanup
* skip
* cleanup
2025-02-05 17:44:01 +00:00
Michael McGuinness
058f8dba7f
Merged in feature/logVersioning (pull request #40 )
...
Can Sync Versioning
* started
* client
* jobcansync
* tests
2025-01-29 16:26:11 +00:00
Michael McGuinness
0ac5ff9e15
Merged in feature/testquery (pull request #39 )
...
Test Query
* depstextandclean
* startedcleaningresult
* resulttidyup
* roundone
* cleaning
* unsyncedquery
* startedtestsandsimplification
* api
* querytests
* resultprocessortests
* unittests
* cleanup
2025-01-29 11:52:37 +00:00
Michael McGuinness
b16ff55afa
Merged in feature/document (pull request #36 )
...
Document CRUD
* doccreate
* dochashlocandget
* depsandtodo
2025-01-24 16:12:25 +00:00
Michael McGuinness
5b7160fe44
Merged in fature/jobs (pull request #34 )
...
Job Collector
* createstructure
* mostupdatevalidation
* repocollectorupdate
* updateoutline
* updatevalidation
* scriptupdate
* cleanupdockerignore
* update
* collectorupdateapi
2025-01-23 14:56:20 +00:00
Michael McGuinness
04d8eaf52c
Merged in feature/client (pull request #31 )
...
Client Entity
* repolevel
* servicefunctions
* openapiclientget
* openapiupdate
* client
* vendor
2025-01-21 18:24:14 +00:00
Michael McGuinness
4ccb980593
Merged in feature/jobcollector (pull request #30 )
...
Initial Job Collector (changes pending)
* movearroundtocleancollector
* internalgetfunctions
* completecollectorquery
* simplify
* fixtests
* addvendor
* noplaceholder
2025-01-21 12:28:46 +00:00
Michael McGuinness
5ca36b0502
Merged in feature/listtypes (pull request #23 )
...
Feature/listtypes
* started
* cleanuplist
* someunittestfixes
* removemostflakiness
2025-01-15 12:19:49 +00:00
Michael McGuinness
57764272c3
Merged in feature/unittests (pull request #9 )
...
Feature/unittests
* addedmoretests
* easyquerytests
* fixotelinit
* preppedqueriestotestcontainer
* dbqueries
* splitintoqueryfiles
* covered the bases
2025-01-08 18:14:15 +00:00
Michael McGuinness
788b21594c
creatorupdatordeprecate
2025-01-07 13:54:41 +00:00
Michael McGuinness
4dd050e390
synctest
2024-12-24 17:13:48 +00:00
Michael McGuinness
339ce185ad
jsonextractionv0
2024-12-23 12:26:05 +00:00
Michael McGuinness
f95114e11a
queuecreation
2024-12-20 17:35:33 +00:00
Michael McGuinness
6b07844d46
collectscollector
2024-12-19 19:49:40 +00:00
Michael McGuinness
66fcc78887
can grab all queries required to fulfill a collector
2024-12-19 18:49:22 +00:00
Michael McGuinness
fc4214336e
normaliseeol
2024-12-19 11:44:19 +00:00
Michael McGuinness
2209b877f5
putting in base query and collector framework
2024-12-19 11:44:13 +00:00