Commit Graph

4031 Commits

Author SHA1 Message Date
shamoon da3e845b8b Fix (beta): normalize long punctuation chunks to improve embedding (#12848) 2026-05-26 09:32:38 -07:00
shamoon 0a6e0db186 Fix: use chord.on_error before apply_async (#12842) 2026-05-24 14:42:11 -07:00
shamoon 15682231b2 Chore: fix sonarcube logger warnings 2026-05-20 08:54:00 -07:00
Trenton H df861189fa Fix: Don't use smaller integer fields for some workflow fields (#12834) 2026-05-20 14:39:01 +00:00
Trenton H bd86dca57e Fix: Password removal source file location (#12830)
Co-authored-by: shamoon <4887959+shamoon@users.noreply.github.com>
2026-05-19 13:52:04 -07:00
Trenton H ff3360310b Fix: Defer password removal workflow action until the file is in place (#12814) 2026-05-16 17:14:37 -07:00
Trenton H 9a68dcdddf Fix: Allow setting allauth rate limit configuration settings (#12798) 2026-05-14 07:29:49 -07:00
Trenton H 9a78882b5a Fix: Don't embed the metadata which is already embedded into the context (#12795) 2026-05-13 09:01:34 -07:00
Trenton H 7e381f204e Fix: Sanitize dash or plus from the text search path (#12789) 2026-05-12 12:41:38 -07:00
shamoon 7471fedb43 Fix: Update parser contract to require empty strings, not None (#12775)
Co-authored-by: stumpylog <797416+stumpylog@users.noreply.github.com>
2026-05-11 09:16:21 -07:00
Trenton H da0f25b546 Fix: Use a persistent, writeable location for hugging face models (#12771) 2026-05-09 18:23:11 -07:00
shamoon 79d0a04df0 Enhancement: support ollama embeddings (#12753) 2026-05-09 00:06:14 +00:00
Moritz Stückler 177d81c8d4 Fix: create LLM_INDEX_DIR before writing meta.json on first run (#12759)
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-08 23:38:41 +00:00
Trenton H 5202dc0748 Fix: Clear ContentType/guardian caches at import and test cases (#12758) 2026-05-08 20:48:47 +00:00
Trenton H b1e44f5d6b Tweakhancment: Include the last applied 'documents' migration in the log (#12757) 2026-05-08 20:37:10 +00:00
shamoon 57b91ad2cf Fix: use response synthesizer for RAG doc chat (#12751) 2026-05-08 20:01:44 +00:00
shamoon 8769dc894e Fix: only update modified field in notes actions (#12750) 2026-05-08 15:36:07 +00:00
shamoon 978e54ab52 Fixhancement: version-aware thumbnail etag (#12754) 2026-05-08 08:26:37 -07:00
shamoon 268ded92bc Documentation: Update v3 migration docs (#12752) 2026-05-08 08:19:15 -07:00
Trenton H 9a1e2aea50 Fix: Handle dash or plus operators in search queries (#12734) 2026-05-07 17:26:11 +00:00
Trenton H 2354f87a40 Fixes trash preview when a document has deleted versions (#12742) 2026-05-07 17:07:35 +00:00
shamoon 3097f06189 Fix: exclude versions from stats count (#12738) 2026-05-07 16:34:26 +00:00
Trenton H f985f7db51 Fix: Celery chords by using Redis as our result backend (#12741) 2026-05-07 09:20:04 -07:00
shamoon af0df43bac Fix: bump version.py to 3.0.0 also (#12736) 2026-05-07 07:39:57 -07:00
Trenton H 2296d7fa0e Fix: Rewrite Whoosh year only queries to be to Tantivy date syntax (#12725) 2026-05-06 09:26:46 -07:00
shamoon cc918bae5f Fix: pass allow parallel tool calls in LLM client (#12718) 2026-05-05 16:57:47 -07:00
Trenton H e2ad14f9ca Fix: workflow password removal didn't handle lists from the DB (#12716) 2026-05-05 12:52:34 -07:00
github-actions[bot] 5966b12362 New Crowdin translations by GitHub Action (#12674)
Co-authored-by: Crowdin Bot <support+bot@crowdin.com>
2026-05-05 08:37:58 -07:00
GitHub Actions bb5100b3d8 Auto translate strings 2026-05-05 01:02:33 +00:00
Trenton H c3b353873b use a few named tuples and data classes instead of so much unpacking (#12709) 2026-05-04 18:00:48 -07:00
Trenton H e822e72964 Feature: Further reduce document importer memory usage (#12707)
* Replaces loaddata with streaming bulk_create

Replaces call_command('loaddata') with a streaming implementation that
reads manifest records one at a time via ijson, accumulates per-model
batches up to --batch-size, and flushes via bulk_create.  This reduces
peak memory and no longer scales directly with the size of the import.

* fix(importer): avoid guardian lru_cache poisoning; include M2M through tables in check_constraints

clear_cache() inside the import transaction emptied Django's ContentType
manager cache while fixture PKs were live, causing downstream ContentType
lookups to repopulate guardian's separate @lru_cache(None) with
fixture-PK objects. After the TestCase transaction rolled back to
original PKs, guardian's lru_cache held stale fixture ContentType
objects, causing MixedContentTypeError in unrelated subsequent tests.

Remove clear_cache() since it was defending against a theoretical
stale-cache scenario that doesn't occur in a proper same-install restore.

Fix check_constraints() to explicitly include auto-created M2M through
tables (populated by .set() after bulk_create) alongside the model tables,
addressing the gap where join-table FK violations would have gone
undetected.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* Excludes the consumer and AnonymousUser from any models which might have a FK relation to it.  This prevents orphan things like UI setting, which have a relation to no existing user

* Splits into more sub functions for Sonar

* Improvements to the typing of the new functions

* Coverage for some error cases, and removes handling for pk only models.  No need to support these

* Final coverage gaps

---------

Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-04 16:36:05 -07:00
GitHub Actions 209c5d2deb Auto translate strings 2026-05-04 21:36:15 +00:00
shamoon a76b6b826c Fix (dev): resolve tantivy search-filtered documents in bulk edit (#12705) 2026-05-04 14:34:08 -07:00
shamoon ca4444c9a3 Fix (dev): return empty list for non-positive search limit (#12703) 2026-05-04 08:50:15 -07:00
GitHub Actions 31afd0483f Auto translate strings 2026-05-04 13:13:43 +00:00
Trenton H 4a915f8e3a Fix: Always require a set, non-empty, not whitespace secret key, even in DEBUG (#12680) 2026-05-04 13:11:56 +00:00
Trenton H 5010f37174 Fix: avoid unnecessary close_old_connections in Celery task dispatch (#12701) 2026-05-04 06:02:28 -07:00
Trenton H b38d112691 Chore: Convert more testing to pytest style (#12678) 2026-04-30 11:40:11 -07:00
GitHub Actions 59c08e84e2 Auto translate strings 2026-04-30 12:54:34 +00:00
shamoon d4a1de18f7 Change (dev): separate llm suggestions endpoint (#12675) 2026-04-30 05:52:45 -07:00
github-actions[bot] 40f33e397e New Crowdin translations by GitHub Action (#11627)
Co-authored-by: Crowdin Bot <support+bot@crowdin.com>
2026-04-29 16:49:16 -07:00
shamoon fbadc2e1b8 Enhancement: Paperless-ngx v3 Logo (#12673) 2026-04-29 16:38:25 -07:00
Trenton H 493d282059 Chore: Upgrades tantivy-py to the latest release (#12605) 2026-04-29 10:09:50 -07:00
shamoon 354df34e47 Enhancement: chat message document links (#12670) 2026-04-28 13:00:20 -07:00
GitHub Actions 8e6fd010a0 Auto translate strings 2026-04-28 17:08:38 +00:00
shamoon 69cb4d06c6 Enhancement (dev): Use OpenAI-like backend (#12668) 2026-04-28 10:06:59 -07:00
Trenton H 14fe520319 Chore: Update typing and baselines again (#12641)
a
2026-04-28 09:28:05 -07:00
shamoon ff95512b9a Fix: apply tag changes directly to document in db (#12664) 2026-04-28 08:18:40 -07:00
GitHub Actions 441d1b8c9f Auto translate strings 2026-04-27 03:19:34 +00:00
shamoon 21ff254ffc Merge branch 'main' into dev 2026-04-26 19:12:40 -07:00