Commit Graph
34 Commits
Author SHA1 Message Date
Pit 3910d9644b Merge pull request #670 from frrad/patch-1
Fix warning in models.py
2020-06-07 22:21:36 +02:00
Pit 38403b78b6 Merge pull request #669 from frrad/patch-1
Adjust docker version requirements in docs
2020-06-02 14:29:22 +02:00
Pit cc31fc14a3 Merge pull request #621 from languitar/fix-620
Handle dateparse exceptions for invalid date formats
2020-05-19 19:04:28 +02:00
Pit d841a3ee5e Merge pull request #627 from Flameeyes/master
Update unpaper website link.
2020-05-19 19:02:57 +02:00
Pit 5e0a3bd7a7 Merge pull request #643 from Pyromane/patch-1
Update lxc-install.sh
2020-05-19 18:59:38 +02:00
Pit b96bfce3b1 Merge pull request #647 from garyng/patch-1
Fix a small typo
2020-05-19 18:58:40 +02:00
Pit df25e06e30 Merge pull request #642 from bauerj/paperless_app
Add link to Paperless App to Related Projects
2020-05-19 18:58:00 +02:00
Pit e0da952e64 Merge pull request #539 from bauerj/subdirectories
Warn if consume directory contains subdirectories
2020-01-04 13:39:28 +01:00
Pit a690b1cf24 Merge pull request #570 from mattelacchiato/master
fix: Documentation rendering leads to wrong commands #569
2019-10-06 16:23:04 +02:00
Pit b5f21550d0 Merge pull request #564 from diveflo/feat/webserver/gunicorn
Gunicorn webserver in Docker
2019-10-06 16:20:06 +02:00
Pit ebd9f918d2 Merge pull request #543 from maur/master
lxc installation - small improvements
2019-09-08 19:13:03 +02:00
Pit 7a9d985240 Merge pull request #509 from bebehei/docker
Sort package arguments in Dockerfile
2019-03-10 11:13:56 +01:00
Pit 90942f9b33 Merge pull request #519 from taoyichen/patch-1
Update Link
2019-03-04 10:25:37 +01:00
Pitandtaoyichen 018c1c79a1 Change link to https
Change linkfrom http to https

Co-Authored-By: taoyichen <ytao15@binghamton.edu>
2019-03-03 14:56:51 -05:00
PitandJensPfeifle cbf008f37b Fix quoting in call to run_convert
Co-Authored-By: JensPfeifle <jens@pfeifle.tech>
2019-03-03 20:31:52 +01:00
Pit 3db98faf5c Merge pull request #499 from bmsleight/screenshots
* Docs: Add web interface screenshots
2019-03-03 19:57:57 +01:00
Pit 8d4057e396 Merge pull request #502 from bmsleight/scanner_new
* Docs: Add MFC-J5910DW to recommended scanners
2019-03-03 19:54:03 +01:00
Pitandstgarf 7bf1d2883c Update docs/utilities.rst
Co-Authored-By: stgarf <stgarf@users.noreply.github.com>
2019-03-03 10:46:43 -08:00
Pitandstgarf 44878f28fa Update docs/utilities.rst
Co-Authored-By: stgarf <stgarf@users.noreply.github.com>
2019-03-03 10:46:06 -08:00
Pitandstgarf 14d7adbd0a Update docs/utilities.rst
Co-Authored-By: stgarf <stgarf@users.noreply.github.com>
2019-03-03 10:45:58 -08:00
Pit Kleyersburg 4333ee01bc Fix modifying the GID under alpine
Fixes #306.
2018-02-25 12:36:51 +01:00
Pit Kleyersburg 80a849fef7 Set g+w on the consumption/export directories
This should fix issue #267.
2017-10-31 15:30:33 +01:00
Pit Kleyersburg f88ec987a3 Don't fail on setting consumption-dir permissions
Changing the group or permissions on the consumption directory can fail,
especially on network-mounted directories. If it fails, don't exit the
consumer, but rather output a warning on what the user has to do.

This is related to (and should close) issue #102.
2016-03-30 15:49:56 +02:00
Pit Kleyersburg fb36a49c26 Add unpaper as another pre-processing step 2016-03-06 15:30:37 +01:00
Pit Kleyersburg 9180ad78c4 Update Dockerfile to match latest version 2016-03-06 14:49:25 +01:00
Pit Kleyersburg 21cd4e9f14 Update env-var in Dockerfile, fix volume names 2016-03-02 09:10:52 +01:00
Pit Kleyersburg c45f951ca0 Ignore error if orientation detection fails
Fixes an additional issue that came up in #48.
2016-02-19 09:52:32 +01:00
Pit Kleyersburg 724afa59c7 Add Dockerfile for application and documentation
This commit adds a `Dockerfile` to the root of the project, accompanied
by a `docker-compose.yml.example` for simplified deployment. The
`Dockerfile` is agnostic to whether it will be the webserver, the
consumer, or if it is run for a one-off command (i.e. creation of a
superuser, migration of the database, document export, ...).

The containers entrypoint is the `scripts/docker-entrypoint.sh` script.
This script verifies that the required permissions are set, remaps the
default users and/or groups id if required and installs additional
languages if the user wishes to.

After initialization, it analyzes the command the user supplied:

  - If the command starts with a slash, it is expected that the user
    wants to execute a binary file and the command will be executed
    without further intervention. (Using `exec` to effectively replace
    the started shell-script and not have any reaping-issues.)

  - If the command does not start with a slash, the command will be
    passed directly to the `manage.py` script without further
    modification. (Again using `exec`.)

The default command is set to `--help`.

If the user wants to execute a command that is not meant for `manage.py`
but doesn't start with a slash, the Docker `--entrypoint` parameter can
be used to circumvent the mechanics of `docker-entrypoint.sh`.

Further information can be found in `docs/setup.rst` and in
`docs/migrating.rst`.

For additional convenience, a `Dockerfile` has been added to the `docs/`
directory which allows for easy building and serving of the
documentation. This is documented in `docs/requirements.rst`.
2016-02-18 22:58:32 +01:00
Pit Kleyersburg c34d57a872 Detect image orientation if the OCR supports it
Fixes issue #47.
2016-02-18 09:37:13 +01:00
Pit Kleyersburg 46f8f492f5 Safely and non-randomly create scratch directory
Creating the scratch-files in `_get_grayscale` using a random integer is
for one inherently unsafe and can cause a collision. On the other hand,
it should be unnecessary given that the files will be cleaned up after
the OCR run.

Since we don't know if OCR runs might be parallel in the future, this
commit implements thread-safe and deterministic directory-creation.

Additionally it fixes the call to `_cleanup` by `consume`. In the
current implementation `_cleanup` will not be called if the last
consumed document failed with an `OCRError`, this commit fixes this.
2016-02-16 12:15:57 +01:00
Pit Kleyersburg 7b227ffa2f Fix matching if user supplied an empty value 2016-02-14 19:47:05 +01:00
Pit Kleyersburg aeab9a0e81 Detect language only on one page of PDF
To detect the language currently the entire document gets processed. If
a different language has been detected than the default one, the entire
document will be processed again for the new language.

This PR analyzes the middle page for its language and either processes
the remaining pages with the default language if it didn't differ, or
processes all pages for the new guessed language.

The amount of processed pages comes down from the worst case `2n` to
worst case `n+1`.
2016-02-14 17:55:13 +01:00
Pit Kleyersburg 20b2408dbb Ensure OCR_THREADS is integer, add documentation 2016-02-14 16:37:38 +01:00
Pit Kleyersburg f5beda9c56 Enable parallel OCR processing
At the moment, every page in a PDF will be processed one by one using
tesseract. Since the processing of a single page is independent from every
other page, one can make use of multi-core machines.

This PR introduces a multiprocessing pool to process multiple pages
simultaneously. The amount of threads to use can be specified in the
environment variable `PAPERLESS_OCR_THREADS`. This will default to the
number of cores/hyperthreads Python detects for your system.
2016-02-14 15:57:42 +01:00