8000 Tags · bryanwills/opendataloader-pdf · GitHub
[go: up one dir, main page]

Skip to content

Tags

Tags

v2.2.1

Toggle v2.2.1's commit message
fix: preserve whitespace chunk positions to restore missing spaces (o…

…pendataloader-project#358)

TextLineProcessor dropped whitespace chunks then relied solely on
physical gap detection to re-insert spaces. PDFs with tight kerning
(gap < threshold) lost all word spacing. Now the position of each
dropped whitespace chunk is recorded via an IdentityHashMap-backed Set
and used as an additional signal for space insertion alongside the
existing gap-based logic. Space BoundingBox coordinates are clamped
with min/max to handle overlapping chunks from tight kerning.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

v2.2.0

Toggle v2.2.0's commit message
fix(hybrid): stream upload to disk and reject negative --max-file-size

Objective: CodeRabbit flagged two valid issues — unbounded memory read
before size check, and negative values silently treated as unlimited.

Approach: Stream upload in 1MB chunks to temp file while checking size
incrementally, so large files never fully load into memory. Add argparse
validator to reject negative --max-file-size values.

Evidence: Started the server and tested all scenarios via curl:

| Scenario                      | Expected | Actual                                    |
|-------------------------------|----------|-------------------------------------------|
| 101MB, no limit (streaming)   | No 413   | ✅ Passed size check (500 from dummy)      |
| 101MB, --max-file-size 50     | 413      | ✅ 413: File size exceeds maximum (50MB)   |
| 10MB, --max-file-size 50      | No 413   | ✅ Passed size check                       |
| --max-file-size -1            | Reject   | ✅ ArgumentTypeError: must be >= 0         |

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

v2.1.1

Toggle v2.1.1's commit message
fix: add install and setup instructions to hybrid error message and C…

…LI help

Problem:
Users and AI agents encountering --hybrid for the first time cannot
self-resolve. The CLI description says "Hybrid backend for AI processing"
with no hint that a server is required. The connection error message
mentions the server command but omits the pip install step and --hybrid-url
for custom servers.

Solution:
- CLI --hybrid description: state "requires a running server" with quick
  start commands and --hybrid-url for remote servers
- Error message: add step-by-step install/start instructions and
  --hybrid-url hint for remote/custom port setups
- Run npm run sync to regenerate Python/Node.js bindings and docs

Verification:
- DoclingFastServerClientTest (10/10): new assertions verify install
  instructions and server start command are present in error output
- Subagent test: a fresh agent with no README/CLAUDE.md context resolved
  hybrid setup using only --help and error messages

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

v2.1.0

Toggle v2.1.0's commit message
fix: add install and setup instructions to hybrid error message and C…

…LI help

Problem:
Users and AI agents encountering --hybrid for the first time cannot
self-resolve. The CLI description says "Hybrid backend for AI processing"
with no hint that a server is required. The connection error message
mentions the server command but omits the pip install step and --hybrid-url
for custom servers.

Solution:
- CLI --hybrid description: state "requires a running server" with quick
  start commands and --hybrid-url for remote servers
- Error message: add step-by-step install/start instructions and
  --hybrid-url hint for remote/custom port setups
- Run npm run sync to regenerate Python/Node.js bindings and docs

Verification:
- DoclingFastServerClientTest (10/10): new assertions verify install
  instructions and server start command are present in error output
- Subagent test: a fresh agent with no README/CLAUDE.md context resolved
  hybrid setup using only --help and error messages

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

v2.0.2

Toggle v2.0.2's commit message
docs: add batch processing speed claim (100+ pages/sec on 8+ cores)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

v2.0.1

Toggle v2.0.1's commit message
fix(test): consolidate StreamInfo import, add xObjectName comment

Address review feedback:
- Move StreamInfo import into org.verapdf block (remove stray blank line)
- Add comment explaining null xObjectName in test StreamInfo construction

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

v2.0.0

Toggle v2.0.0's commit message
refactor: improve deprecation message clarity and strengthen Python test

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

v1.12.0

Toggle v1.12.0's commit message
fix: use zip -r for THIRD_PARTY and clarify air-gapped setup

- Fix zip command to recurse into THIRD_PARTY directory (review feedback)
- Clarify air-gapped environments require pre-installing dependencies

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

v1.11.3

Toggle v1.11.3's commit message
chore: fix high-severity minimatch ReDoS and update dependencies

Fix two high-severity Dependabot alerts for minimatch ReDoS (CVEs opendataloader-project#14, opendataloader-project#15):
- Update pnpm override from `<10.2.1` to `<10.2.3` (patched version is 10.2.3)
- minimatch is now resolved to 10.2.4

Also update other dependencies:
- Node.js: @types/node, @typescript-eslint/*, eslint, globals (minor/patch)
- Java: commons-cli 1.10.0 → 1.11.0
- Python: python-multipart minimum version >=0.0.6 → >=0.0.22 (security patch)

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

v1.11.2

Toggle v1.11.2's commit message
fix: add --force-ocr to non-English OCR examples

--ocr-lang alone doesn't enable forced OCR; both flags are needed
for scanned PDFs with non-English content.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
0