Dynamically increase the open files limit if needed #14
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Codecov Report
@@ Coverage Diff @@
## main #14 +/- ##
==========================================
- Coverage 92.17% 91.58% -0.60%
==========================================
Files 4 4
Lines 537 582 +45
==========================================
+ Hits 495 533 +38
- Misses 37 42 +5
- Partials 5 7 +2
Continue to review full report at Codecov.
|
This was referenced Sep 10, 2024
tagatac
added a commit
that referenced
this pull request
Sep 10, 2024
**What is changing**: Check the OS-level open file limit (and adjust it if necessary) prior to writing PDF files. **Why this change is being made**: There is the potential for wkhtmltopdf to need many open files (see wkhtmltopdf/wkhtmltopdf#3081). This was fixed in #14, where it depended on the order of events: 1. Stage the PDF file, getting the number of images 2. Check and adjust the open file limit 3. Flush the PDF file to disk Number 3 was achieved via the call `defer outFile.Close()`: https://github.com/tagatac/bagoup/blob/86f9b32870d2127f3fd3e196cecfc24265cf8d87/write.go#L29 However, #29 removed `Close()` from the `OutFile` interface, collapsing `Stage()` and `Flush()` into a single function `Flush()` run prior to checking and adjusting the open file limit. **Related issue(s)**: Fixes #63 **Follow-up changes needed**: None AFAIK **Is the change completely covered by unit tests? If not, why not?**: Yes
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
wkhtmltopdf appears to keep all embedded image files open until the PDF is written: wkhtmltopdf/wkhtmltopdf#3081
As a consequence, we need to allow for large numbers of open files in the case that there are many embedded images.
Also, long URLs without dashes are not wrapped by default, decreasing the font size for the entire document.
word-wrap: break-wordfixes this.