remarks

Extract your marks (highlights, scribbles, annotations) and convert them to Markdown, PDF, PNG, and SVG.

remarks works with PDFs annotated on reMarkable™ paper tablets, both 1st and 2nd generation.

Please note that remarks is still highly experimental software. In any case, pull requests are warmly welcome!

Some use cases

• In: PDF highlighted on reMarkable → Out: PDF with parseable highlights
  Someone who highlights lots of PDFs (e.g., researchers, academics, etc) can export their highlights for processing with a reference management tool, like Zotero [#2].

• Extract highlighted text from PDF to Markdown
  Infovores of the world can export highlighted text to Markdown and insert them into their preferred "tool for networked thought", like Obsidian or Roam Research.

• Export annotated PDF pages to full-page images
  Sometimes having just the textual content is not enough, sometimes you need the actual (visual) context around your annotation. To help you in such situations, remarks can export each annotated PDF page to a PNG image file. Images can be easily uploaded or embedded anywhere, from personal websites to "tools for networked thought".

A visual example

Highlight and annotate PDFs with your Marker on your reMarkable tablet:

And then use remarks to export annotated pages to Markdown, PDF, PNG, or SVG on your computer.

PDF:

• The --targets pdf flag outputs a directory with single-page PDF files for each annotated page.
• The --combined_pdf flag outputs an all-in-one PDF file (the original PDF with all annotated pages).
• The --modified_pdf flag outputs an PDF file with just the annotated pages.

PNG:

Markdown:

WHAT IS LIFE?

Based on lectures delivered under the auspices of the Dublin Institute for Advanced Studies at Trinity College, Dublin, in February 1943

To the memory of My Parents

SVG:

• Please note that the SVG image file includes only the annotations, not the original PDF content.

Compatibility and dependencies

Because remarks depends only on PyMuPDF and Shapely, there is no need to install imagemagick, opencv, or any additional image library. Both PyMuPDF and Shapely have pre-built wheels [1, 2] for several platforms (macOS, Linux, Windows) and recent Python versions, so their installation should be easy and smooth for most setups.

I use remarks with a reMarkable 1 tablet running software version 2.5.0.27 on macOS Catalina (10.15.x) with CPython 3.8.x. I don't have other devices to test it thoroughly, but I expect remarks to work just fine in all common setups, including with remarkable 2.

Incidentally, please help me keep track of remarks compatibility across different setups:

• If it is working well for you, make a quick comment with your setup
• If you run into any problems, raise an issue

If OCRmyPDF is available on your computer, remarks may (optionally) use it to OCR PDFs before extracting their highlighted text.

Setup

To get remarks up and running on your local machine, follow the instructions below:

1. Copy files from reMarkable's xochitl directory to your computer

I find using rsync the easiest way to copy reMarkable's internal files from/to your tablet. Check out the repository lucasrla/remarkable-utils for the SSH & rsync setup I use (which includes automatic backups based on cron).

Alternatively, you can use the good old scp to copy the reMarkable's internal files from the tablet to your computer:

• On your reMarkable tablet, go to Menu > Settings > Help > About, then tap on Copyrights and licenses. In General information, right after the section titled "GPLv3 Compliance", there will be the username (root), password and IP addresses needed for SSH.

• Using these credentials, scp the contents of /home/root/.local/share/remarkable/xochitl from your reMarkable to a directory on your computer. (Copying may take a while depending on the size of your document collection and the quality of your wifi network.)

• To prevent any unintented interruptions, you can (optionally) switch off the Auto sleep feature in Menu > Settings > Battery before transferring your files.

2. Clone this repository and install the dependencies

Users on macOS Big Sur: If you use pip, it is best to upgrade it to >=20.3 via pip install --upgrade pip. Version 20.3 includes a new dependency resolver and a fix to an annoying issue with macOS Big Sur [#988]. If you use poetry, it seems the annoying issue is still there, follow [#3458] for updates. For more information on these issues and their impact to the installation of remarks, see [#7].

### 2.1 Clone
git clone https://github.com/lucasrla/remarks.git && cd remarks


### 2.2 Create a virtual environment

# I like pyenv [https://github.com/pyenv/pyenv] 
# and pyenv-virtualenv [https://github.com/pyenv/pyenv-virtualenv]:
pyenv virtualenv remarks && pyenv local remarks

# But of course you are free to use any of the many alternatives
# e.g. virtualenv, virtualenvwrapper


### 2.3 Install the dependencies

# Personally, I prefer using poetry [http://python-poetry.org] for managing dependencies:
poetry install

# But pip works fine as well:
pip install -r requirements.txt

Usage and Demo

Run remarks and check out what arguments are available:

python -m remarks --help

Next, for a quick hands-on experience of remarks, run the demo:

# Alan Turing's 1936 foundational paper (with a few highlights and scribbles)

# Original PDF file downloaded from:
# "On Computable Numbers, with an Application to the Entscheidungsproblem"
# https://londmathsoc.onlinelibrary.wiley.com/doi/abs/10.1112/plms/s2-42.1.230

python -m remarks demo/on-computable-numbers/xochitl demo/on-computable-numbers --targets png md pdf --combined_pdf

A few other examples:

# Assuming your `xochitl` files are at `~/backups/remarkable/xochitl/`

python -m remarks ~/backups/remarkable/xochitl/ example_1/ --ann_type highlights --targets md --combined_pdf

python -m remarks ~/backups/remarkable/xochitl/ example_2/ --targets png

Credits and Acknowledgements

• @JorjMcKie who wrote and maintains the great PyMuPDF

• u/stucule who posted to r/RemarkableTablet the first account (that I could find online) about reverse engineering .rm files

• @ax3l who wrote lines-are-rusty / lines-are-beautiful and also contributed to reverse engineering of .rm files

• @edupont, @Liblor, @florian-wagner, and @jackjackk for their contributions to rM2svg

• @ericsfraga, @jmiserez, @peerdavid, @phill777 and @lschwetlick for updating rM2svg to the most recent .rm format

• @lschwetlick who wrote rMsync and also two blog posts about reMarkable-related software [1, 2]

• @soulisalmed who wrote biff

• @benlongo who wrote remarkable-highlights

For more reMarkable resources, check out awesome-reMarkable and remarkablewiki.com.

License

remarks is Free Software distributed under the GNU General Public License v3.0.

Disclaimers

This is a hobby project of an enthusiastic reMarkable user. There is no warranty whatsoever. Use it at your own risk.

The author(s) and contributor(s) are not associated with reMarkable AS, Norway. reMarkable is a registered trademark of reMarkable AS in some countries. Please see https://remarkable.com for their products.