Images/Figures Downloading

[sanjana-7890]

Currently I can see that all images placeholders are coming at their correct place in markdown, but can we also have a feature like- if enabled can download those (all placeholders) to a particular directory on your local during the markdown conversion only (in parallel). Other libraries do have this feature but they lack in identifying some images/figures/charts.... but till now I could see Docling is identifying most of them that's why I believe this feature would be a plus over others.

[PeterStaar-IBM]

@sanjana-7890 Great idea: can you point us to these other libraries (want to inspect how they do it, before we get started)

[PeterStaar-IBM]

Super, yes, I think we could do that! We are releasing a v2 in the next days (or even today) and I think we could start adding that capability soon

[sanjana-7890]

great to hear

[karthiks-chipstack]

@PeterStaar-IBM Curious to know if this feature is available now ?

[PeterStaar-IBM]

@karthiks-chipstack Yes, it is showed here: https://github.com/DS4SD/docling/blob/main/docs/examples/export_figures.py

[zRich]

this example doesn't work.

Traceback (most recent call last):
File "H:\repos\zRich\zGenAI\docling\export_figures.py", line 85, in
main()
File "H:\repos\zRich\zGenAI\docling\export_figures.py", line 41, in main
conv_res = doc_converter.convert(input_doc_path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\zhaoz\miniconda3\envs\docling\Lib\site-packages\pydantic_internal_validate_call.py", line 38, in wrapper_function
return wrapper(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\zhaoz\miniconda3\envs\docling\Lib\site-packages\pydantic_internal_validate_call.py", line 111, in call
res = self.pydantic_validator.validate_python(pydantic_core.ArgsKwargs(args, kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\zhaoz\miniconda3\envs\docling\Lib\site-packages\docling\document_converter.py", line 170, in convert
return next(all_res)
^^^^^^^^^^^^^
File "C:\Users\zhaoz\miniconda3\envs\docling\Lib\site-packages\docling\document_converter.py", line 189, in convert_all
for conv_res in conv_res_iter:
^^^^^^^^^^^^^
File "C:\Users\zhaoz\miniconda3\envs\docling\Lib\site-packages\docling\document_converter.py", line 220, in _convert
for item in map(
^^^^
File "C:\Users\zhaoz\miniconda3\envs\docling\Lib\site-packages\docling\document_converter.py", line 264, in _process_document
conv_res = self._execute_pipeline(in_doc, raises_on_error=raises_on_error)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\zhaoz\miniconda3\envs\docling\Lib\site-packages\docling\document_converter.py", line 283, in _execute_pipeline
conv_res = pipeline.execute(in_doc, raises_on_error=raises_on_error)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\zhaoz\miniconda3\envs\docling\Lib\site-packages\docling\pipeline\base_pipeline.py", line 52, in execute
raise e
File "C:\Users\zhaoz\miniconda3\envs\docling\Lib\site-packages\docling\pipeline\base_pipeline.py", line 45, in execute
conv_res = self._assemble_document(conv_res)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\zhaoz\miniconda3\envs\docling\Lib\site-packages\docling\pipeline\standard_pdf_pipeline.py", line 169, in _assemble_document
conv_res.document.pages[page_no].image = ImageRef.from_pil(
^^^^^^^^^^^^^^^^^^
File "C:\Users\zhaoz\miniconda3\envs\docling\Lib\site-packages\docling_core\types\doc\document.py", line 473, in from_pil
return cls(
^^^^
File "C:\Users\zhaoz\miniconda3\envs\docling\Lib\site-packages\pydantic\main.py", line 214, in init
validated_self = self.pydantic_validator.validate_python(data, self_instance=self)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
pydantic_core._pydantic_core.ValidationError: 1 validation error for ImageRef
uri
Input should be a valid URL, empty host [type=url_parsing, input_value='data:image/png;base64,iV...bUKabsAAAAASUVORK5CYII=', input_type=str]
For further information visit https://errors.pydantic.dev/2.10/v/url_parsing

[cau-git]

@zRich This was fixed since, please retry.

[zRich]

thanks @cau-git