[Feature Request]On simple crc generation, check if the (commit version - 1)'s crc file present.

[huan233usc]

Feature request

Which Delta project/connector is this regarding?

• Spark
• Standalone
• Flink
• Kernel
• Other (fill in here)

Overview

Current implementation (#4134) generate crc_simple post commit hook at commit version only when (commit version - 1)'s crc is used for building the snapshot.

crc_simple will not present if retry happen.

One optimization could be -- if crc at (commit version - 1) is not present, try to read it and build new crc info. This will increase the chance that crc_simple got build

Motivation

Further details

Willingness to contribute

The Delta Lake Community encourages new feature contributions. Would you or another member of your organization be willing to contribute an implementation of this feature?

• Yes. I can contribute this feature independently.
• Yes. I would be willing to contribute this feature with guidance from the Delta Lake community.
• No. I cannot contribute this feature at this time.