Skip to content

Commit

Permalink
Update projects_system_design.html
Browse files Browse the repository at this point in the history
  • Loading branch information
geospackle authored Jan 6, 2024
1 parent 273f7c8 commit 6e3d6b1
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion projects_system_design.html
Original file line number Diff line number Diff line change
Expand Up @@ -77,7 +77,7 @@
</div>
</a>
<p class="one-third column omega">
This diagram describes a general design for a backfill subsystem to replace a legacy service where transformations are live computed on each request. The new system leverages the legacy system's transformations library and stores the transformed data for quick retrieval. This poses a few challenges as data needs to be backfilled regularly as low frequency data is ingested and when there are code changes impacting transformations.
This diagram describes a general design for a backfill system of a feature service that consumes data at two frequencies. Lower frequency data is less accurate but highly available and consistent. Higher frequency data has frequent outages and anomalies. Therefore the data needs to be backfilled regularly as low frequency data is ingested. Targeted backfills are also executed and when there are code changes impacting transformations.
</p>

<hr class="two-thirds column alpha" style="border-top: 2px solid #bbb; padding: 10px">
Expand Down

0 comments on commit 6e3d6b1

Please sign in to comment.