Weekly Sync - 19 December 2023

[github-actions[bot]]

Please add agenda items below and give your weekly update in a comment. Thank you!

Agenda

[beniaminmunteanu]

Telemetry last week:

INFRA:

• created an AWS Lambda function that queries coingate API at every 24 hours (based on cloudwatch interval event)

• Lambda transforms the data to Rafiki Rates Service format, and stores it in a public S3 as a JSON.

Having the exchange rates available and the new gateway otel collector ECS cluster deployed, I turned to rafiki integration:

• new Telemetry Rates service (new instance of Rafiki's RatesService -> The one that queries ASE rates endpoint)
  this rates service has different cache setup (longer ttl) and queries the S3 exchange rates data instead of the ASE rates endpoint.

• Tried out implementing a laplacian distribution for data privacy, but was unable to find a good sensitivity parameter (it's domain-driven)

• Started reading whitepapers on Local Differential Privacy:
  microsoft approach 2017
  another microsoft paper on the previous subject
  further research
  RAPPOR

Currently stuck on (looking for alternative approaches):

The problem in applying Local Differential Privacy (LDP) algorithms described above is that in the local setup for each rafiki instance where we would do the α-rounding for memoization, we would need to know "m", which is the maximum field of possibilities that a counter value could have. In order to do a discretization, we would have to divide by this "m". However, unless maxPacketAmount is set and consistent on all rafiki telemetry-enabled instances in the network, we do not have any limits on amount of money being sent.