Code

⚡ Source gdp adapter using dask#508

Code

Closed

kevinsantana11 wants to merge 19 commits intoCloud-Drift:mainCloud-Drift/clouddrift:mainfrom kevinsantana11:source-gdp-adapter-daskkevinsantana11/clouddrift:source-gdp-adapter-daskCopy head branch name to clipboard

+241-361

Commits

Commits on Sep 29, 2024

• ⚡ use dask to improve memory and compute scalability

  Show description for 99d166c
  kevinsantana11

  committed
  99d166c

  Copy full SHA for 99d166c

• typing, linting and formatting

  kevinsantana11

  committed
  c8800aa

  Copy full SHA for c8800aa

• Move dataset generation test and simplified it

  kevinsantana11

  committed
  b9c07ae

  Copy full SHA for b9c07ae

Commits on Sep 30, 2024

• sort by start date

  kevinsantana11

  committed
  710ad1f

  Copy full SHA for 710ad1f

Commits on Oct 1, 2024

• use proper fill values

  kevinsantana11

  committed
  022d1f1

  Copy full SHA for 022d1f1

• update metadata and documentation

  kevinsantana11

  committed
  666d057

  Copy full SHA for 666d057

• formatting

  kevinsantana11

  committed
  44a330a

  Copy full SHA for 44a330a

• use correct value (not type) for NaN

  kevinsantana11

  committed
  e50077f

  Copy full SHA for e50077f

Commits on Oct 2, 2024

• NaN is deprecated, use nan

  kevinsantana11

  committed
  0d79404

  Copy full SHA for 0d79404

Commits on Oct 4, 2024

• handle case where there's no metadata

  kevinsantana11

  committed
  5f4b727

  Copy full SHA for 5f4b727

Commits on Oct 8, 2024

• Add examples and information on using dask

  kevinsantana11

  committed
  66ba460

  Copy full SHA for 66ba460

• formatting

  kevinsantana11

  committed
  de40518

  Copy full SHA for de40518

• update wording

  kevinsantana11

  committed
  eaf865f

  Copy full SHA for eaf865f

• typo

  kevinsantana11

  committed
  0d764b2

  Copy full SHA for 0d764b2

Commits on Oct 23, 2024

• move import, fix naming and add back skip_download

  kevinsantana11

  committed
  abab73d

  Copy full SHA for abab73d

Commits on Nov 1, 2024

• dont load entire dataset and allow dask to lazy load the dataset as needed

  kevinsantana11

  committed
  82683db

  Copy full SHA for 82683db

• add ignore lint

  kevinsantana11

  committed
  00894d5

  Copy full SHA for 00894d5

• use nan over NaN

  kevinsantana11

  committed
  d16fa75

  Copy full SHA for d16fa75

• skip gdp_source as currently this takes a really long time

  kevinsantana11

  committed
  eb36d23

  Copy full SHA for eb36d23