Code

Bulk Batch creation#1869

Code

Merged

zachgk merged 12 commits intodeepjavalibrary:masterdeepjavalibrary/djl:masterfrom patins1:IndicesBasedSubDatasetpatins1/djl:IndicesBasedSubDatasetCopy head branch name to clipboardSep 1, 2022

+797-92

Commits

Commits on Aug 27, 2022

• Bulk Batch creation

  

  patins1

  authored and

  KexinFeng

  committed
  b3b28ec

  Copy full SHA for b3b28ec

• execute "take" instead of "pick" for mxnet if requested

  

  patins1

  authored and

  KexinFeng

  committed
  1e57b8b

  Copy full SHA for 1e57b8b

• more convenience methods to retrieve a sub dataset

  

  patins1

  authored and

  KexinFeng

  committed
  40cd23e

  Copy full SHA for 40cd23e

• Update api/src/main/java/ai/djl/training/dataset/BulkDataIterable.java

  KexinFeng

  committed
  9c013f0

  Copy full SHA for 9c013f0

• revert initial take implementation

  

  patins1

  authored and

  KexinFeng

  committed
  f416562

  Copy full SHA for f416562

• use new take implementation

  

  patins1

  authored and

  KexinFeng

  committed
  75d4249

  Copy full SHA for 75d4249

• use NDIndexFullTake approach

  patins1

  committed
  06e93bc

  Copy full SHA for 06e93bc

Commits on Aug 28, 2022

• added test for BulkDataIterable

  patins1

  committed
  5b3e0e1

  Copy full SHA for 5b3e0e1

• tidy up test for LinearCollection

  patins1

  committed
  9430665

  Copy full SHA for 9430665

• test isRange

  patins1

  committed
  5f3ebfb

  Copy full SHA for 5f3ebfb

• add index test and clean code

  KexinFeng

  committed
  8ffac00

  Copy full SHA for 8ffac00

• add warning

  KexinFeng

  committed
  76364ff

  Copy full SHA for 76364ff