Code

Experiments: validation of daaf#13

Code

Merged

guidj merged 77 commits intomainguidj/rl-daaf:mainfrom exp-validation-daafguidj/rl-daaf:exp-validation-daafCopy head branch name to clipboardApr 9, 2024

+13,480-975

Commits

Commits on Mar 3, 2024

• build: upgrades rlplg to 0.19.2

  guidj

  committed
  0b8ba16

  Copy full SHA for 0b8ba16

• refactor: upgrades usage of rlplg

  Show description for 9dc3738
  guidj

  committed
  9dc3738

  Copy full SHA for 9dc3738

• refactor: renames eval module for clarity

  Show description for ad1fd40
  guidj

  committed
  ad1fd40

  Copy full SHA for ad1fd40

• refactor: renames metrics module for generality

  guidj

  committed
  b095b72

  Copy full SHA for b095b72

• feat: adds control experiment pipeline

  guidj

  committed
  3b1be87

  Copy full SHA for 3b1be87

• refactor: local eval scripts

  guidj

  committed
  d9e1a20

  Copy full SHA for d9e1a20

• config: fixes experiments config for policyeval

  guidj

  committed
  46b6607

  Copy full SHA for 46b6607

• fix: algorithm names

  guidj

  committed
  d90ee78

  Copy full SHA for d90ee78

• feat: add control exp config

  guidj

  committed
  4fafbc0

  Copy full SHA for 4fafbc0

• fix: method calls in controljob

  guidj

  committed
  ed303e6

  Copy full SHA for ed303e6

• refactor: deletes unused reward mapper

  guidj

  committed
  c94d7c5

  Copy full SHA for c94d7c5

• wip: eval analysis

  guidj

  committed
  b77fc13

  Copy full SHA for b77fc13

• refactor: rename options mapper

  Show description for fea825a
  guidj

  committed
  fea825a

  Copy full SHA for fea825a

• refactor: makes daaf mpd with options lazy

  guidj

  committed
  3ef6257

  Copy full SHA for 3ef6257

• refactor: lazy daaf n-step update marker

  guidj

  committed
  66afb5d

  Copy full SHA for 66afb5d

• refactor: makes daaf n-step lazy

  guidj

  committed
  3a2453c

  Copy full SHA for 3a2453c

• feat: returns stats collector

  guidj

  committed
  74ba92f

  Copy full SHA for 74ba92f

• feat: adds return collectiont to experiments

  guidj

  committed
  a43ec4c

  Copy full SHA for a43ec4c

• refactor: log run and expid at the end

  guidj

  committed
  4f27dbd

  Copy full SHA for 4f27dbd

• feat: results agg for control

  guidj

  committed
  9324984

  Copy full SHA for 9324984

Commits on Mar 4, 2024

• build: upgrade rlplg to 0.19.3

  Show description for 2b2d780
  guidj

  committed
  2b2d780

  Copy full SHA for 2b2d780

• config: adds exploration to control experiments

  guidj

  committed
  3fc83ef

  Copy full SHA for 3fc83ef

• build: upgrades rlplg

  Show description for 1dbbe05
  guidj

  committed
  1dbbe05

  Copy full SHA for 1dbbe05

• refactor: episode_gen fn

  guidj

  committed
  a85c325

  Copy full SHA for a85c325

• fix: create_inital_values

  guidj

  committed
  e200335

  Copy full SHA for e200335

• feat: add param for metrics cal window

  guidj

  committed
  4ff4b2e

  Copy full SHA for 4ff4b2e

• refactor: avg returns over all episodes

  guidj

  committed
  21f16f6

  Copy full SHA for 21f16f6

• refactor: minor polishing

  guidj

  committed
  bcbdf0e

  Copy full SHA for bcbdf0e

Commits on Mar 7, 2024

• build: updates rlplg to 0.19.5

  Show description for 9a844da
  guidj

  committed
  9a844da

  Copy full SHA for 9a844da

• refactor: nstep method and exp method init

  guidj

  committed
  fb6eba1

  Copy full SHA for fb6eba1

Commits on Mar 9, 2024

• build: upgrades rlplg to 0.19.7

  guidj

  committed
  f850ff0

  Copy full SHA for f850ff0

• feat: control with options policy

  guidj

  committed
  9f66f2d

  Copy full SHA for 9f66f2d

• fix: fn call for egreedy options policy

  guidj

  committed
  833f232

  Copy full SHA for 833f232

Commits on Mar 10, 2024

• feat: algo args

  Show description for 7c64dc4
  guidj

  committed
  7c64dc4

  Copy full SHA for 7c64dc4

• exp: updates config and algorithm-args

  Show description for 80481e3
  guidj

  committed
  80481e3

  Copy full SHA for 80481e3

• fix: read_csv mutually exclusive args

  Show description for 0a6f5f0
  guidj

  committed
  0a6f5f0

  Copy full SHA for 0a6f5f0

• fix: add missing args to nstep spec with LEAST

  guidj

  committed
  c377921

  Copy full SHA for c377921

Commits on Mar 12, 2024

• feat: dict serialization for pyarrow

  Show description for c6ff4df
  guidj

  committed
  c6ff4df

  Copy full SHA for c6ff4df

• perf: reduce data logging volume

  guidj

  committed
  3974f59

  Copy full SHA for 3974f59

Commits on Mar 14, 2024

• build: deps in makefile

  guidj

  committed
  f8f620c

  Copy full SHA for f8f620c

• build: updates requirements files

  guidj

  committed
  26a26a2

  Copy full SHA for 26a26a2

• fix: export dict using json module

  guidj

  committed
  2fbc0d4

  Copy full SHA for 2fbc0d4

• exp: drops options of size 8

  Show description for ba12419
  guidj

  committed
  ba12419

  Copy full SHA for ba12419

• refactor: sets epsilon to 20%

  Show description for c91efaa
  guidj

  committed
  c91efaa

  Copy full SHA for c91efaa

Commits on Mar 15, 2024

• refactor: disable logging

  Show description for 8909cd2
  guidj

  committed
  8909cd2

  Copy full SHA for 8909cd2

• config: drop hanoi(disks=5)

  Show description for fc12a87
  guidj

  committed
  fc12a87

  Copy full SHA for fc12a87

• exp: drops n-step options expeirments

  Show description for db7b923
  guidj

  committed
  db7b923

  Copy full SHA for db7b923

• config: bundle runs into a single task

  Show description for 198ece9
  guidj

  committed
  198ece9

  Copy full SHA for 198ece9

• config: drop hanoi(5) from control exp

  guidj

  committed
  3041f84

  Copy full SHA for 3041f84

Commits on Mar 16, 2024

• refactor: swap list for dict

  Show description for c0f5605
  guidj

  committed
  c0f5605

  Copy full SHA for c0f5605

• refactor: update qtable using public API

  guidj

  committed
  0b8e2cd

  Copy full SHA for 0b8e2cd

• fix: out of bound index access in nstep mapper

  guidj

  committed
  8fb3b91

  Copy full SHA for 8fb3b91

• refactor: break runs into independent tasks

  Show description for 80c11ad
  guidj

  committed
  80c11ad

  Copy full SHA for 80c11ad

Commits on Mar 17, 2024

• Log experiment task

  guidj

  committed
  3a7eb51

  Copy full SHA for 3a7eb51

Commits on Mar 18, 2024

• refactor: refactor exp as asis

  guidj

  committed
  130b992

  Copy full SHA for 130b992

• refactor: log job start as debug

  guidj

  committed
  4830ecc

  Copy full SHA for 4830ecc

• refactor: batch tasks to reduce worker overhead

  guidj

  committed
  1fd494a

  Copy full SHA for 1fd494a

Commits on Mar 21, 2024

• deps: missing jupyter extensions

  guidj

  committed
  41a6ec4

  Copy full SHA for 41a6ec4

• build: chains format to pip-install

  Show description for 22714cf
  guidj

  committed
  22714cf

  Copy full SHA for 22714cf

• build: drop format dependency on pip install

  Show description for 2a54388
  guidj

  committed
  2a54388

  Copy full SHA for 2a54388

Commits on Mar 22, 2024

• analysis: control with daaf

  guidj

  committed
  7a3f189

  Copy full SHA for 7a3f189

• build: updates manifest

  guidj

  committed
  05028d3

  Copy full SHA for 05028d3

• feat: daaf traj mapper

  Show description for 625e61a
  guidj

  committed
  625e61a

  Copy full SHA for 625e61a

• feat: adds custom control methods

  guidj

  committed
  05f501e

  Copy full SHA for 05f501e

Commits on Mar 25, 2024

• feat: updates and adds new plots

  guidj

  committed
  2dcc530

  Copy full SHA for 2dcc530

• feat: updates notebooks with oen-step baseline

  guidj

  committed
  206f83f

  Copy full SHA for 206f83f

• build: updates deps for notebooks

  guidj

  committed
  bf9349a

  Copy full SHA for bf9349a

• wip: fix linting issues

  guidj

  committed
  fba80e2

  Copy full SHA for fba80e2

Commits on Apr 1, 2024

• build: updates deps

  guidj

  committed
  cdc681d

  Copy full SHA for cdc681d

Commits on Apr 9, 2024

• fix: linter issues

  guidj

  committed
  64bf243

  Copy full SHA for 64bf243

• config: updates config params

  guidj

  committed
  267d41e

  Copy full SHA for 267d41e

• refactor: drop default value for exploration

  guidj

  committed
  5962613

  Copy full SHA for 5962613

• fix: parsing existing dynaprog index

  guidj

  committed
  64f910e

  Copy full SHA for 64f910e

• fix: return iterator from policyeval fn

  guidj

  committed
  6937462

  Copy full SHA for 6937462

• fix: linter flagging return type in evaluate_policy

  guidj

  committed
  dad4ba1

  Copy full SHA for dad4ba1

• refactor: make formatting consistent with check

  guidj

  committed
  e13d501

  Copy full SHA for e13d501

• Bump version: 0.15.0 → 0.15.1

  guidj

  committed
  d7f9d96

  Copy full SHA for d7f9d96