Code

Added SmeLU#263

Code

Merged

blefaudeux merged 16 commits intofacebookresearch:mainfacebookresearch/xformers:mainfrom kashif:smooth-relukashif/xformers:smooth-reluCopy head branch name to clipboardMay 10, 2022

+51

Commits

Commits on Apr 7, 2022

• Added SmeLU

  kashif

  committed
  2b9c64e

  Copy full SHA for 2b9c64e

• added pytorch class

  kashif

  committed
  7bc8ef6

  Copy full SHA for 7bc8ef6

Commits on Apr 8, 2022

• tl.constexpr annotated arguments

  kashif

  committed
  bbbf95f

  Copy full SHA for bbbf95f

Commits on Apr 21, 2022

• Merge remote-tracking branch 'upstream/main' into smooth-relu

  kashif

  committed
  1982d2a

  Copy full SHA for 1982d2a

• do not change constant beta

  kashif

  committed
  1afc663

  Copy full SHA for 1afc663

Commits on Apr 22, 2022

• triton 2.0 fixes

  kashif

  committed
  07d4241

  Copy full SHA for 07d4241

Commits on Apr 28, 2022

• Merge remote-tracking branch 'upstream/main' into smooth-relu

  kashif

  committed
  e992661

  Copy full SHA for e992661

• make smelu beta=2.0 default

  kashif

  committed
  3ccf685

  Copy full SHA for 3ccf685

• use buffer for beta

  kashif

  committed
  3813fcb

  Copy full SHA for 3813fcb

• ignore mypy

  kashif

  committed
  8591819

  Copy full SHA for 8591819

• revert buffer

  kashif

  committed
  a47ab38

  Copy full SHA for a47ab38

Commits on May 5, 2022

• Merge remote-tracking branch 'upstream/main' into smooth-relu

  kashif

  committed
  83f1078

  Copy full SHA for 83f1078

• use beta=2.0 for now

  kashif

  committed
  94ed71b

  Copy full SHA for 94ed71b

• Merge remote-tracking branch 'upstream/main' into smooth-relu

  kashif

  committed
  b7209fd

  Copy full SHA for b7209fd

• Merge remote-tracking branch 'upstream/main' into smooth-relu

  kashif

  committed
  a70661e

  Copy full SHA for a70661e

Commits on May 10, 2022

• Merge remote-tracking branch 'upstream/main' into smooth-relu

  kashif

  committed
  4ddf413

  Copy full SHA for 4ddf413