🧠 NN: Aurora-24de239dff

[unixwizard]

🎯 Summary

This PR improves upon the last network by freezing everything and just increasing the WDL. The ratio now between evaluation and game result is 80:20.

🧬 Architecture and Hyper-Parameter

       IN          ACCUMULATOR                               HIDDEN                                    OUT
 ______________      _______      ______________________________________________________________      _____
| WHITE: (768) | -> | (384) | -> | ClippedReLU(0, 1) -> (384) \                                 |    |     |
|              |    |       |    |                             \                                |    |     |
|              |    |       |    |                              CONCATENATE(ColorToMove): (768) | -> | (1) |
|              |    |       |    |                             /                                |    |     |
| BLACK: (768) | -> | (384) | -> | ClippedReLU(0, 1) -> (384) /                                 |    |     |
 --------------      -------      --------------------------------------------------------------      -----

Codename: Aurora
ID: 24de239dff

Data: 1.7B FEN --- DEPTH: 9 (1.2B) + NODES: 5K (500M)
Batch Size: 750K
Epochs: 120
LR: 9e-3
LR Drop Step: 1
LR Drop Last: 120
LR Gamma: 0.985
WDL: 0.2
Scale: 400

👏 Acknowledgements

NA

📈 ELO

STC:

ELO   | 8.37 +- 5.73 (95%)
SPRT  | 10.0+0.10s Threads=1 Hash=16MB
LLR   | 3.00 (-2.94, 2.94) [0.00, 5.00]
GAMES | N: 7928 W: 2327 L: 2136 D: 3465

LTC:

ELO   | 5.56 +- 4.25 (95%)
SPRT  | 60.0+0.60s Threads=1 Hash=256MB
LLR   | 2.96 (-2.94, 2.94) [0.00, 5.00]
GAMES | N: 13240 W: 3531 L: 3319 D: 6390