AndrovT 38e61663d8 Use block sparse input for the first layer. ...

Use block sparse input for the first fully connected layer on architectures with at least SSSE3.

Depending on the CPU architecture, this yields a speedup of up to 10%, e.g.

```
Result of 100 runs of 'bench 16 1 13 default depth NNUE'

base (...ockfish-base) =     959345  +/- 7477
test (...ckfish-patch) =    1054340  +/- 9640
diff                   =     +94995  +/- 3999

speedup        = +0.0990
P(speedup > 0) =  1.0000

CPU: 8 x AMD Ryzen 7 5700U with Radeon Graphics
Hyperthreading: on
```

Passed STC:
https://tests.stockfishchess.org/tests/view/6485aa0965ffe077ca12409c
LLR: 2.93 (-2.94,2.94) <0.00,2.00>
Total: 8864 W: 2479 L: 2223 D: 4162
Ptnml(0-2): 13, 829, 2504, 1061, 25

This commit includes a net with reordered weights, to increase the likelihood of block sparse inputs,
but otherwise equivalent to the previous master net (nn-ea57bea57e32.nnue).

Activation data collected with https://github.com/AndrovT/Stockfish/tree/log-activations, running bench 16 1 13 varied_1000.epd depth NNUE on this data. Net parameters permuted with https://gist.github.com/AndrovT/9e3fbaebb7082734dc84d27e02094cb3.

closes https://github.com/official-stockfish/Stockfish/pull/4612

No functional change

2023-06-12 20:41:27 +02:00

..

affine_transform_sparse_input.h

Use block sparse input for the first layer.

2023-06-12 20:41:27 +02:00

affine_transform.h

Made two specializations for affine transform easier to understand.

2023-04-10 09:29:52 +02:00

clipped_relu.h

Update copyright years

2023-01-02 19:07:38 +01:00

simd.h

Add support for ARM dot product instructions

2023-02-23 13:22:03 +01:00

sqr_clipped_relu.h

Avoid unnecessary string copies

2023-01-09 20:32:58 +01:00