931070b65a
Elo Worth in King Danger
...
Adding the EloWorth for each term in King Danger.
Should be useful for simplifications, tuning patches, and new ideas.
closes https://github.com/official-stockfish/Stockfish/pull/3204
non-functional change
2020-11-02 19:41:17 +01:00
75e06a1c89
Optimize affine transform for SSSE3 and higher targets.
...
A non-functional speedup. Unroll the loops going over
the output dimensions in the affine transform layers by
a factor of 4 and perform 4 horizontal additions at a time.
Instead of doing naive horizontal additions on each vector
separately use hadd and shuffling between vectors to reduce
the number of instructions by using all lanes for all stages
of the horizontal adds.
passed STC of the initial version:
LLR: 2.95 (-2.94,2.94) {-0.25,1.25}
Total: 17808 W: 1914 L: 1756 D: 14138
Ptnml(0-2): 76, 1330, 5948, 1460, 90
https://tests.stockfishchess.org/tests/view/5f9d516f6a2c112b60691da3
passed STC of the final version after cleanup:
LLR: 2.95 (-2.94,2.94) {-0.25,1.25}
Total: 16296 W: 1750 L: 1595 D: 12951
Ptnml(0-2): 72, 1192, 5479, 1319, 86
https://tests.stockfishchess.org/tests/view/5f9df5776a2c112b60691de3
closes https://github.com/official-stockfish/Stockfish/pull/3203
No functional change
2020-11-02 19:41:17 +01:00
dfc7f88650
Update default net to nn-cb26f10b1fd9.nnue
...
Result of https://tests.stockfishchess.org/tests/view/5f9a06796a2c112b60691c0f tuning.
STC
LLR: 2.94 (-2.94,2.94) {-0.25,1.25}
Total: 53712 W: 5776 L: 5561 D: 42375
Ptnml(0-2): 253, 4282, 17604, 4431, 286
https://tests.stockfishchess.org/tests/view/5f9c7bbc6a2c112b60691d4d
LTC
LLR: 2.97 (-2.94,2.94) {0.25,1.25}
Total: 80184 W: 4007 L: 3739 D: 72438
Ptnml(0-2): 58, 3302, 33130, 3518, 84
https://tests.stockfishchess.org/tests/view/5f9d01f06a2c112b60691d87
closes https://github.com/official-stockfish/Stockfish/pull/3209
bench: 3517795
2020-11-01 08:02:40 +01:00
987b6c98d4
Move the observed feature collection to the threaded part now that it can be done safely.
2020-11-01 11:02:44 +09:00
c53be1b23f
Add specialized bitset for use in the trainer for observed features tracking.
2020-11-01 11:02:44 +09:00
e8907bcfc4
Replace omp in trainer_feature_transformer
2020-10-31 11:54:03 +09:00
db1b33d4ac
Optimize trainer clipped relu propagate
2020-10-31 11:52:51 +09:00
b5714c4084
Parallelize input slice trainer backprop.
2020-10-31 11:52:26 +09:00
941897ff2c
Optimize trainer clipped relu backpropagate.
2020-10-31 11:50:12 +09:00
c96743c5bd
Optimize feature transformer backpropagation stats.
2020-10-31 11:49:29 +09:00
2c10b1babc
Optimize feature transformer clipped relu.
2020-10-31 11:48:02 +09:00
7bedf6c5ab
Specify the whole evalsave message because otherwise the first evalsave/0 triggers it.
2020-10-31 08:36:58 +09:00
8c81bbd3db
Fix the counter in for_each_index_with_workers going out of scope before workers finish.
2020-10-31 08:36:58 +09:00
a56d8124d8
Replace non-blas parts of trainers with our own blas-like routines.
2020-10-31 08:36:58 +09:00
c56a4a36eb
Add our own blas-like routines that use stockfish's thread pool for parallelization.
2020-10-29 23:57:51 +09:00
ee0917a345
Pass ThreadPool to update_parameters, propagate, and backpropagate.
2020-10-29 09:21:19 +09:00
f1e96cab55
Align trainer arrays to cache line.
2020-10-29 09:12:50 +09:00
8fac468259
Add a cache line aligned allocator.
2020-10-29 09:12:50 +09:00
ec9e49e875
Add a HalfKA architecture (a product of K - king, and A - any piece) along with all required infrastructure. HalfKA doesn't discriminate kings compared to HalfKP. Keep old architecture as the default one.
2020-10-29 09:10:01 +09:00
0f6c08c73f
Do not skip non-recapture ttMove when in check
...
The qsearch() MovePicker incorrectly skips a non-recapture ttMove
when in check (if depth <= DEPTH_QS_RECAPTURES). This is clearly not
intended and can cause qsearch() to return a mate score when there
is no mate. Introduced in cad300c6596f0e#3171 and #3198 .
This PR fixes the bug by not skipping the non-recapture ttMove when in check.
Passed non-regression STC:
https://tests.stockfishchess.org/tests/view/5f9867ea6a2c112b60691b10
LLR: 2.98 (-2.94,2.94) {-1.25,0.25}
Total: 27112 W: 2943 L: 2842 D: 21327
Ptnml(0-2): 127, 2170, 8878, 2237, 144
Passed non-regression LTC:
https://tests.stockfishchess.org/tests/view/5f9967326a2c112b60691bb0
LLR: 2.99 (-2.94,2.94) {-0.75,0.25}
Total: 18392 W: 807 L: 738 D: 16847
Ptnml(0-2): 9, 655, 7802, 718, 12
closes https://github.com/official-stockfish/Stockfish/pull/3199
closes https://github.com/official-stockfish/Stockfish/pull/3198
Bench: 3870606
2020-10-28 23:40:37 +01:00
317fda2516
Cleanup eval saving and lr scheduling.
2020-10-28 23:08:05 +09:00
6328135264
Update default net to nn-2eb2e0707c2b.nnue
...
Optimization of the net weights of the 32 x 32 layer (1024 parameters) and net biases of the 512 x 32 layer (32 parameters) using SPSA.
Tuning of 32 x 32 Layer (800,000 games, 5 seconds time control):
https://tests.stockfishchess.org/tests/view/5f942040d3978d7e86f1aa05
Tuning of 512 x 32 Layer (80,000 games, 20 seconds time control):
https://tests.stockfishchess.org/tests/view/5f8f926d2c92c7fe3a8c608b
STC:
LLR: 2.96 (-2.94,2.94) {-0.25,1.25}
Total: 17336 W: 1918 L: 1754 D: 13664
Ptnml(0-2): 79, 1344, 5672, 1480, 93
https://tests.stockfishchess.org/tests/view/5f9882346a2c112b60691b34
LTC:
LLR: 2.94 (-2.94,2.94) {0.25,1.25}
Total: 37304 W: 1822 L: 1651 D: 33831
Ptnml(0-2): 27, 1461, 15501, 1640, 23
https://tests.stockfishchess.org/tests/view/5f98a4b36a2c112b60691b40
closes https://github.com/official-stockfish/Stockfish/pull/3201
Bench: 3403528
2020-10-28 08:13:34 +01:00
bde3505758
Bishop Pawns based on Files
...
Passed STC:
https://tests.stockfishchess.org/tests/view/5f8cc8145a4eacb45305da3c
LLR: 2.94 (-2.94,2.94) {-0.25,1.25}
Total: 132544 W: 27795 L: 27328 D: 77421
Ptnml(0-2): 2756, 15558, 29272, 15835, 2851
Passed LTC:
https://tests.stockfishchess.org/tests/view/5f8df614bacb75a4f9a4721e
LLR: 2.94 (-2.94,2.94) {0.25,1.25}
Total: 169608 W: 23257 L: 22622 D: 123729
Ptnml(0-2): 1408, 16316, 48758, 16877, 1445
closes https://github.com/official-stockfish/Stockfish/pull/3194
Bench: 4067106
2020-10-28 08:11:29 +01:00
680654b254
Add dots to output every epoch for progress visualization.
2020-10-28 09:36:43 +09:00
f81fa3d712
Replace global_learning_rate with learning_rate local to the learner and passed to update_parameters as a parameter.
2020-10-28 09:36:07 +09:00
cde6ec2bf2
Make all grad related functions in learn static. Pass calc_grad as a parameter.
2020-10-27 14:47:50 +09:00
e4868cb59e
Move setting learn search limits to learner.
2020-10-27 14:47:07 +09:00
c229929d26
Remove the position parameter from learn.
2020-10-27 00:35:43 +09:00
a8066cd4a9
Rename elmo lambdas
2020-10-27 00:33:58 +09:00
f7de49eb66
Create a collective parameter struct for learner.
2020-10-27 00:33:58 +09:00
ba390a7f9a
Print the used factorizer when intializing training.
2020-10-27 00:32:39 +09:00
e01397c674
Remove multi_think
2020-10-26 19:40:40 +09:00
e515f1f61f
Move SfenWriter to a separate file
2020-10-26 19:39:58 +09:00
65e443954a
Update expected gensfen finished responses.
2020-10-26 09:37:59 +09:00
03abfae41f
Reorder members, renaming.
2020-10-26 09:37:59 +09:00
6d4d20c4be
Cleaner printing and some renaming.
2020-10-26 09:37:59 +09:00
d77b3d176e
Always flush sfen writer at the end of gensfen and when it is destroyed.
2020-10-26 09:37:59 +09:00
21fac7c53c
A collective struct for gensfen parameters.
2020-10-26 09:37:59 +09:00
cb61dc9c9b
Make sfen writer a part of gensfen.
2020-10-26 09:37:59 +09:00
3f289546da
Make some gensfen members private.
2020-10-26 09:37:59 +09:00
821b655bc6
Move gensfen progress reporting from sfen writer to gensfen
2020-10-26 09:37:59 +09:00
af238fe132
Rewrite gensfen to use stockfish's thread pool.
2020-10-26 09:37:59 +09:00
0e528995c2
Print avg bias/weight for affine trasform and feature transformer during training.
2020-10-25 22:18:28 +09:00
fe766f4f42
Additional output from layers during training.
2020-10-25 22:18:28 +09:00
2c477d76ec
Cleaner and more outputs during training initialization.
2020-10-25 22:18:28 +09:00
b882423005
Bring back info for finished evalsave. Update tests with the new message.
2020-10-25 22:18:28 +09:00
4b72658409
Synchronize printed info regions in the learner and sfen reader.
2020-10-25 22:18:28 +09:00
d824bd8ec5
Add an overload for io manip in the logger.
2020-10-25 22:18:28 +09:00
54dd6a2407
Add logger with synchronized regions.
2020-10-25 22:18:28 +09:00
cf3edfed82
Improve info messages.
2020-10-25 22:18:28 +09:00
FauziAkram