 Tomasz Sobczyk
|
fafb9557a8
|
Get train loss from update_parameters.
|
2020-12-02 08:56:20 +09:00 |
|
|
Tomasz Sobczyk
|
256c4b55ec
|
Properly apply gradient norm clipping after it's scaled in the update_parameters.
|
2020-12-02 08:56:20 +09:00 |
|
|
Tomasz Sobczyk
|
539bd2d1c8
|
Replace the old loss/grad calculation completely.
|
2020-12-02 08:56:20 +09:00 |
|
|
Tomasz Sobczyk
|
b71d1e8620
|
Pass the new loss function to update_parameters
|
2020-12-02 08:56:20 +09:00 |
|
|
Tomasz Sobczyk
|
2aa7f5290e
|
Fix comparison of integers with different signedness.
|
2020-11-30 08:54:53 +09:00 |
|
|
Tomasz Sobczyk
|
622e0b14c2
|
Remove superfluous example shuffling. Shuffling now only happens on reading.
|
2020-11-30 08:54:53 +09:00 |
|
|
Tomasz Sobczyk
|
34510dd08a
|
Remove used examples asyncronously.
|
2020-11-30 08:54:53 +09:00 |
|
|
Tomasz Sobczyk
|
0bee8fef64
|
Don't unnecessarily copy the batch part.
|
2020-11-30 08:54:53 +09:00 |
|
|
Tomasz Sobczyk
|
49b2dcb1f3
|
Preallocate memory for unique_features. Keep the training_features temporary buffer as a thread_local so we reuse the storage.
|
2020-11-30 08:54:53 +09:00 |
|
|
Tomasz Sobczyk
|
cc11375f6d
|
Skeleton for new evaluate learner
|
2020-11-30 08:54:53 +09:00 |
|
|
noobpwnftw
|
c29554a120
|
Merge remote-tracking branch 'remotes/official/master' into master
Bench: 3597730
|
2020-11-23 04:27:12 +08:00 |
|
|
Tomasz Sobczyk
|
4e1653d53a
|
Fix reliance on transitive includes for factorizers in trainer feature transformer. Add a file that includes all factorizers.
|
2020-11-14 12:35:12 +09:00 |
|
|
Tomasz Sobczyk
|
ee0917a345
|
Pass ThreadPool to update_parameters, propagate, and backpropagate.
|
2020-10-29 09:21:19 +09:00 |
|
|
Tomasz Sobczyk
|
ec9e49e875
|
Add a HalfKA architecture (a product of K - king, and A - any piece) along with all required infrastructure. HalfKA doesn't discriminate kings compared to HalfKP. Keep old architecture as the default one.
|
2020-10-29 09:10:01 +09:00 |
|
|
Tomasz Sobczyk
|
317fda2516
|
Cleanup eval saving and lr scheduling.
|
2020-10-28 23:08:05 +09:00 |
|
|
Tomasz Sobczyk
|
680654b254
|
Add dots to output every epoch for progress visualization.
|
2020-10-28 09:36:43 +09:00 |
|
|
Tomasz Sobczyk
|
f81fa3d712
|
Replace global_learning_rate with learning_rate local to the learner and passed to update_parameters as a parameter.
|
2020-10-28 09:36:07 +09:00 |
|
|
Tomasz Sobczyk
|
cde6ec2bf2
|
Make all grad related functions in learn static. Pass calc_grad as a parameter.
|
2020-10-27 14:47:50 +09:00 |
|
|
Tomasz Sobczyk
|
ba390a7f9a
|
Print the used factorizer when intializing training.
|
2020-10-27 00:32:39 +09:00 |
|
|
Tomasz Sobczyk
|
2c477d76ec
|
Cleaner and more outputs during training initialization.
|
2020-10-25 22:18:28 +09:00 |
|
|
Tomasz Sobczyk
|
b882423005
|
Bring back info for finished evalsave. Update tests with the new message.
|
2020-10-25 22:18:28 +09:00 |
|
|
Tomasz Sobczyk
|
4b72658409
|
Synchronize printed info regions in the learner and sfen reader.
|
2020-10-25 22:18:28 +09:00 |
|
|
Tomasz Sobczyk
|
cf3edfed82
|
Improve info messages.
|
2020-10-25 22:18:28 +09:00 |
|
|
Tomasz Sobczyk
|
a351c1d65e
|
Add verbose flag to learn. Only print update parameters info when vebose=true
|
2020-10-25 22:18:28 +09:00 |
|
|
Tomasz Sobczyk
|
ec436d3dfd
|
Print some weight update stats
|
2020-10-25 22:18:28 +09:00 |
|
|
Tomasz Sobczyk
|
be3937c37b
|
Print layers and their indices during training initialization.
|
2020-10-25 22:18:28 +09:00 |
|
|
Tomasz Sobczyk
|
146a6b056e
|
PascalCase -> snake_case for consistency with the rest of the codebase.
|
2020-10-19 18:37:23 +09:00 |
|
|
Tomasz Sobczyk
|
497f689aa3
|
Cleanup nnue
|
2020-10-19 08:29:51 +09:00 |
|
|
noobpwnftw
|
9827411b7c
|
Merge remote-tracking branch 'remotes/nodchip/master' into trainer
|
2020-09-24 21:45:28 +08:00 |
|
|
noobpwnftw
|
411adab149
|
Merge remote-tracking branch 'remotes/nodchip/master' into trainer
|
2020-09-23 18:29:30 +08:00 |
|
|
noobpwnftw
|
a47a3bfc7c
|
Merge remote-tracking branch 'remotes/nodchip/master' into trainer
|
2020-09-19 02:14:17 +08:00 |
|
|
Tomasz Sobczyk
|
d33e7a9b07
|
Remove conditional compilation on EVAL_LEARN
|
2020-09-12 16:19:24 +02:00 |
|
|
nodchip
|
7bd4688747
|
Remove compile warnings.
|
2020-09-09 23:02:39 +09:00 |
|
|
noobpwnftw
|
675d336ebb
|
Merge branch 'master' into trainer
|
2020-09-09 16:08:49 +08:00 |
|
|
nodchip
|
a6013557f2
|
Removed EVAL_NNUE macro.
|
2020-09-09 10:26:42 +09:00 |
|
|
nodchip
|
4cc98d80f8
|
Replaced the utility function to create a directory to std::filesystem.
|
2020-09-07 18:56:41 +09:00 |
|
|
nodchip
|
bf7d02578e
|
Fixed build errors.
|
2020-08-07 22:47:45 +09:00 |
|
|
nodchip
|
1c23465383
|
Moved the nnue folder.
|
2020-08-07 22:34:53 +09:00 |
|