 Tomasz Sobczyk
|
0bee8fef64
|
Don't unnecessarily copy the batch part.
|
2020-11-30 08:54:53 +09:00 |
|
|
Tomasz Sobczyk
|
e954b14196
|
Prefetch weights for feature transformer backprop to shared cache.
|
2020-11-30 08:54:53 +09:00 |
|
|
Tomasz Sobczyk
|
1c8495b54b
|
Remove handwritten saxpy because compilers optimize the second look anyway.
|
2020-11-30 08:54:53 +09:00 |
|
|
Tomasz Sobczyk
|
15c528ca7b
|
Prepare feature transformer learner.
|
2020-11-30 08:54:53 +09:00 |
|
|
Tomasz Sobczyk
|
4e1653d53a
|
Fix reliance on transitive includes for factorizers in trainer feature transformer. Add a file that includes all factorizers.
|
2020-11-14 12:35:12 +09:00 |
|
|
Tomasz Sobczyk
|
987b6c98d4
|
Move the observed feature collection to the threaded part now that it can be done safely.
|
2020-11-01 11:02:44 +09:00 |
|
|
Tomasz Sobczyk
|
e8907bcfc4
|
Replace omp in trainer_feature_transformer
|
2020-10-31 11:54:03 +09:00 |
|
|
Tomasz Sobczyk
|
c96743c5bd
|
Optimize feature transformer backpropagation stats.
|
2020-10-31 11:49:29 +09:00 |
|
|
Tomasz Sobczyk
|
2c10b1babc
|
Optimize feature transformer clipped relu.
|
2020-10-31 11:48:02 +09:00 |
|
|
Tomasz Sobczyk
|
a56d8124d8
|
Replace non-blas parts of trainers with our own blas-like routines.
|
2020-10-31 08:36:58 +09:00 |
|
|
Tomasz Sobczyk
|
ee0917a345
|
Pass ThreadPool to update_parameters, propagate, and backpropagate.
|
2020-10-29 09:21:19 +09:00 |
|
|
Tomasz Sobczyk
|
f1e96cab55
|
Align trainer arrays to cache line.
|
2020-10-29 09:12:50 +09:00 |
|
|
Tomasz Sobczyk
|
0e528995c2
|
Print avg bias/weight for affine trasform and feature transformer during training.
|
2020-10-25 22:18:28 +09:00 |
|
|
Tomasz Sobczyk
|
fe766f4f42
|
Additional output from layers during training.
|
2020-10-25 22:18:28 +09:00 |
|
|
Tomasz Sobczyk
|
2c477d76ec
|
Cleaner and more outputs during training initialization.
|
2020-10-25 22:18:28 +09:00 |
|
|
Tomasz Sobczyk
|
4b72658409
|
Synchronize printed info regions in the learner and sfen reader.
|
2020-10-25 22:18:28 +09:00 |
|
|
Tomasz Sobczyk
|
cf3edfed82
|
Improve info messages.
|
2020-10-25 22:18:28 +09:00 |
|
|
Tomasz Sobczyk
|
c49ae541c4
|
Add layer info for check_health. Print subsequent infos from the same scope with "-->" instead of "INFO:" for clarity.
|
2020-10-25 22:18:28 +09:00 |
|
|
Tomasz Sobczyk
|
8ddef320e6
|
Print an additional new line before calc_loss progress instead of after check_health in the feature transformer layer.
|
2020-10-25 22:18:28 +09:00 |
|
|
Tomasz Sobczyk
|
146a6b056e
|
PascalCase -> snake_case for consistency with the rest of the codebase.
|
2020-10-19 18:37:23 +09:00 |
|
|
Tomasz Sobczyk
|
69ea3d30b2
|
Move the extra new line to after check health.
|
2020-10-19 08:29:51 +09:00 |
|
|
Tomasz Sobczyk
|
c286f9cd7d
|
Cleanup trainer.
|
2020-10-19 08:29:51 +09:00 |
|
|
noobpwnftw
|
9827411b7c
|
Merge remote-tracking branch 'remotes/nodchip/master' into trainer
|
2020-09-24 21:45:28 +08:00 |
|
|
Tomasz Sobczyk
|
d33e7a9b07
|
Remove conditional compilation on EVAL_LEARN
|
2020-09-12 16:19:24 +02:00 |
|
|
nodchip
|
a6013557f2
|
Removed EVAL_NNUE macro.
|
2020-09-09 10:26:42 +09:00 |
|
|
nodchip
|
bf7d02578e
|
Fixed build errors.
|
2020-08-07 22:47:45 +09:00 |
|
|
nodchip
|
1c23465383
|
Moved the nnue folder.
|
2020-08-07 22:34:53 +09:00 |
|