Commit Graph

  • cb812c742c Add [[nodiscard]] attributes to autograd functions. Tomasz Sobczyk 2020-11-29 22:52:21 +01:00
  • 26f19e1429 Make automatic differentiation node types constexpr. Tomasz Sobczyk 2020-11-29 22:50:49 +01:00
  • aec6017195 When forming an autograd expression only copy parts that are rvalue references, store references to lvalues. Tomasz Sobczyk 2020-11-29 19:06:31 +01:00
  • a5c20bee5b Apply gradient clipping. Tomasz Sobczyk 2020-11-29 17:57:06 +01:00
  • d103867558 Add memoization to the autograd expression evaluator. Tomasz Sobczyk 2020-11-29 17:27:45 +01:00
  • aa55692b97 Cross entropy loss. Tomasz Sobczyk 2020-11-29 17:08:22 +01:00
  • 539bd2d1c8 Replace the old loss/grad calculation completely. Tomasz Sobczyk 2020-11-29 12:18:02 +01:00
  • b71d1e8620 Pass the new loss function to update_parameters Tomasz Sobczyk 2020-11-29 11:55:15 +01:00
  • 5a58eb803a Loss func with autograd Tomasz Sobczyk 2020-11-29 11:55:00 +01:00
  • 541fb8177a More utility in autograd. Tomasz Sobczyk 2020-11-29 11:33:35 +01:00
  • 6ce0245787 Basic autograd Tomasz Sobczyk 2020-11-29 01:37:07 +01:00
  • 1322a9a5fd Prevent false sharing of num_calls counter in the shared input trainer. Fix current_operation not being local to the executing thread. Tomasz Sobczyk 2020-11-29 21:26:06 +01:00
  • 2aa7f5290e Fix comparison of integers with different signedness. Tomasz Sobczyk 2020-11-29 17:31:57 +01:00
  • a97b65eaef Fix compilation error with USE_BLAS Tomasz Sobczyk 2020-11-29 11:04:10 +01:00
  • 622e0b14c2 Remove superfluous example shuffling. Shuffling now only happens on reading. Tomasz Sobczyk 2020-11-25 23:13:06 +01:00
  • 34510dd08a Remove used examples asyncronously. Tomasz Sobczyk 2020-11-25 23:12:02 +01:00
  • 0bee8fef64 Don't unnecessarily copy the batch part. Tomasz Sobczyk 2020-11-25 22:59:34 +01:00
  • e954b14196 Prefetch weights for feature transformer backprop to shared cache. Tomasz Sobczyk 2020-11-25 22:43:42 +01:00
  • 8009973381 Special case for alpha=1 in saxpy, slight performance increase. Tomasz Sobczyk 2020-11-25 22:13:11 +01:00
  • 49b2dcb1f3 Preallocate memory for unique_features. Keep the training_features temporary buffer as a thread_local so we reuse the storage. Tomasz Sobczyk 2020-11-25 21:53:53 +01:00
  • 1c8495b54b Remove handwritten saxpy because compilers optimize the second look anyway. Tomasz Sobczyk 2020-11-25 20:37:38 +01:00
  • 15c528ca7b Prepare feature transformer learner. Tomasz Sobczyk 2020-11-22 21:38:11 +01:00
  • a3c78691a2 Prepare input slice trainer. Tomasz Sobczyk 2020-11-22 20:44:26 +01:00
  • 401fc0fbab Prepare clipped relu trainer. Tomasz Sobczyk 2020-11-22 20:16:49 +01:00
  • 774b023641 Add chunked for each with workers. Tomasz Sobczyk 2020-11-22 19:53:33 +01:00
  • cc11375f6d Skeleton for new evaluate learner Tomasz Sobczyk 2020-11-22 19:46:43 +01:00
  • 0d4b803b08 Prepare trainer affine transform. Tomasz Sobczyk 2020-11-22 19:23:30 +01:00
  • 4ea8572b6d Add single threaded sgemm. Tomasz Sobczyk 2020-11-22 18:27:51 +01:00
  • 7364006757 Update default net to nn-62ef826d1a6d.nnue SFisGOD 2020-11-28 23:14:34 +08:00
  • 2442ba2b0e Reductions simplification Unai Corzo 2020-11-29 13:52:36 +01:00
  • 045728a7da Remove piece lists syzygy1 2020-11-29 12:05:26 +01:00
  • 2bc4ae172a Update README.md Unai Corzo 2020-11-29 09:07:31 +01:00
  • 6c429c4d65 Search simplification Unai Corzo 2020-11-28 16:32:52 +01:00
  • 66da1e802c Remove bonus for killers. lonfom169 2020-11-26 09:40:54 -03:00
  • d6d6972a66 Refine rook penalty on closed files Lolligerhans 2020-11-20 18:09:41 +01:00
  • 9b7983a452 Cleaned up MakeIndex() mstembera 2020-11-17 15:58:25 -08:00
  • ef4fdb40f9 Merge pull request #254 from noobpwnftw/merge nodchip 2020-11-28 09:03:38 +09:00
  • 0b2ae6cb64 Merge remote-tracking branch 'remotes/official/master' into merge noobpwnftw 2020-11-28 06:19:16 +08:00
  • 92b14a5ba2 Add docs for transform. Tomasz Sobczyk 2020-11-26 18:06:00 +01:00
  • 89294e2e4f Add transform command. Add transform nudged_static subcommand. Tomasz Sobczyk 2020-11-26 17:28:09 +01:00
  • 190dd26b9f use classical for certain endgames. Vizvezdenec 2020-11-26 06:38:09 +01:00
  • 7615e3485e Calculate sum from first elements MaximMolchanov 2020-11-14 02:55:29 +02:00
  • 9fb6383ed8 Assorted search and eval parameter tune Unai Corzo 2020-11-24 17:06:30 +01:00
  • 027626db1e Small cleanups 13 Stéphane Nicolet 2020-11-12 14:05:28 +01:00
  • c12848d5ac Merge pull request #249 from noobpwnftw/merge nodchip 2020-11-23 19:55:23 +09:00
  • 45e3335ee8 Add missing docs. Tomasz Sobczyk 2020-11-22 18:08:14 +01:00
  • 9030020a85 Add smart_fen_skipping option to learn. Tomasz Sobczyk 2020-11-22 18:05:59 +01:00
  • f978e1bef0 Merge branch 'master' into merge noobpwnftw 2020-11-23 13:07:31 +08:00
  • ee13cfce67 Fix result assigned for a psvector when the positions are not continuous. Tomasz Sobczyk 2020-11-22 17:02:33 +01:00
  • 3cee6881ee Move the terminal position check to after qsearch, otherwise qsearch may end up in a terminal position. Tomasz Sobczyk 2020-11-22 17:18:06 +01:00
  • c29554a120 Merge remote-tracking branch 'remotes/official/master' into master noobpwnftw 2020-11-23 01:59:40 +08:00
  • d43cd104b6 Fix uninitialized variable when searching from a terminal position. Tomasz Sobczyk 2020-11-21 21:14:15 +01:00
  • 38d19eca14 Update instrumented.sh JWmer 2020-11-20 23:58:04 +01:00
  • 3975fc9c0d Update half_relative_ka.cpp JWmer 2020-11-20 15:49:02 +01:00
  • b0429237a8 Update half_ka.cpp JWmer 2020-11-20 15:48:18 +01:00
  • ea70e378cd Update a.cpp JWmer 2020-11-20 15:47:44 +01:00
  • 777c3a08ab Update README.md JWmer 2020-11-20 15:30:17 +01:00
  • f832aa6b6b Update evaluate.h JWmer 2020-11-20 15:19:36 +01:00
  • be4cd56146 Update half_kp.cpp JWmer 2020-11-20 15:17:27 +01:00
  • 021f47b00e Update half_relative_kp.cpp JWmer 2020-11-20 15:16:37 +01:00
  • 36c801699f Update k.cpp JWmer 2020-11-20 15:15:54 +01:00
  • 5b3e9b0eb3 Update p.cpp JWmer 2020-11-20 15:15:25 +01:00
  • c04c5b6658 Update nnue_common.h JWmer 2020-11-20 15:11:02 +01:00
  • b27c51b5cf Delete k-p-cr-ep_256x2-32-32.h JWmer 2020-11-20 15:06:45 +01:00
  • 72fee2f7a4 Delete k-p-cr_256x2-32-32.h JWmer 2020-11-20 15:06:32 +01:00
  • d9dcdc2b73 Delete k-p_256x2-32-32.h JWmer 2020-11-20 15:06:14 +01:00
  • 5f18c88b3d Docs for book in gensfen. Tomasz Sobczyk 2020-11-16 14:14:39 +01:00
  • e1dbad47ce Add support for opening book to gensfen. Tomasz Sobczyk 2020-11-16 14:13:34 +01:00
  • d4350a16f3 Add representation of an opening book. Tomasz Sobczyk 2020-11-16 11:32:42 +01:00
  • d793663188 Add docs for max_grad option for learn Tomasz Sobczyk 2020-11-16 00:43:43 +01:00
  • 3dbc45bdfc Add gradient clipping. Tomasz Sobczyk 2020-11-16 00:41:05 +01:00
  • 50358e26c7 Fix searching terminal nodes in gensfen. Tomasz Sobczyk 2020-11-13 22:28:28 +01:00
  • 00bc80c3c4 Add assume_quiet option to the learner. Tomasz Sobczyk 2020-11-09 19:27:53 +01:00
  • 00797a3d86 add option ensure_quiet for gensfen that makes the generated position quiet Tomasz Sobczyk 2020-11-09 19:21:27 +01:00
  • f9595828eb Rook Mobility Tweak FauziAkram 2020-11-11 20:56:29 +02:00
  • 9b930023fb Fix default value for batchsize in learn docs. Tomasz Sobczyk 2020-11-14 15:32:06 +01:00
  • 691da3bdad Add more information for factorizers at the start of training. Tomasz Sobczyk 2020-11-13 11:14:19 +01:00
  • 4e1653d53a Fix reliance on transitive includes for factorizers in trainer feature transformer. Add a file that includes all factorizers. Tomasz Sobczyk 2020-11-13 11:05:07 +01:00
  • 69bc3ef9be Output loss more often. Tomasz Sobczyk 2020-11-12 22:24:59 +01:00
  • a71623f74c Add explicit read head seek to the start of the binpack file. Otherwise on MACOS the read head is placed at the end when app is specified. Tomasz Sobczyk 2020-11-13 10:56:52 +01:00
  • 285bf7041a Increase reduction at root SFisGOD 2020-11-10 18:28:43 +01:00
  • b5781150ea Increase reduction based on the number of best move changes. lonfom169 2020-11-08 23:43:32 -03:00
  • 2a8576b804 Fix compilation issues. Tomasz Sobczyk 2020-11-09 19:08:28 +01:00
  • 8069963c56 Update convert docs. Tomasz Sobczyk 2020-11-04 20:23:36 +01:00
  • 5d88e7bce8 Add optional move validation to training data conversion. No longer rely on static initialization order for magics initialization. Tomasz Sobczyk 2020-11-04 20:17:58 +01:00
  • 392b529c3f Qsearch pruning: follow-up Stéphane Nicolet 2020-11-06 19:20:27 +01:00
  • 32edb1d009 Update default net to nn-c3ca321c51c9.nnue SFisGOD 2020-11-07 08:50:02 +08:00
  • ba35c88ab8 AVX-512 for smaller affine and feature transforms. Tomasz Sobczyk 2020-11-03 22:49:10 +01:00
  • 7fc47eeb6f Introducing King On File FauziAkram 2020-11-05 01:54:53 +02:00
  • 04a320666e Change handling the special case of a single legal move. Joost VandeVondele 2020-10-23 07:39:35 +02:00
  • 3f6451eff7 Manually align arrays on the stack Tomasz Sobczyk 2020-11-03 11:23:35 +01:00
  • a260c9a8a2 Fix incorrect pruning in qsearch J. Oster 2020-11-01 18:33:17 +01:00
  • 931070b65a Elo Worth in King Danger FauziAkram 2020-10-29 17:33:18 +03:00
  • 75e06a1c89 Optimize affine transform for SSSE3 and higher targets. Tomasz Sobczyk 2020-10-29 00:14:53 +01:00
  • dfc7f88650 Update default net to nn-cb26f10b1fd9.nnue mstembera 2020-10-30 13:45:40 -07:00
  • 987b6c98d4 Move the observed feature collection to the threaded part now that it can be done safely. Tomasz Sobczyk 2020-10-27 19:24:07 +01:00
  • c53be1b23f Add specialized bitset for use in the trainer for observed features tracking. Tomasz Sobczyk 2020-10-27 19:19:23 +01:00
  • e8907bcfc4 Replace omp in trainer_feature_transformer Tomasz Sobczyk 2020-10-27 11:57:45 +01:00
  • db1b33d4ac Optimize trainer clipped relu propagate Tomasz Sobczyk 2020-10-27 18:57:47 +01:00
  • b5714c4084 Parallelize input slice trainer backprop. Tomasz Sobczyk 2020-10-27 18:41:17 +01:00