Tomasz Sobczyk
9a4c7cf4e3
Add transform minimize_binpack for minimizing existing .binpack datasets. ( #4447 )
...
Takes advantage of the sample skipping rules that are used during training (capture, check, or VALUE_NONE).
Adds positions to keep continuity, which improves compression.
2023-04-25 19:21:29 +02:00
Tomasz Sobczyk
55ce07b773
Add additional checks for en-passant possiblity when fixing the erroneus ep flag from a fen.
2021-05-24 23:22:48 +02:00
Joost VandeVondele
ed8b381cce
Merge pull request #3496 from Sopel97/fix_discrep
...
Fix discrepancy for ep square between set and move in the binpack lib.
2021-05-24 22:43:14 +02:00
Tomasz Sobczyk
eac1d430b4
Add dedicated command for training data validation.
2021-05-24 19:43:36 +02:00
Tomasz Sobczyk
ca365f17ba
Fix discrepancy for ep square between set and move in the binpack lib.
...
basically, the binpack lib doesn't reset the epsquare after f7f5 in this 5kb1/5p2/2B3p1/1N1KP2p/3p1P2/2bP2P1/5r2/8 b - - 0 1 position, but it does reset it when passed the fen 5kb1/8/2B3p1/1N1KPp1p/3p1P2/2bP2P1/5r2/8 w - f6 0 50. Potentially creating a discrepancy based on whether the position was set directly or arrived at by a move
2021-05-24 19:17:42 +02:00
Tomasz Sobczyk
8365109972
Revert "Add additional checks for en-passant possiblity when fixing the erroneus ep flag from a fen."
...
This reverts commit 6afcdaa928 .
2021-04-05 12:37:11 +02:00
Tomasz Sobczyk
6afcdaa928
Add additional checks for en-passant possiblity when fixing the erroneus ep flag from a fen.
2021-04-03 23:17:55 +09:00
Tomasz Sobczyk
591609c262
Fix relation between halfmove and fullmove clocks.
2021-03-14 22:01:01 +09:00
Tomasz Sobczyk
b68cd36708
http://talkchess.com/forum3/viewtopic.php?f=2&t=76736&p=885254#p885254
2021-02-28 23:28:12 +09:00
Tomasz Sobczyk
d99ba07b81
Fix incorrect enpassant flag for moves read from uci format in the binpack lib
2020-12-11 00:31:32 +09:00
Tomasz Sobczyk
a71623f74c
Add explicit read head seek to the start of the binpack file. Otherwise on MACOS the read head is placed at the end when app is specified.
2020-11-13 19:56:36 +09:00
Tomasz Sobczyk
2a8576b804
Fix compilation issues.
2020-11-10 10:21:09 +09:00
Tomasz Sobczyk
5d88e7bce8
Add optional move validation to training data conversion. No longer rely on static initialization order for magics initialization.
2020-11-10 10:21:09 +09:00
Tomasz Sobczyk
886467e09f
Fix crash when trying to read a non existing .binpack file.
2020-10-22 20:01:55 +09:00
Tomasz Sobczyk
7d62b3f799
Store additional bits for fullmove clock and 50 more rule halfmove clock at the end of the bit stream. This change keeps backwards compatibility.
2020-10-11 20:59:27 +09:00
Matthies
50b4ff8354
Add missing include to make MSVC compile
2020-09-13 09:59:20 +09:00
Tomasz Sobczyk
c76bb34a96
Add convert UCI function that allows conversion of files between any of plain, bin, and binpack. Usage: convert infile outfile [append].
2020-09-11 09:36:24 +09:00
Tomasz Sobczyk
59402d4a6d
Include <climits> for CHAR_BIT. Test both formats in instrumented learn.
2020-09-10 21:19:37 +09:00
Tomasz Sobczyk
7e6901af27
Remove unused immintring. Include intrin.h only on some platforms, otherwise builtins are used.
2020-09-10 21:19:37 +09:00
Tomasz Sobczyk
53ad4d8b56
A speculative build fix for linux.
2020-09-10 21:19:37 +09:00
Tomasz Sobczyk
a7ca826593
MIT license/copyright notice in the library file.
2020-09-10 21:19:37 +09:00
Tomasz Sobczyk
585a5351bf
Fix warnings.
2020-09-10 21:19:37 +09:00
Tomasz Sobczyk
6b76ebc2ca
Support for binpack format in sfenreader in learner. Automatically detect file extension and choose the correct reader (bin or binpack)
2020-09-10 21:19:37 +09:00
Tomasz Sobczyk
020e66d2e6
Add "sfen_format" option in gensfen. Valid values are "bin" and "binpack". It determines the output format of the sfens. Binpack is a highly compressed formats for consecutive sfens. Extension is now determined by the used format, output_file_name should contain just the stem.
2020-09-10 21:19:37 +09:00