• Martin Holst Swende's avatar
    core/rawdb: freezer batch write (#23462) · 794c6133
    Martin Holst Swende authored
    This change is a rewrite of the freezer code.
    
    When writing ancient chain data to the freezer, the previous version first encoded each
    individual item to a temporary buffer, then wrote the buffer. For small item sizes (for
    example, in the block hash freezer table), this strategy causes a lot of system calls for
    writing tiny chunks of data. It also allocated a lot of temporary []byte buffers.
    
    In the new version, we instead encode multiple items into a re-useable batch buffer, which
    is then written to the file all at once. This avoids performing a system call for every
    inserted item.
    
    To make the internal batching work, the ancient database API had to be changed. While
    integrating this new API in BlockChain.InsertReceiptChain, additional optimizations were
    also added there.
    Co-authored-by: 's avatarFelix Lange <fjl@twurst.com>
    794c6133
Name
Last commit
Last update
.github Loading commit data...
accounts Loading commit data...
build Loading commit data...
cmd Loading commit data...
common Loading commit data...
consensus Loading commit data...
console Loading commit data...
contracts/checkpointoracle Loading commit data...
core Loading commit data...
crypto Loading commit data...
docs Loading commit data...
eth Loading commit data...
ethclient Loading commit data...
ethdb Loading commit data...
ethstats Loading commit data...
event Loading commit data...
graphql Loading commit data...
internal Loading commit data...
les Loading commit data...
light Loading commit data...
log Loading commit data...
metrics Loading commit data...
miner Loading commit data...
mobile Loading commit data...
node Loading commit data...
p2p Loading commit data...
params Loading commit data...
rlp Loading commit data...
rpc Loading commit data...
signer Loading commit data...
swarm Loading commit data...
tests Loading commit data...
trie Loading commit data...
.dockerignore Loading commit data...
.gitattributes Loading commit data...
.gitignore Loading commit data...
.gitmodules Loading commit data...
.golangci.yml Loading commit data...
.mailmap Loading commit data...
.travis.yml Loading commit data...
AUTHORS Loading commit data...
COPYING Loading commit data...
COPYING.LESSER Loading commit data...
Dockerfile Loading commit data...
Dockerfile.alltools Loading commit data...
Makefile Loading commit data...
README.md Loading commit data...
SECURITY.md Loading commit data...
appveyor.yml Loading commit data...
circle.yml Loading commit data...
go.mod Loading commit data...
go.sum Loading commit data...
interfaces.go Loading commit data...
oss-fuzz.sh Loading commit data...