Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[wip] e35 #7189

Closed
wants to merge 4,128 commits into from
Closed

[wip] e35 #7189

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
4128 commits
Select commit Hold shift + click to select a range
7d6a8fb
move filesItem to files_item.go
AskAlexSharov Apr 10, 2024
fd5905f
move filesItem to files_item.go
AskAlexSharov Apr 10, 2024
e53ae82
move filesItem to files_item.go
AskAlexSharov Apr 10, 2024
aa54be4
rename files to dirtyFiles
AskAlexSharov Apr 10, 2024
7213b5c
rename files to dirtyFiles
AskAlexSharov Apr 10, 2024
9309e88
merge devel
AskAlexSharov Apr 10, 2024
3321e36
rename files to dirtyFiles
AskAlexSharov Apr 10, 2024
27f0de1
e3 dev docs add research section
AskAlexSharov Apr 10, 2024
2eb7307
add headers to torrent and rclone config
mh0lt Apr 10, 2024
d327928
fix dup complaint
mh0lt Apr 10, 2024
325514f
gnosis - fix db grow problem
AskAlexSharov Apr 11, 2024
7b26cc9
Merge branch 'devel' into e35
AskAlexSharov Apr 11, 2024
81dd3a5
grafana version up
AskAlexSharov Apr 11, 2024
0fe0073
merge devel
AskAlexSharov Apr 11, 2024
bf5bcce
grafana: prune timings to support rate_interval
AskAlexSharov Apr 11, 2024
06a6547
up roaring version
AskAlexSharov Apr 11, 2024
4d6124f
up crypto lib
AskAlexSharov Apr 11, 2024
0838a75
Merge remote-tracking branch 'origin/download_headers' into e35
AskAlexSharov Apr 11, 2024
c3824cf
save
AskAlexSharov Apr 11, 2024
f6f54c4
check webseeds has files declared in manifest (#9853)
awskii Apr 11, 2024
823d322
merge devel
AskAlexSharov Apr 11, 2024
65072fd
merge devel
AskAlexSharov Apr 12, 2024
d48bac5
no grafana staking
AskAlexSharov Apr 12, 2024
03a83d8
no grafana staking
AskAlexSharov Apr 12, 2024
5f515e1
grafana: more mean calcs
AskAlexSharov Apr 12, 2024
f86bbb9
gnosis fix nil rollback in tests
AskAlexSharov Apr 12, 2024
42cd803
gnosis fix nil rollback in tests
AskAlexSharov Apr 12, 2024
07dc954
merge devel
AskAlexSharov Apr 12, 2024
4cae513
renaming step2 (#9921)
AskAlexSharov Apr 12, 2024
48bfa82
merge devel
AskAlexSharov Apr 12, 2024
8ca07dc
merge devel
AskAlexSharov Apr 12, 2024
da299c1
sepolia e3 v2 files
AskAlexSharov Apr 14, 2024
7887719
Merge branch 'devel' into e35
AskAlexSharov Apr 15, 2024
a0af6c2
save
AskAlexSharov Apr 15, 2024
b816a01
bor-mainnet: step 2496, blk 5.52M
AskAlexSharov Apr 15, 2024
0cef180
save
AskAlexSharov Apr 15, 2024
20aa5c2
save
AskAlexSharov Apr 15, 2024
7c83102
merge devel
AskAlexSharov Apr 15, 2024
aa1966e
e35: gasPool.Reset() add blob limit param (#9938)
AskAlexSharov Apr 15, 2024
f02ae4b
skip non-seedable files in manifest-verify
AskAlexSharov Apr 15, 2024
c7c39be
skip non-seedable files in manifest-verify
AskAlexSharov Apr 15, 2024
6a66df3
rename to snapLock
AskAlexSharov Apr 15, 2024
1cc3344
merge devel
AskAlexSharov Apr 15, 2024
f406bd8
save
AskAlexSharov Apr 15, 2024
889b41e
save
AskAlexSharov Apr 15, 2024
1601c4a
Merge branch 'allow_relative_path' into e35
AskAlexSharov Apr 15, 2024
d5fcefd
Merge branch 'ws_no_default_list' into e35
AskAlexSharov Apr 15, 2024
8f11915
Merge branch 'manifest_verify_skip_seedable' into e35
AskAlexSharov Apr 15, 2024
b03d25f
Merge branch 'devel' into e35
awskii Apr 15, 2024
f5750c0
save
AskAlexSharov Apr 16, 2024
82e9e1e
e35: more info about txnIdx (#9936)
AskAlexSharov Apr 16, 2024
cac08b0
dbg: HeaderInserter
AskAlexSharov Apr 16, 2024
c3ca076
improve logging
AskAlexSharov Apr 16, 2024
7dee288
e35: remove `e3`/`e4` build tags and `make test3` targets (#9935)
AskAlexSharov Apr 16, 2024
0e39e57
readme or users
AskAlexSharov Apr 16, 2024
3224f66
more bor mainnet e2
AskAlexSharov Apr 16, 2024
b807437
E35 fix npe accumulate (#9954)
awskii Apr 17, 2024
cef5f77
merge devel
AskAlexSharov Apr 17, 2024
81dc8da
merge devel
AskAlexSharov Apr 17, 2024
6592e16
fix WithReadAhead logic
AskAlexSharov Apr 17, 2024
80c4f3f
better logging
AskAlexSharov Apr 17, 2024
869ddb7
disable d.size check
AskAlexSharov Apr 17, 2024
0dc9015
readme improve
AskAlexSharov Apr 17, 2024
cfc639d
mumbai v2
AskAlexSharov Apr 17, 2024
730b621
merge devel
AskAlexSharov Apr 17, 2024
e360dad
merge devel
AskAlexSharov Apr 17, 2024
9da9b88
temporary disable TestDecompressor_OpenCorrupted
AskAlexSharov Apr 17, 2024
dd3e16a
e35: if finish < block_snaps then process this blocks without global …
AskAlexSharov Apr 17, 2024
90e52d9
save
AskAlexSharov Apr 17, 2024
888e84c
merge devel
AskAlexSharov Apr 18, 2024
e9d6c6e
enable snaps for all chain names
AskAlexSharov Apr 18, 2024
7deb027
linter fix
AskAlexSharov Apr 18, 2024
b91ee53
linter fix
AskAlexSharov Apr 18, 2024
314b2df
mainnet step 1472
AskAlexSharov Apr 18, 2024
071321f
merge https://github.com/ledgerwatch/erigon/pull/9970
awskii Apr 18, 2024
c11fe05
merge https://github.com/ledgerwatch/erigon/pull/9970
AskAlexSharov Apr 18, 2024
0002fc1
merge https://github.com/ledgerwatch/erigon/pull/9970
AskAlexSharov Apr 18, 2024
949113c
save
AskAlexSharov Apr 18, 2024
4805694
save
AskAlexSharov Apr 18, 2024
cb10b09
merge devel
AskAlexSharov Apr 18, 2024
91580b2
OptimisticReopen - must be used in backend.go (Erigon)
AskAlexSharov Apr 18, 2024
cac82df
don't return err from openFiles
AskAlexSharov Apr 18, 2024
014aeff
"erigon snapsots retire": to build all files (#9979)
AskAlexSharov Apr 18, 2024
e7ca122
merge devel
AskAlexSharov Apr 18, 2024
67eb9ad
Merge branch 'devel' into e35
AskAlexSharov Apr 18, 2024
d9cab0e
Merge branch 'devel' into e35
AskAlexSharov Apr 19, 2024
e94c8df
Merge branch 'devel' into e35
AskAlexSharov Apr 19, 2024
0b8a710
save
AskAlexSharov Apr 19, 2024
422da0e
save
AskAlexSharov Apr 19, 2024
77fd6b4
save
AskAlexSharov Apr 19, 2024
d38bbf5
Exec3: remove blocking index building
AskAlexSharov Apr 19, 2024
afb1d5d
OpenFolder: add ctx to err
AskAlexSharov Apr 19, 2024
00acf14
step towards atomic fs
AskAlexSharov Apr 19, 2024
00b8a3b
dedicated fsyncDB() func - for clarity and docs
AskAlexSharov Apr 19, 2024
b2cadca
Merge branch 'dl_fsync_more' into e35
AskAlexSharov Apr 19, 2024
5621c72
rename filesLock to dirtyFilesLock
AskAlexSharov Apr 19, 2024
513ce0f
save
AskAlexSharov Apr 19, 2024
28b6608
eth-mainnet: fix files
AskAlexSharov Apr 19, 2024
dd26a37
save
AskAlexSharov Apr 19, 2024
dc7753d
save
AskAlexSharov Apr 19, 2024
2a0096e
integration stage_exec: to not build missed indices at startup
AskAlexSharov Apr 19, 2024
7450910
merge devel
AskAlexSharov Apr 19, 2024
dd5e00d
rename experimental.history.v3 to history.v3
AskAlexSharov Apr 20, 2024
26fc87d
remove flag --snapshots and --history.v3 (--snap.stop will still work)
AskAlexSharov Apr 20, 2024
075f79e
save
AskAlexSharov Apr 20, 2024
5c47e5d
build indices before produce
AskAlexSharov Apr 20, 2024
5a08240
fs: to be less smart - it's up to APP create file or not
AskAlexSharov Apr 20, 2024
1b19522
Merge branch 'dl_fs_no_brain' into e35
AskAlexSharov Apr 20, 2024
23e6e6f
save
AskAlexSharov Apr 20, 2024
55c3887
save
AskAlexSharov Apr 20, 2024
845bc3c
save
AskAlexSharov Apr 20, 2024
59e68d6
save
AskAlexSharov Apr 20, 2024
96c17ff
save
AskAlexSharov Apr 20, 2024
bdbd776
save
AskAlexSharov Apr 20, 2024
f7fec0a
merge devel
AskAlexSharov Apr 21, 2024
6ef03d8
merge devel
AskAlexSharov Apr 21, 2024
6413f3a
save
AskAlexSharov Apr 21, 2024
583483b
Merge branch 'devel' into dl_dbg_upgrade
AskAlexSharov Apr 22, 2024
c47ac36
Merge branch 'devel' into e35
AskAlexSharov Apr 22, 2024
4378014
rename agg_v3 to agg
AskAlexSharov Apr 22, 2024
8d07b54
rename agg_v3 to agg
AskAlexSharov Apr 22, 2024
07b2704
e35: remove system contract (#10016)
AskAlexSharov Apr 22, 2024
e27651e
attempt to fix TestNonceFromAddress
AskAlexSharov Apr 22, 2024
9331216
attempt to fix TestNonceFromAddress
AskAlexSharov Apr 22, 2024
6c7ae47
attempt to fix TestNonceFromAddress
AskAlexSharov Apr 22, 2024
84922bd
attempt to fix TestNonceFromAddress
AskAlexSharov Apr 22, 2024
a92ba81
e35: avoid using `dirtyFilesMinimaxTxNum` in prune/build methods (#10…
AskAlexSharov Apr 22, 2024
e153992
Merge branch 'devel' into e35
AskAlexSharov Apr 22, 2024
15e7b57
skip CoherentCache tests
AskAlexSharov Apr 22, 2024
c6e3ff9
fix `testDbAndAggregatorv3`
AskAlexSharov Apr 22, 2024
ba2128a
fix `testDbAndAggregatorv3`
AskAlexSharov Apr 22, 2024
69fa01f
more docs for visibleFiles field (#10013)
AskAlexSharov Apr 22, 2024
b84d582
linter fix
AskAlexSharov Apr 22, 2024
542e888
fix initial download
AskAlexSharov Apr 22, 2024
f6c9629
fix initial download
AskAlexSharov Apr 22, 2024
ce9a09f
E35 skip frozen blocks processing during mock test (#10021)
awskii Apr 22, 2024
e6945f1
e35 add downloader mock (#10022)
awskii Apr 22, 2024
a5f22a2
merge devel
AskAlexSharov Apr 23, 2024
bec49d9
save
AskAlexSharov Apr 23, 2024
e8e151a
fix clconfig for bor
AskAlexSharov Apr 23, 2024
92e4f68
bor-mainnet: 56.1M ,step 2560
AskAlexSharov Apr 23, 2024
407051a
save
AskAlexSharov Apr 23, 2024
682375c
gnosis 33.5M
AskAlexSharov Apr 23, 2024
ad8394a
gnosis 33.5M
AskAlexSharov Apr 23, 2024
65a952e
save
AskAlexSharov Apr 23, 2024
f0ecc08
Merge branch 'devel' into e35
AskAlexSharov Apr 23, 2024
30c2009
Merge branch 'devel' into e35
AskAlexSharov Apr 24, 2024
172add8
save
AskAlexSharov Apr 24, 2024
32f7a11
save
AskAlexSharov Apr 24, 2024
31493d0
save
AskAlexSharov Apr 24, 2024
7591c9d
save
AskAlexSharov Apr 24, 2024
512bf5a
save
AskAlexSharov Apr 24, 2024
1e88b8e
save
AskAlexSharov Apr 24, 2024
2fd213c
save
AskAlexSharov Apr 24, 2024
900d8ad
enable http for 1 request
AskAlexSharov Apr 24, 2024
3466e3e
save
AskAlexSharov Apr 24, 2024
d20a701
gi Merge branch 'e35_dbg_blk_not_found' into e35
AskAlexSharov Apr 24, 2024
a375903
Merge branch 'devel' into e35
AskAlexSharov Apr 24, 2024
d7f09d2
up torrent lib
AskAlexSharov Apr 24, 2024
b22ef8e
up torrent lib
AskAlexSharov Apr 24, 2024
4af6fab
eth/stagedsync: add skeleton for new polygon sync stage (#10047)
taratorio Apr 24, 2024
448d564
e3 etl collate history (#9930)
awskii Apr 25, 2024
16eb892
merge devel
AskAlexSharov Apr 25, 2024
935dba1
merge devel
AskAlexSharov Apr 25, 2024
ee602b0
merge devel
AskAlexSharov Apr 25, 2024
fb9f3c5
Merge branch 'devel' into dl_dbg_upgrade
AskAlexSharov Apr 25, 2024
3b849c4
Merge branch 'dl_dbg_upgrade' into e35
AskAlexSharov Apr 25, 2024
84879b7
roaring version up
AskAlexSharov Apr 25, 2024
5625836
save
AskAlexSharov Apr 25, 2024
aff444a
.lock to store whiteList instead of blackList
AskAlexSharov Apr 25, 2024
5e6d128
save
AskAlexSharov Apr 25, 2024
1b8d926
save
AskAlexSharov Apr 25, 2024
125f378
torrent lib tag
AskAlexSharov Apr 25, 2024
850ba5a
Revert "Added downloader request count (#10036)"
AskAlexSharov Apr 25, 2024
26c229c
Merge remote-tracking branch 'origin/revert-10036-di_add_request_coun…
AskAlexSharov Apr 25, 2024
8a32a24
save
AskAlexSharov Apr 25, 2024
9031e5d
merge dl_dbg_upgrade
AskAlexSharov Apr 25, 2024
6d0f0e2
merge dl_dbg_upgrade
AskAlexSharov Apr 25, 2024
7162b43
save
AskAlexSharov Apr 25, 2024
abad420
save
AskAlexSharov Apr 25, 2024
a58aae8
save
AskAlexSharov Apr 25, 2024
f7814f2
Merge branch 'dl_dbg_upgrade' into e35
AskAlexSharov Apr 25, 2024
74dbfb5
save
AskAlexSharov Apr 25, 2024
c5d3ff4
cleanup stage senders
AskAlexSharov Apr 25, 2024
18eb78e
save
AskAlexSharov Apr 25, 2024
d3898b9
merge devel
AskAlexSharov Apr 26, 2024
802eeab
save
AskAlexSharov Apr 26, 2024
5e2bf57
merge devel
AskAlexSharov Apr 26, 2024
ca911f2
save
AskAlexSharov Apr 26, 2024
d5d6c52
merge devel
AskAlexSharov Apr 26, 2024
19d3fb4
actions/checkout@v4
AskAlexSharov Apr 26, 2024
6601bf9
actions/checkout@v4
AskAlexSharov Apr 26, 2024
de93760
mainnet v2: remove couple last files - because seems something broken
AskAlexSharov Apr 26, 2024
541ec40
merge devel
AskAlexSharov Apr 26, 2024
b200ec8
Merge branch 'devel' into e35
AskAlexSharov Apr 27, 2024
4965dd9
save
AskAlexSharov Apr 27, 2024
1035566
save
AskAlexSharov Apr 27, 2024
06a71ee
Merge branch 'devel' into e35
AskAlexSharov Apr 27, 2024
8248e3a
E35 bt cleanup (#10084)
awskii Apr 27, 2024
45be46c
bor-mainnet: 56.2M
AskAlexSharov Apr 27, 2024
310bec1
merge devel
AskAlexSharov Apr 28, 2024
26970e0
merge devel
AskAlexSharov Apr 28, 2024
74588d0
save
AskAlexSharov Apr 28, 2024
9e7e88d
e35: discard comm history by default (in not on chain-tip) (#10095)
AskAlexSharov Apr 28, 2024
b024add
e35: mdbx v0_12_10 (#9617)
AskAlexSharov Apr 28, 2024
7f82fe4
save
AskAlexSharov Apr 28, 2024
b7b3abf
merge devel
AskAlexSharov Apr 28, 2024
52cf9e3
save
AskAlexSharov Apr 28, 2024
4999b47
save
AskAlexSharov Apr 28, 2024
0766620
rename iterators
AskAlexSharov Apr 28, 2024
75b4106
cherry-pick
AskAlexSharov Apr 28, 2024
49e40e7
rename iterators
AskAlexSharov Apr 28, 2024
54e1acc
add unwind error time
AskAlexSharov Apr 29, 2024
78d9d78
e35: preopen pagesize (#10110)
AskAlexSharov Apr 29, 2024
b8fb8fc
Merge branch 'devel' into e35
AskAlexSharov Apr 29, 2024
51b52bb
merge devel
AskAlexSharov Apr 29, 2024
c47ba73
merge devel
AskAlexSharov Apr 29, 2024
76be44c
e35: rename integrateFiles to integrateDirtyFiles (#10115)
AskAlexSharov Apr 29, 2024
c082d4f
Update README.md
AskAlexSharov Apr 29, 2024
61a0ed2
Update README.md
AskAlexSharov Apr 29, 2024
d426f17
more docs
AskAlexSharov Apr 29, 2024
df717a9
more docs
AskAlexSharov Apr 29, 2024
24140a1
polygon/sync: fix executionClientStorage.Flush hanging in err cases (…
battlmonstr Apr 29, 2024
d63ad37
polygon/sync: use a direct execution API client (#10123)
battlmonstr Apr 29, 2024
192028d
e35: recalc all visibleFiles under 1 mutex (now many atomics) (#10116)
AskAlexSharov Apr 29, 2024
0399bbb
polygon/heimdall: refactor heimdall with store option (#10128)
taratorio Apr 29, 2024
2b60c23
polygon/sync: rename storage to store for consistency with heimdall p…
taratorio Apr 29, 2024
139576e
merge devel
AskAlexSharov Apr 30, 2024
7ed221e
save
AskAlexSharov Apr 30, 2024
878b9fc
merge devel
AskAlexSharov Apr 30, 2024
9129e27
Merge commit 'b7668209aae4d2a950a52610bc8561aa54740c32' into e35
AskAlexSharov Apr 30, 2024
2f87328
merge devel
AskAlexSharov Apr 30, 2024
6dc8548
Merge commit 'd8bf235f0dd2bbdeb630e98907b372deb3f0810a' into e35
AskAlexSharov Apr 30, 2024
db9dcd8
merge devel
AskAlexSharov Apr 30, 2024
4d092d7
compat e35
AskAlexSharov Apr 30, 2024
b9d5d8b
merge devel
AskAlexSharov Apr 30, 2024
4cf024e
mainnet step 1400
AskAlexSharov Apr 30, 2024
fd674eb
save
AskAlexSharov Apr 30, 2024
af5f47c
save
AskAlexSharov Apr 30, 2024
e3cd5b8
push check
AskAlexSharov Apr 30, 2024
915f1a3
e35: align deps of e35 and devel (#10137)
AskAlexSharov Apr 30, 2024
8ba9928
merge devel
AskAlexSharov Apr 30, 2024
bcfaae3
Merge branch 'devel' into e35
AskAlexSharov Apr 30, 2024
c5f400c
e35: stage_snap - to reopen in readonly mode (#10143)
AskAlexSharov Apr 30, 2024
aa80f52
make integration more tolerant
AskAlexSharov May 1, 2024
107fac8
renamings of iter
AskAlexSharov May 1, 2024
0c5c3c8
renamings of iter
AskAlexSharov May 1, 2024
1154a1c
Merge branch 'devel' into e35
AskAlexSharov May 1, 2024
c4c2b4e
save
AskAlexSharov May 1, 2024
7e3ea3a
polygon/heimdall: refactor into txReadStore and txStore (#10130)
taratorio May 1, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion go.mod
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -176,7 +176,7 @@ require (
github.com/koron/go-ssdp v0.0.4 // indirect
github.com/kr/pretty v0.3.1 // indirect
github.com/kr/text v0.2.0 // indirect
github.com/ledgerwatch/erigon-snapshot v1.3.1-0.20240202034757-516749793a9d // indirect
github.com/ledgerwatch/erigon-snapshot v1.3.1-0.20240202101433-135828c6e0ff // indirect
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
github.com/ledgerwatch/erigon-snapshot v1.3.1-0.20240202101433-135828c6e0ff // indirect
github.com/ledgerwatch/erigon-snapshot v1.3.1-0.20240202101433-135828c6e0ff // indirect

github.com/libp2p/go-buffer-pool v0.1.0 // indirect
github.com/libp2p/go-cidranger v1.1.0 // indirect
github.com/libp2p/go-flow-metrics v0.1.0 // indirect
Expand Down
4 changes: 2 additions & 2 deletions go.sum
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -529,8 +529,8 @@ github.com/kylelemons/godebug v0.0.0-20170224010052-a616ab194758 h1:0D5M2HQSGD3P
github.com/kylelemons/godebug v0.0.0-20170224010052-a616ab194758/go.mod h1:B69LEHPfb2qLo0BaaOLcbitczOKLWTsrBG9LczfCD4k=
github.com/leanovate/gopter v0.2.9 h1:fQjYxZaynp97ozCzfOyOuAGOU4aU/z37zf/tOujFk7c=
github.com/leanovate/gopter v0.2.9/go.mod h1:U2L/78B+KVFIx2VmW6onHJQzXtFb+p5y3y2Sh+Jxxv8=
github.com/ledgerwatch/erigon-snapshot v1.3.1-0.20240202034757-516749793a9d h1:IyRrAx3uu5n8yFIXluMDe9xHatqFc483MnpO9z45LEQ=
github.com/ledgerwatch/erigon-snapshot v1.3.1-0.20240202034757-516749793a9d/go.mod h1:3AuPxZc85jkehh/HA9h8gabv5MSi3kb/ddtzBsTVJFo=
github.com/ledgerwatch/erigon-snapshot v1.3.1-0.20240202101433-135828c6e0ff h1:BiTSvSU/0EnhlB7tH8FDvkv33+a2a4IwymOxu8JI+tk=
github.com/ledgerwatch/erigon-snapshot v1.3.1-0.20240202101433-135828c6e0ff/go.mod h1:3AuPxZc85jkehh/HA9h8gabv5MSi3kb/ddtzBsTVJFo=
github.com/ledgerwatch/log/v3 v3.9.0 h1:iDwrXe0PVwBC68Dd94YSsHbMgQ3ufsgjzXtFNFVZFRk=
github.com/ledgerwatch/log/v3 v3.9.0/go.mod h1:EiAY6upmI/6LkNhOVxb4eVsmsP11HZCnZ3PlJMjYiqE=
github.com/ledgerwatch/secp256k1 v1.0.0 h1:Usvz87YoTG0uePIV8woOof5cQnLXGYa162rFf3YnwaQ=
Expand Down
Loading