Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for DB testing using aida-sdb #721

Open
HerbertJordan opened this issue Oct 2, 2023 · 0 comments
Open

Support for DB testing using aida-sdb #721

HerbertJordan opened this issue Oct 2, 2023 · 0 comments
Labels
bug Something isn't working feature request

Comments

@HerbertJordan
Copy link
Collaborator

Currently, the main tool for evaluating Carmen is aida-vm-sdb which uses substate data and an EVM implementation to replay a sequence of operations on Carmen's StateDB implementations. This has two issues:

  • it introduces the EVM processing overhead into the evaluation process, likely slowing down evaluation runs
  • it introduces the EVM processing as part of the system-under-test, potentially complicating error diagnosis

The aida-sdb tool was originally conceived as a tool directly targeting the StateDB implementation itself, short-cutting the EVM implementation. However, its current status is not clear. In particular:

  • it is unclear whether it is operational, and thus fit for practical use; it does not seem to be regularly tested in Jenkins
  • it is unclear how to obtain traces for replaying operations; in particular, since it is not based on the Aida-DB trace information can not be obtained from this source
  • it is unclear whether the trace format is compact enough to be practical; if traces take > 1 TB some test systems would require additional free disk space (e.g. profiling5)
  • the tool has not yet been ported to the new executor infrastructure, thus lacking the latest features (e.g. progress tracking and hash validation)

The state of the tool and its potential should be evaluated and a decision should be made whether time should be invested in supporting this tool, or whether it should be removed.

@HerbertJordan HerbertJordan added bug Something isn't working feature request labels Oct 2, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working feature request
Projects
None yet
Development

No branches or pull requests

1 participant