Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Block builder scheduler startup: learn state from worker updates #9897

Open
wants to merge 24 commits into
base: main
Choose a base branch
from
Open

Block builder scheduler startup: learn state from worker updates #9897

wants to merge 24 commits into from
+583 −137

Commits on Nov 4, 2024

  1. Take in changes from davidgrant/block-builder-scheduler-backlog

    @seizethedave
    seizethedave committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    4783226 View commit details
    Browse the repository at this point in the history

Commits on Nov 5, 2024

  1. Tighten up updateInterval.

    @seizethedave
    seizethedave committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    ff2ee11 View commit details
    Browse the repository at this point in the history

  2. Add startup phase. Add epoch to job key to detect startup conflicts.

    @seizethedave
    seizethedave committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    f734096 View commit details
    Browse the repository at this point in the history

  3. Startup/recovery mode. Listen to updates and convert to jobQueue at t… 

    …he end of the startup period.
    @seizethedave
    seizethedave committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    9ff6ac2 View commit details
    Browse the repository at this point in the history

  4. better JobNotAssigned message.

    @seizethedave
    seizethedave committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    c9ebaf5 View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2024

  1. better name

    @seizethedave
    seizethedave committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    d16ecd2 View commit details
    Browse the repository at this point in the history

  2. Tidy up observation-mode completion. Tidy up tests.

    @seizethedave
    seizethedave committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    e16bdee View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2024

  1. Merge.

    @seizethedave
    seizethedave committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    ad6881d View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into davidgrant/block-buil… 

    …der-scheduler-reconcile
    @seizethedave
    seizethedave committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    1911495 View commit details
    Browse the repository at this point in the history

Commits on Nov 9, 2024

  1. Initial testing of observation code.

    @seizethedave
    seizethedave committed Nov 9, 2024
    Configuration menu
    Copy the full SHA
    44db959 View commit details
    Browse the repository at this point in the history

  2. Restore 517.

    @seizethedave
    seizethedave committed Nov 9, 2024
    Configuration menu
    Copy the full SHA
    356194b View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2024

  1. Merge remote-tracking branch 'origin/main' into davidgrant/block-buil… 

    …der-scheduler-reconcile
    @seizethedave
    seizethedave committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    4fa848c View commit details
    Browse the repository at this point in the history

  2. Epoch->int64; leaseTime->leaseExpiry.

    @seizethedave
    seizethedave committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    d259e22 View commit details
    Browse the repository at this point in the history

  3. job queue nil until observation mode over.

    @seizethedave
    seizethedave committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    95006f7 View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2024

  1. Fetch Kafka offsets at startup.

    @seizethedave
    seizethedave committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    8b352a6 View commit details
    Browse the repository at this point in the history

  2. Improve observation mode finalization.

    @seizethedave
    seizethedave committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    4eca9cb View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/main' into davidgrant/block-buil… 

    …der-scheduler-reconcile
    @seizethedave
    seizethedave committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    3c63143 View commit details
    Browse the repository at this point in the history

  4. Better tests for observation mode.

    @seizethedave
    seizethedave committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    f2bf7aa View commit details
    Browse the repository at this point in the history

  5. Remove redundant test.

    @seizethedave
    seizethedave committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    5f40759 View commit details
    Browse the repository at this point in the history

  6. Improve the observation test.

    @seizethedave
    seizethedave committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    d59d02e View commit details
    Browse the repository at this point in the history

  7. lint & tweaks.

    @seizethedave
    seizethedave committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    9393468 View commit details
    Browse the repository at this point in the history

  8. Remove offset-tracking code that doesn't work correctly.

    @seizethedave
    seizethedave committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    98cb58c View commit details
    Browse the repository at this point in the history

  9. ded code

    @seizethedave
    seizethedave committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    9c3ad6c View commit details
    Browse the repository at this point in the history

  10. Remove ref to old job updates.

    @seizethedave
    seizethedave committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    826d738 View commit details
    Browse the repository at this point in the history