Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Decentralization Client: Implement ice-box for out-of-order messages #1546

Open
mkysel opened this issue Jan 24, 2025 · 0 comments
Open

Decentralization Client: Implement ice-box for out-of-order messages #1546

mkysel opened this issue Jan 24, 2025 · 0 comments
Labels

Comments

@mkysel
Copy link
Contributor

mkysel commented Jan 24, 2025

Is your feature request related to a problem?

When a client subscribes to the decentralized backend, it might receive messages out of order.

Group messages can be inherently "out of order" and can be sorted by timestamp, but messages also depend on commits in their "depends_on" field.

A message can not be processed before all messages in the "depends_on" field have been processed.

This does not mean that other messages that have different dependencies can't proceed.

As such, the client must implement an "ice-box" that holds these messages until the dependencies arrive.

There are two solutions I can think of:

  • either the client persists the ice-box and moves the last_seen cursor. Processing these messages across restarts.
  • or it keeps the ice-box in memory, but might have to re-pull if a restart happens

Describe the solution to the problem

No response

Describe the uses cases for the feature

No response

Additional details

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Status: Todo
Development

No branches or pull requests

1 participant