Skip to content

Migrating data between Unifyfs servers #728

Open
@hariharan-devarajan

Description

Describe the problem you're observing

In the case of producer-consumer workloads where a subset of producers produce and then another subset of processes on a different set of nodes consume, currently the reading of consumers is bottlenecked by the unifyfs server which holds the data (generally the set of nodes where data was produced).

We can add a migration step between the unifyfs servers to migrate this data closer to the consumers so that they can access data node-locally instead of remote access.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions