Skip to content

[master < T981] Reduce all shortest paths memory usage#981

Merged
gitbuda merged 10 commits intomasterfrom
reduce-all-shortest-memory-usage
Jul 30, 2023
Merged

[master < T981] Reduce all shortest paths memory usage#981
gitbuda merged 10 commits intomasterfrom
reduce-all-shortest-memory-usage

Conversation

@antoniofilipovic
Copy link
Contributor

@antoniofilipovic antoniofilipovic commented Jun 13, 2023

TLDR: Based on the mgbench results, memory usage dropped from gigabytes to a few megabytes, while performance on all shortest paths dropped ~7% -> the decision is to merge because of the significant gain in memory usage while keeping performance high.

[master < Task] PR

  • Check, and update documentation if necessary
  • Provide the full content or a guide for the final git message

To keep docs changelog up to date, one more thing to do:

  • Write a release note here
  • Tag someone from docs team in the comments

@antoniofilipovic antoniofilipovic self-assigned this Jun 13, 2023
@gitbuda
Copy link
Member

gitbuda commented Jun 22, 2023

@antoniofilipovic can we merge this to master before v2.9 is released (include in the v2.9 release)?

@gitbuda gitbuda added this to the mg-v2.10.0 milestone Jun 22, 2023
@antoniofilipovic antoniofilipovic marked this pull request as ready for review July 24, 2023 11:42
@Josipmrden Josipmrden changed the title [master < T] Reduce all shortest paths memory usage [master < T981] Reduce all shortest paths memory usage Jul 28, 2023
@Josipmrden
Copy link
Contributor

please provide text for the PR message

@Josipmrden
Copy link
Contributor

small comments, overall GJ

@antoniofilipovic
Copy link
Contributor Author

@vpavicic This PR changes the way memory is used in all shortest-path queries. From now on users should see lower memory usage with query performance almost staying the same.

@gitbuda gitbuda added benchmarking mgBench and benchmarking Memgraph feature feature labels Jul 30, 2023
@gitbuda gitbuda merged commit 285b409 into master Jul 30, 2023
@gitbuda gitbuda deleted the reduce-all-shortest-memory-usage branch July 30, 2023 10:58
as51340 pushed a commit that referenced this pull request Nov 10, 2023
* Change allocator to PoolResource
as51340 pushed a commit that referenced this pull request Oct 24, 2025
* Change allocator to PoolResource
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

benchmarking mgBench and benchmarking Memgraph feature feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants