Skip to content

Fix a flaky issue with task percentage not stored in DB#421

Open
fabi200123 wants to merge 1 commit intocloudbase:masterfrom
fabi200123:fix-update-task-percentage
Open

Fix a flaky issue with task percentage not stored in DB#421
fabi200123 wants to merge 1 commit intocloudbase:masterfrom
fabi200123:fix-update-task-percentage

Conversation

@fabi200123
Copy link
Copy Markdown
Contributor

It seems like there is a flaky issue with the percentage for Replicate Disks.
The final steps for replication are not stored in the DB and the UI doesn't display the 100% for disk replication. The worker reaches the 100%, but the 100% is never stored in the DB.

This issue seems to come from the self._cast from update_task_progress_update.

NOTE: Changing it to _call seems to fix the issue, but the whole issue is hard to replicate.

self, ctxt, task_id, progress_update_index, new_current_step,
new_total_steps=None, new_message=None):
self._cast(
# Must use synchronous RPC: EventManager advances last_perc only after
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Won't a synchronous RPC call slow down the transfer? There are quite a few progress updates that will now have to wait for the conductor.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That was the Daniel's question as well.
Asked Emilian to do a test, and there was no significant difference regarding time.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"no significant difference" doesn't tell us much. When talking about performance, we need actual numbers. Ideally some profiler data.

The performance impact may be more significant if the conductor is under load, e.g. having 10-20 concurrent migrations.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants