Skip to content

WIP Only increase suspicious counter for executing tasks - #6396

Closed
fjetter wants to merge 1 commit into
dask:mainfrom
fjetter:only_increase_suspicious_counter_for_executing
Closed

fjetter wants to merge 1 commit into
dask:mainfrom
fjetter:only_increase_suspicious_counter_for_executing

Conversation

@fjetter

@fjetter fjetter commented May 20, 2022

Copy link
Copy Markdown
Member

See #6386 (comment) for some more details

TODO

  • tests
  • better description for the PR

@fjetter

fjetter commented May 20, 2022 •

Copy link
Copy Markdown
Member Author

Problem: The scheduler only knows about the executing worker state after a heartbeat got in. If the task consistently fails before this (e.g. immediately or during deserialization) the scheduler does not have the possibility to increase the counter, ever. I think this is a major problem and I don't have an easy way out. Closing this again but feel free to discuss if somebody has an idea

(I think if we want this behavior we'd need to send a proper task state update to the scheduler once we transition it to executing; I'm not sure if this is worth it)

@fjetter fjetter closed this May 20, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant