4 Commits

Author	SHA1	Message	Date
Sybren A. Stüvel	b922722614	Manager: broadcast worker timeouts over SocketIO ... This way the web interface will also show timed-out workers.	2022-06-13 13:05:20 +02:00
Sybren A. Stüvel	986b647967	Manager: re-queue tasks of timed-out workers ... Allow other workers to pick up the task(s) assigned to a timed-out worker.	2022-06-13 12:38:35 +02:00
Sybren A. Stüvel	7d5aae25b5	Manager: add timeout checks for workers	2022-06-13 12:33:22 +02:00
Sybren A. Stüvel	d90a8b987d	Manager: Task Timeout Checker ... Tasks that are in state `active` but haven't been 'touched' by a Worker for 10 minutes or longer will transition to state `failed`. In the future, it might be better to move the decision about which state is suitable to the Task State Machine service, so that it can be smarter and take the history of the task into account. Going to `soft-failed` first might be a nice touch.	2022-06-10 14:32:02 +02:00