Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix map_reduce doctest #33834

Closed
tobiasdiez opened this issue May 10, 2022 · 24 comments
Closed

Fix map_reduce doctest #33834

tobiasdiez opened this issue May 10, 2022 · 24 comments

Comments

@tobiasdiez
Copy link
Contributor

One doctest continuously fails in the build workflow. I couldn't reproduce the error locally, but hopefully it goes away by slightly increasing the timeout from 1sec to 1.5sec.

We also extend the doctest to provide a bit more debug information, and to actually test parallel processing by using two roots and thus two threads.

Local debug output:

File "sage/parallel/map_reduce.py", line 1148, in sage.parallel.map_reduce.RESetMapReduce.start_workers
Failed example:
    S.start_workers(); sleep(float(0.1))
Expected:
    Starting: 1
    Starting: 2
Got:
    [DocTestWorker-1-MainThread] (22:13:22.691) Starting work with 2 processes
    [DocTestWorker-1-MainThread] (22:13:22.691) Distributing tasks
    [DocTestWorker-1-MainThread] (22:13:22.691) Starting processes
    [RESetMapReduceWorker-1:27-MainThread] (22:13:22.735) Started
    [RESetMapReduceWorker-1:27-MainThread] (22:13:22.736) Launching thief
    [RESetMapReduceWorker-1:27-Thief] (22:13:22.736) Thief started
    [RESetMapReduceWorker-1:28-MainThread] (22:13:22.743) Started
    [RESetMapReduceWorker-1:28-MainThread] (22:13:22.744) Launching thief
    [RESetMapReduceWorker-1:28-Thief] (22:13:22.744) Thief started
**********************************************************************
File "sage/parallel/map_reduce.py", line 1153, in sage.parallel.map_reduce.RESetMapReduce.start_workers
Failed example:
    sleep(float(1.5))
Expected:
    Finished: 1
    Finished: 2
Got:
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.237) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.237) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.238) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.238) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.238) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.238) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.238) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.238) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.239) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.239) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.239) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.239) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.239) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.239) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.239) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.239) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.239) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.239) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.239) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.239) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.239) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.239) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.239) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.239) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.239) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.239) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.239) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.239) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.239) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.239) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.239) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.239) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.239) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.239) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.240) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.240) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.240) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.240) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.240) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.240) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.240) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.240) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.240) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.240) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.240) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.240) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.240) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.240) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.240) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.240) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.240) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.240) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.240) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.240) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.240) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.240) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.240) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.240) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.240) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.241) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.241) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.241) _signal_task_done called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.241) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.241) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.241) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.241) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.241) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.241) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.241) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.241) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.241) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.241) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.241) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.241) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.241) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.241) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.241) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.241) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.241) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.241) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.241) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.241) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.241) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.241) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.241) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.241) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.241) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.241) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.241) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.242) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.242) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.242) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.242) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.242) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.242) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.242) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.242) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.242) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.242) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.242) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.242) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.242) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.242) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.242) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.242) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.242) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.242) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.242) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.242) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.242) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.242) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.242) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.242) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.242) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.242) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.242) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.242) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.242) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.242) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.242) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.243) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.242) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.243) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.243) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.243) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.243) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.243) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.243) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.243) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.243) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.243) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.243) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.243) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.243) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.243) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.243) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.243) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.243) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.243) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.243) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.243) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.243) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.243) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.243) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.243) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.243) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.243) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.243) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.243) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.243) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.244) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.244) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.244) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.244) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.244) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.244) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.244) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.244) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.244) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.244) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.244) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.244) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.244) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.244) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.244) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.244) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.244) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.244) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.244) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.244) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.244) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.244) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.244) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.244) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.244) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.244) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.244) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.244) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.244) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.244) Failed Steal RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.244) _signal_task_done called
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.244) Trying to steal from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.245) waiting for steal answer from RESetMapReduceWorker-1:28
    [RESetMapReduceWorker-1:28-MainThread] (22:13:23.245) _signal_task_done called
    [RESetMapReduceWorker-1:28-MainThread] (22:13:23.245) raising AbortError
    [RESetMapReduceWorker-1:28-MainThread] (22:13:23.245) ***************** FINISHED ******************
    [RESetMapReduceWorker-1:28-MainThread] (22:13:23.245) Sending poison pills
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.245) Got a Steal request from RESetMapReduceWorker-1:27
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.245) _signal_task_start called
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.245) Thief aborted
    [RESetMapReduceWorker-1:28-Thief] (22:13:23.245) Thief Exiting
    [RESetMapReduceWorker-1:28-MainThread] (22:13:23.246) Worker Done !
    [RESetMapReduceWorker-1:27-Thief] (22:13:23.246) Thief received poison pill
    [RESetMapReduceWorker-1:27-Thief] (22:13:23.246) Thief Exiting
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.246) Worker Done !
    [RESetMapReduceWorker-1:28-MainThread] (22:13:23.246) Exiting
    [RESetMapReduceWorker-1:27-MainThread] (22:13:23.246) Exiting
    Starting: 2
    Finished: 2
    Starting: 1
    Finished: 1
**********************************************************************
File "sage/parallel/map_reduce.py", line 1161, in sage.parallel.map_reduce.RESetMapReduce.start_workers
Failed example:
    S.finish()
Expected nothing
Got:
    [DocTestWorker-1-MainThread] (22:13:24.310) Joining worker processes...
    [DocTestWorker-1-MainThread] (22:13:24.310) Joining RESetMapReduceWorker-1:27
    [DocTestWorker-1-MainThread] (22:13:24.311) Joining RESetMapReduceWorker-1:28
    [DocTestWorker-1-MainThread] (22:13:24.311) Joining done

CC: @dimpase @mkoeppe @fchapoton

Component: misc

Author: Tobias Diez, Frédéric Chapoton

Branch/Commit: 7fe3812

Reviewer: Tobias Diez, Frédéric Chapoton

Issue created by migration from https://trac.sagemath.org/ticket/33834

@tobiasdiez tobiasdiez added this to the sage-9.6 milestone May 10, 2022
@sagetrac-git
Copy link
Mannequin

sagetrac-git mannequin commented May 10, 2022

Branch pushed to git repo; I updated commit sha1. New commits:

39963caActivate debug level logging

@sagetrac-git
Copy link
Mannequin

sagetrac-git mannequin commented May 10, 2022

Changed commit from 90186ce to 39963ca

@tobiasdiez

This comment has been minimized.

@tobiasdiez

This comment has been minimized.

@mkoeppe
Copy link
Contributor

mkoeppe commented May 12, 2022

comment:4

dup of #33846

@fchapoton
Copy link
Contributor

comment:5

note that sleep should take an integer or a float as input, not any sage type

maybe one can redo my changes from #33846 here ?

@sagetrac-git
Copy link
Mannequin

sagetrac-git mannequin commented May 13, 2022

Changed commit from 39963ca to 5bf1e6b

@sagetrac-git
Copy link
Mannequin

sagetrac-git mannequin commented May 13, 2022

Branch pushed to git repo; I updated commit sha1. New commits:

b8fac7bMerge branch 'public/misc/fix_map_reduce_test' in 9.6.rc4
5bf1e6bordering imports, using sleep(int(..)) and sleep(float(..))

@fchapoton
Copy link
Contributor

comment:7

ok, I have incorporated my changes here. I will now close the other ticket.

@fchapoton
Copy link
Contributor

Changed author from Tobias Diez to Tobias Diez, Frédéric Chapoton

@fchapoton
Copy link
Contributor

comment:9

note that the build and test badge is still red, for another reasons related to not-working coverage..

@sagetrac-git
Copy link
Mannequin

sagetrac-git mannequin commented May 13, 2022

Branch pushed to git repo; I updated commit sha1. New commits:

279376fturn off debugging

@sagetrac-git
Copy link
Mannequin

sagetrac-git mannequin commented May 13, 2022

Changed commit from 5bf1e6b to 279376f

@fchapoton
Copy link
Contributor

comment:11

hmm, doctests do not pass...

@sagetrac-git
Copy link
Mannequin

sagetrac-git mannequin commented May 13, 2022

Branch pushed to git repo; I updated commit sha1. New commits:

463e0a9Try with immeadiate flushing

@sagetrac-git
Copy link
Mannequin

sagetrac-git mannequin commented May 13, 2022

Changed commit from 279376f to 463e0a9

@fchapoton
Copy link
Contributor

comment:13

still failing

@sagetrac-git
Copy link
Mannequin

sagetrac-git mannequin commented May 14, 2022

Branch pushed to git repo; I updated commit sha1. New commits:

7fe3812Increase first wait time

@sagetrac-git
Copy link
Mannequin

sagetrac-git mannequin commented May 14, 2022

Changed commit from 463e0a9 to 7fe3812

@fchapoton
Copy link
Contributor

comment:15

oh, boy, a green middle badge at last ! Positive review from me.

Please set to positive of you agree.

@tobiasdiez
Copy link
Contributor Author

Reviewer: Tobias Diez, Frédéric Chapoton

@tobiasdiez
Copy link
Contributor Author

comment:16

Yeah, finally! Thank you for your work in this direction.

I've set it now to positive review and set the priority to "blocker" so that it hopefully still makes it into 9.6 (since there are only changes to the doctests it shouldn't introduce any serious bugs). Please set it back if you don't agree.

@mkoeppe
Copy link
Contributor

mkoeppe commented May 14, 2022

comment:17

I don't think that's worth delaying the release for

@vbraun
Copy link
Member

vbraun commented May 17, 2022

Changed branch from public/misc/fix_map_reduce_test to 7fe3812

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants