Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot use concurrent for multiple statement in non-task mode #880

Closed
gaow opened this issue Feb 5, 2018 · 4 comments
Closed

Cannot use concurrent for multiple statement in non-task mode #880

gaow opened this issue Feb 5, 2018 · 4 comments

Comments

@gaow
Copy link
Member

gaow commented Feb 5, 2018

Here is a MWE:

[1]
input: [f'{x+1}.txt' for x in range(2)], group_by = 1, concurrent = True
bash: expand = True
 echo {_input}
python: expand = True
 print({_input:r})

Running this script I get a warning:

WARNING: Input groups are executed sequentially because of existence of directives between statements.

and the jobs are not done in parallel. However it seems to me that there should not be any ambiguous logic here that prevents the parallelism. So am I missing something here? What can I do to still achieve concurrent without using task?

@BoPeng
Copy link
Contributor

BoPeng commented Feb 5, 2018

It is a bug cause by multiple actions in a step. It should have been fixed.

@gaow
Copy link
Member Author

gaow commented Feb 5, 2018

Great, the MWE was fixed. But I run into this problem:

 File "/home/gaow/Public/miniconda3/lib/python3.6/site-packages/sos-0.9.11.3-py3.6.egg/sos/parser.py", line 693, in __init__
    self._read(fp)
  File "/home/gaow/Public/miniconda3/lib/python3.6/site-packages/sos-0.9.11.3-py3.6.egg/sos/parser.py", line 1211, in _read
    raise parsing_errors
sos.parser.ParsingError: File contains parsing errors: /home/gaow/GIT/github/ipynb-website/release
	[line  4]: 
local variable 'starting' referenced before assignment
	[line  7]: 
local variable 'starting' referenced before assignment
	[line 74]: 
local variable 'starting' referenced before assignment
	[line 100]: 
local variable 'starting' referenced before assignment
	[line 213]: 
local variable 'starting' referenced before assignment

The problem was obvious from the code but I am not sure enough of intended logic to fix it.

BoPeng pushed a commit that referenced this issue Feb 5, 2018
@BoPeng
Copy link
Contributor

BoPeng commented Feb 5, 2018

Try again.

@gaow
Copy link
Member Author

gaow commented Feb 5, 2018

I think it works! Will reopen if I later find it otherwise.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants