Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cloudburst connection to Anna running on Local #59

Open
umar-nawaz opened this issue Apr 16, 2021 · 1 comment
Open

Cloudburst connection to Anna running on Local #59

umar-nawaz opened this issue Apr 16, 2021 · 1 comment

Comments

@umar-nawaz
Copy link

Hi team,
I have setup cloudburst to run given benchmarks both running on local machine. My goal is to run benchmarks on local that are available under cloudburst/server. Unfortunately, I was unable to figure out what is missing to get responses from anna.

After I start a benchmark, for example composition.py it runs fine until registering functions but never returns/timeout after this when try to call get() from anna.

I guess the issue is with ports configurations that I did not change and all ports are free (that are possibly used by anna or cloudburst by default).
Also the ones cloudburst need here.
I am also able to run the example given in main readme of cloudburst just fine.

My configurations:
Anna seems running fine on local and I could GET and PUT in kvs.

~/sites » ps | grep anna     
3162 ttys005  116:36.56 ./build/target/kvs/anna-monitor
3163 ttys005    0:07.80 ./build/target/kvs/anna-route
3164 ttys005  116:44.17 ./build/target/kvs/anna-kvs

Cloudburst executor and scheduler are also running

~/sites » ps ax | grep python 
 4638   ??  S      0:01.84 python3 cloudburst/server/scheduler/server.py conf/cloudburst-local.yml
 4639   ??  S      0:01.85 python3 cloudburst/server/executor/server.py conf/cloudburst-local.yml

I can also post recent logs from anna and cloudburst if that helps but there was no error or info message.

I wonder what am i missing to get results from benchmarks? Is there already a documentation about connecting both? I would be happy to improve any documentation once the issue is resolved :)

@umar-nawaz
Copy link
Author

Update: after further debugging, it looks like the connection to anna KVS works fine but is too slow probably. I noticed this when I am debugging line by line, it actually loads the values from Anna and gets worker_address correctly.

Config file:

ip: 127.0.0.1
mgmt_ip: NULL
executor:
 scheduler_ips:
   - 127.0.0.1
 thread_id: 0
scheduler:
 routing_address: 127.0.0.1
 metric_address: 127.0.0.1
 policy: locality
benchmark:
 cloudburst_address: 127.0.0.1
 thread_id: 0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant