-
Notifications
You must be signed in to change notification settings - Fork 318
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
New multi docker #3902
New multi docker #3902
Conversation
c1a53b3
to
cfce639
Compare
3616688
to
e34655d
Compare
@heliocastro thanks for contributing! The Python support in ORT as-is is indeed limited to Python 3.6 and supporting other Python versions makes a lot of sense. Deciding for the way to go would be a pre-requisite for reviewing this PR. I'm sorry to tell that we don't have the time currently to do that in the near future. |
1030b55
to
bcc8d05
Compare
@heliocastro The "Update to use pyenv" commit is not signed off that why DCO check fails - could you also add a commit message to this commit? |
@heliocastro How difficult would it be to also build a massive source tarbal for this Docker image? |
I'm glad with the rework, mostly the update of ScanCode Toolkit and the ability to change both Python and Node versions |
Seems really cool, thanks @heliocastro . I've successfully compiled it with docker, but when running the pip package manager I always end up with the following:
What am I doing wrong? |
It seems to work (although I still get errors due to private dependencies), when I first run
Initially I was having trouble with virtualenv due to a version restriction:
I resolved that version restriction by updating the versions in
NOTE: there is a warning in the code that pip 20.3 comes with a new dependency resolver that is untested with ORT. |
45b993a
to
9cfba50
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just some minor comments. Tested it and it is working fine.
|
||
add_local_path "${PYENV_ROOT}/bin" | ||
|
||
eval "$(pyenv init --path)"; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
eval "$(pyenv init --path)"; | |
eval "$(pyenv init --path)" |
|
||
eval "$(pyenv init --path)"; | ||
#shellcheck disable=1091 | ||
. "$(pyenv root)"/completions/pyenv.bash; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
. "$(pyenv root)"/completions/pyenv.bash; | |
. "$(pyenv root)"/completions/pyenv.bash |
Dockerfile
Outdated
&& npm install --global npm@$NPM_VERSION bower@$BOWER_VERSION yarn@$YARN_VERSION | ||
|
||
#------------------------------------------------------------------------ | ||
# ORT |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
should be
# Scancode
Dockerfile
Outdated
&& DEBIAN_FRONTEND=noninteractive apt-get install -y --no-install-recommends \ | ||
build-essential \ | ||
dirmngr \ | ||
dpkg-dev \ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
indentation is mixed up here with tabs and spaces
Dockerfile
Outdated
|
||
#------------------------------------------------------------------------ | ||
# Scancode from official releases | ||
ARG SCANCODE_VERSION=21.8.4 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why is scancode added after ORT source? Wouldn't it be better for caching to reverse that?
@heliocastro : I suggested some changes in heliocastro#16 |
I build a new Docker image yesterday with the default settings and tried to run it for a Python project. It seems ORT is not able to access virtualenv:
Trying to debug it shows virtualenv is not readily available:
Edit:
Backtracking the
So as previously the |
3075760
to
d25349b
Compare
@nicorikken This is already solved in latest commits. virtualenv is installed in the current python, but temember that if you are using interactive environment, you will need run the wrappers to initialize pyenv |
FYI: new scancode release: https://github.com/nexB/scancode-toolkit/releases/tag/v30.1.0 |
d25349b
to
46c942e
Compare
I think dart support might be broken in this PR. When scanning antlr4 it fails with the following error:
Might also be broken on master, I have not tested that. |
|
||
#------------------------------------------------------------------------ | ||
# Scancode from official releases | ||
ARG SCANCODE_VERSION=30.1.0 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think you also need to change the scancodeVersion
in ./gradle.properties
.
@heliocastro Instead of nvm what do you thing of using n which seems to have a simpler API for example see https://blog.insiderattack.net/working-with-multiple-nodejs-versions-85c8eef7a600 |
* Switchable build arg versions * Scancode build from releases, not from python npip * Python uses pyenv. Default python is 3.8.11 * Nodejs is using nvenv. Default nodejs is the latest LTS * Ruby uses rbenv. Bundler and Cocoapods now come by default * Wrapper script to use bashrc on direct ort usage * Use bash and pipefail on all operations as default. Exception for Android sdkmanager that behaves differently on pipefail * Silence gpg dearmor output on tee * Using a single downloader, curl * Go updated to last stable release Signed-off-by: Helio Chissini de Castro <helio@kde.org>
Signed-off-by: Maximilian Huber <gh@maxhbr.de>
Signed-off-by: Helio Chissini de Castro <helio@kde.org>
Signed-off-by: Helio Chissini de Castro <helio@kde.org>
For some not yet identified, defauly Ubuntu openjdk 11 fail to build current instance of Ort upstream code. AdoptOpenJDk fix the issue as a better solution. Signed-off-by: Helio Chissini de Castro <helio@kde.org>
46c942e
to
c469070
Compare
Superseded by #4746. |
Would be nice if you just push the docker-image to Docker Hub |
Please refer to #2441 for that matter instead of commenting on closed PRs. |
Dockerfile: Multidocker based on Ubuntu 20.04
Android sdkmanager that behaves differently on pipefail