Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update base image #241

Merged
merged 5 commits into from
Feb 23, 2022
Merged

Update base image #241

merged 5 commits into from
Feb 23, 2022

Conversation

jburel
Copy link
Member

@jburel jburel commented Jan 26, 2022

Attempting to get the BioFormats-image job green in new jenkins-CI
Currently failure due to

Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.22.0:test (default-test) on project ome-common: There are test failures.

The change also matches the arguments in BF-build job

@sbesson
Copy link
Member

sbesson commented Jan 26, 2022

Interesting. These tests are definitely picked up and executed daily in existing devspaces e.g. https://merge-ci.openmicroscopy.org/jenkins/job/BIOFORMATS-image/1065. Since this is a building from scratch, one potential source of divergence worth investigating is the base Docker image.

@jburel
Copy link
Member Author

jburel commented Jan 31, 2022

Looking at the Image
There is a difference between the version of merge-ci and updated jenkins-ci
Recent update see https://github.com/docker-library/openjdk

@sbesson
Copy link
Member

sbesson commented Feb 1, 2022

Looking quickly at it locally, it looks like we are hitting https://stackoverflow.com/q/23260057. Amongst possible suggested solutions, one of them might be to revert #58 (i.e. it looks like we had already had this issue in the past)

@jburel
Copy link
Member Author

jburel commented Feb 2, 2022

the commit 441e5ea did not break the build on the updated infra

@jburel
Copy link
Member Author

jburel commented Feb 2, 2022

When running locally I have errors when building the javadoc

100 errors
#14 580.3 100 warnings
#14 580.3 [ERROR] MavenReportException: Error while generating Javadoc: 
#14 580.3 Exit code: 1 - /bio-formats-build/ome-poi/src/main/java/loci/poi/hpsf/ClassID.java:218: error: unexpected end tag: </p>
#14 580.3      * <code>false</code>.</p>
#14 580.3                           ^
#14 580.3 /bio-formats-build/ome-poi/src/main/java/loci/poi/hpsf/ClassID.java:51: error: malformed HTML
#14 580.3  * @author Rainer Klute <a
#14 580.3                         ^
#14 580.3 /bio-formats-build/ome-poi/src/main/java/loci/poi/hpsf/ClassID.java:52: error: bad use of '>'
#14 580.3  * href="mailto:klute@rainer-klute.de">&lt;klute@rainer-klute.de&gt;</a>
#14 580.3                                       ^
#14 580.3 /bio-formats-build/ome-poi/src/main/java/loci/poi/hpsf/ClassID.java:52: error: unexpected end tag: </a>
#14 580.3  * href="mailto:klute@rainer-klute.de">&lt;klute@rainer-klute.de&gt;</a>
#14 580.3                                                                     ^
#14 580.3 /bio-formats-build/ome-poi/src/main/java/loci/poi/hpsf/Constants.java:46: error: malformed HTML
#14 580.3  * @author Rainer Klute <a
#14 580.3                         ^
#14 580.3 /bio-formats-build/ome-poi/src/main/java/loci/poi/hpsf/Constants.java:47: error: bad use of '>'
#14 580.3  * href="mailto:klute@rainer-klute.de">&lt;klute@rainer-klute.de&gt;</a>
#14 580.3        

@jburel
Copy link
Member Author

jburel commented Feb 2, 2022

@dgault have you seen this error before?

@sbesson
Copy link
Member

sbesson commented Feb 10, 2022

@jburel should the title of this PR be updated as it is allowing the tests to be run on new JDK versions rather than skipping them

@jburel jburel changed the title skip tests Re-introduce flag to pass the tests due to Java version bump Feb 10, 2022
@dgault
Copy link
Member

dgault commented Feb 10, 2022

I've never seen any of those before, Im assuming there must be extra or stricter checking going on here. When I get some free time I will try to reproduce locally

@jburel
Copy link
Member Author

jburel commented Feb 10, 2022

It looks like the image is older in the new devspace

docker inspect openjdk:8 | grep Created
        "Created": "2019-03-05T04:04:10.522942166Z",

and merge-ci

docker inspect openjdk:8 | grep Created
        "Created": "2021-07-22T13:37:31.954806499Z",

That probably explains what the divergence we noticed

@sbesson
Copy link
Member

sbesson commented Feb 10, 2022

So is the next step to pull a recent Docker image, exclude this and see if the problem is fixed?

@jburel
Copy link
Member Author

jburel commented Feb 10, 2022

I have

  • modified the Dockerfile so a recent image is pulled
  • removed flag re-introduced with 441e5ea

@jburel jburel changed the title Re-introduce flag to pass the tests due to Java version bump Update base image Feb 10, 2022
@jburel
Copy link
Member Author

jburel commented Feb 10, 2022

The title has been modified to reflect the change.
I could force push a commit if required.
The errors seen in the testing ci match the errors seen today on merge-ci i.e.

(    formats/tiff: line   33) broken    https://www.adobe.io/open/standards/TIFF.html - 404 Client Error: Not Found for url: https://developer.adobe.com/open/standards/TIFF.html

Copy link
Member

@sbesson sbesson left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think I convinced myself that pinning the base image to a specific JDK version as proposed here will help making things more reproducible and simplify troubleshooting. It would be good to have additional sign-offs from the team to be sure we are not missing some important use cases.

@jburel
Copy link
Member Author

jburel commented Feb 11, 2022

@dgault what do you think about pinning the version?

@sbesson sbesson requested a review from dgault February 11, 2022 12:14
@dgault
Copy link
Member

dgault commented Feb 14, 2022

Fixing to a specific version seems like a sensible approach to me, should keep things more consistent. Looks good from my side.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants