Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

WW3 crash #31

Closed
aekiss opened this issue Jun 2, 2023 · 5 comments
Closed

WW3 crash #31

aekiss opened this issue Jun 2, 2023 · 5 comments
Assignees
@micaeljtoliveira
Labels
bug Something isn't working ww3 Related to WW3

Comments

@aekiss
Copy link
Contributor

aekiss commented Jun 2, 2023

Executables built with WW3 crash with an MPI error.
@micaeljtoliveira
Copy link
Contributor

Here is the corresponding traceback:

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
access-om3-CICE6-  0000000004A0DD5B  Unknown               Unknown  Unknown
libpthread-2.28.s  000014E12E130CF0  Unknown               Unknown  Unknown
libuct_ib.so.0.0.  000014E11952EA28  Unknown               Unknown  Unknown
libucp.so.0.0.0    000014E12C1D751A  ucp_worker_progre     Unknown  Unknown
libucc_tl_ucp.so.  000014E0CBF0C233  Unknown               Unknown  Unknown
libucc_tl_ucp.so.  000014E0CBF10FAB  ucc_tl_ucp_bcast_     Unknown  Unknown
libucc.so.1.0.0    000014E12DB4330B  Unknown               Unknown  Unknown
libucc.so.1.0.0    000014E12DB481EE  ucc_context_progr     Unknown  Unknown
libmpi.so.40.30.4  000014E12E721D47  mca_coll_ucc_prog     Unknown  Unknown
libopen-pal.so.40  000014E12C674C53  opal_progress         Unknown  Unknown
libmpi.so.40.30.4  000014E12E71C8BE  mca_coll_ucc_bcas     Unknown  Unknown
libmpi.so.40.30.4  000014E12E785096  MPI_Bcast             Unknown  Unknown
libmpi_mpifh.so    000014E12EAD4AC5  Unknown               Unknown  Unknown
access-om3-CICE6-  0000000003230EFF  wav_comp_nuopc_mp        1390  wav_comp_nuopc.F90
access-om3-CICE6-  000000000321CB51  wav_comp_nuopc_mp         664  wav_comp_nuopc.F90
access-om3-CICE6-  00000000007C9B66  Unknown               Unknown  Unknown
access-om3-CICE6-  00000000007CDC6F  Unknown               Unknown  Unknown
access-om3-CICE6-  0000000000D533AA  Unknown               Unknown  Unknown
access-om3-CICE6-  0000000001114A72  Unknown               Unknown  Unknown
access-om3-CICE6-  00000000007CAFEA  Unknown               Unknown  Unknown
access-om3-CICE6-  000000000070A61D  Unknown               Unknown  Unknown
access-om3-CICE6-  00000000009E1C61  Unknown               Unknown  Unknown
access-om3-CICE6-  00000000006AEBE8  Unknown               Unknown  Unknown
access-om3-CICE6-  00000000006C8F7B  Unknown               Unknown  Unknown
access-om3-CICE6-  00000000007C9B66  Unknown               Unknown  Unknown
access-om3-CICE6-  00000000007CDC6F  Unknown               Unknown  Unknown
access-om3-CICE6-  0000000000D533AA  Unknown               Unknown  Unknown
access-om3-CICE6-  0000000001114A72  Unknown               Unknown  Unknown
access-om3-CICE6-  00000000007CAFEA  Unknown               Unknown  Unknown
access-om3-CICE6-  000000000070A61D  Unknown               Unknown  Unknown
access-om3-CICE6-  00000000009E1C61  Unknown               Unknown  Unknown
access-om3-CICE6-  00000000006AEBE8  Unknown               Unknown  Unknown
access-om3-CICE6-  00000000006C9082  Unknown               Unknown  Unknown
access-om3-CICE6-  00000000006DCF6B  Unknown               Unknown  Unknown
access-om3-CICE6-  00000000007C9B66  Unknown               Unknown  Unknown
access-om3-CICE6-  00000000007CDC6F  Unknown               Unknown  Unknown
access-om3-CICE6-  0000000000D533AA  Unknown               Unknown  Unknown
access-om3-CICE6-  0000000001114A72  Unknown               Unknown  Unknown
access-om3-CICE6-  00000000007CAFEA  Unknown               Unknown  Unknown
access-om3-CICE6-  000000000070A61D  Unknown               Unknown  Unknown
access-om3-CICE6-  00000000009E1C61  Unknown               Unknown  Unknown
access-om3-CICE6-  000000000042E7C1  MAIN__                    128  esmApp.F90
access-om3-CICE6-  000000000042DB62  Unknown               Unknown  Unknown
libc-2.28.so       000014E12DD92D85  __libc_start_main     Unknown  Unknown
access-om3-CICE6-  000000000042DA6E  Unknown               Unknown  Unknown

@micaeljtoliveira
Copy link
Contributor

Executables built with WW3 crash with an MPI error.

To be more precise, they crash when calling an MPI routine.

@micaeljtoliveira
Copy link
Contributor

micaeljtoliveira commented Jun 2, 2023 •
edited
Loading

The wav_comp_nuopc.F90 file is this one: WW3/WW3/model/src/wav_comp_nuopc.F90

@micaeljtoliveira micaeljtoliveira self-assigned this Jul 4, 2023
@micaeljtoliveira micaeljtoliveira added ww3 Related to WW3 bug Something isn't working labels Jul 4, 2023
@micaeljtoliveira
Copy link
Contributor

It seems there are two issues that prevent our configurations to run:

  1. the version of WW3 used is incompatible with some of the namelists
  2. the endianess of some of the input files is incompatible with our compile flags

@micaeljtoliveira micaeljtoliveira mentioned this issue Jul 23, 2023
Closed
@micaeljtoliveira
Copy link
Contributor

Fixed in #57

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@micaeljtoliveira micaeljtoliveira

Labels
bug Something isn't working ww3 Related to WW3
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@micaeljtoliveira @aekiss