[gpu005:113202] *** Process received signal ***
[gpu005:113202] Signal: Segmentation fault (11)
[gpu005:113202] Signal code: Address not mapped (1)
[gpu005:113202] Failing at address: 0x440000e8
[gpu005:113193] *** Process received signal ***
[gpu005:113193] Signal: Segmentation fault (11)
[gpu005:113193] Signal code: Address not mapped (1)
[gpu005:113193] Failing at address: 0x440000e8
[gpu005:113200] *** Process received signal ***
[gpu005:113200] Signal: Segmentation fault (11)
[gpu005:113200] Signal code: Address not mapped (1)
[gpu005:113200] Failing at address: 0x440000e8
[gpu005:113191] *** Process received signal ***
[gpu005:113191] Signal: Segmentation fault (11)
[gpu005:113191] Signal code: Address not mapped (1)
[gpu005:113191] Failing at address: 0x440000e8
[gpu005:113216] *** Process received signal ***
[gpu005:113216] Signal: Segmentation fault (11)
[gpu005:113216] Signal code: Address not mapped (1)
[gpu005:113216] Failing at address: 0x440000e8
[gpu005:113197] *** Process received signal ***
[gpu005:113197] Signal: Segmentation fault (11)
[gpu005:113197] Signal code: Address not mapped (1)
[gpu005:113197] Failing at address: 0x440000e8
[gpu005:113192] *** Process received signal ***
[gpu005:113192] Signal: Segmentation fault (11)
[gpu005:113192] Signal code: Address not mapped (1)
[gpu005:113192] Failing at address: 0x440000e8
[gpu005:113205] *** Process received signal ***
[gpu005:113205] Signal: Segmentation fault (11)
[gpu005:113205] Signal code: Address not mapped (1)
[gpu005:113205] Failing at address: 0x440000e8
[gpu005:113194] *** Process received signal ***
[gpu005:113194] Signal: Segmentation fault (11)
[gpu005:113194] Signal code: Address not mapped (1)
[gpu005:113194] Failing at address: 0x440000e8
[gpu005:113204] *** Process received signal ***
[gpu005:113204] Signal: Segmentation fault (11)
[gpu005:113204] Signal code: Address not mapped (1)
[gpu005:113204] Failing at address: 0x440000e8
[gpu005:113201] *** Process received signal ***
[gpu005:113201] Signal: Segmentation fault (11)
[gpu005:113201] Signal code: Address not mapped (1)
[gpu005:113201] Failing at address: 0x440000e8
[gpu005:113206] *** Process received signal ***
[gpu005:113206] Signal: Segmentation fault (11)
[gpu005:113206] Signal code: Address not mapped (1)
[gpu005:113206] Failing at address: 0x440000e8
[gpu005:113208] *** Process received signal ***
[gpu005:113208] Signal: Segmentation fault (11)
[gpu005:113208] Signal code: Address not mapped (1)
[gpu005:113208] Failing at address: 0x440000e8
[gpu005:113198] *** Process received signal ***
[gpu005:113198] Signal: Segmentation fault (11)
[gpu005:113198] Signal code: Address not mapped (1)
[gpu005:113198] Failing at address: 0x440000e8
[gpu005:113196] *** Process received signal ***
[gpu005:113196] Signal: Segmentation fault (11)
[gpu005:113196] Signal code: Address not mapped (1)
[gpu005:113196] Failing at address: 0x440000e8
[gpu005:113214] *** Process received signal ***
[gpu005:113214] Signal: Segmentation fault (11)
[gpu005:113214] Signal code: Address not mapped (1)
[gpu005:113214] Failing at address: 0x440000e8
[gpu005:113195] *** Process received signal ***
[gpu005:113195] Signal: Segmentation fault (11)
[gpu005:113195] Signal code: Address not mapped (1)
[gpu005:113195] Failing at address: 0x440000e8
[gpu005:113203] *** Process received signal ***
[gpu005:113203] Signal: Segmentation fault (11)
[gpu005:113203] Signal code: Address not mapped (1)
[gpu005:113203] Failing at address: 0x440000e8
[gpu005:113217] *** Process received signal ***
[gpu005:113217] Signal: Segmentation fault (11)
[gpu005:113217] Signal code: Address not mapped (1)
[gpu005:113217] Failing at address: 0x440000e8
[gpu005:113199] *** Process received signal ***
[gpu005:113199] Signal: Segmentation fault (11)
[gpu005:113199] Signal code: Address not mapped (1)
[gpu005:113199] Failing at address: 0x440000e8
[gpu005:113210] *** Process received signal ***
[gpu005:113210] Signal: Segmentation fault (11)
[gpu005:113210] Signal code: Address not mapped (1)
[gpu005:113210] Failing at address: 0x440000e8
[gpu005:113212] *** Process received signal ***
[gpu005:113212] Signal: Segmentation fault (11)
[gpu005:113212] Signal code: Address not mapped (1)
[gpu005:113212] Failing at address: 0x440000e8
[gpu005:113207] *** Process received signal ***
[gpu005:113207] Signal: Segmentation fault (11)
[gpu005:113207] Signal code: Address not mapped (1)
[gpu005:113207] Failing at address: 0x440000e8
[gpu005:113209] *** Process received signal ***
[gpu005:113209] Signal: Segmentation fault (11)
[gpu005:113209] Signal code: Address not mapped (1)
[gpu005:113209] Failing at address: 0x440000e8
[gpu005:113211] *** Process received signal ***
[gpu005:113211] Signal: Segmentation fault (11)
[gpu005:113211] Signal code: Address not mapped (1)
[gpu005:113211] Failing at address: 0x440000e8
[gpu005:113213] *** Process received signal ***
[gpu005:113213] Signal: Segmentation fault (11)
[gpu005:113213] Signal code: Address not mapped (1)
[gpu005:113213] Failing at address: 0x440000e8
[gpu005:113218] *** Process received signal ***
[gpu005:113215] *** Process received signal ***
[gpu005:113215] Signal: Segmentation fault (11)
[gpu005:113215] Signal code: Address not mapped (1)
[gpu005:113215] Failing at address: 0x440000e8
[gpu005:113218] Signal: Segmentation fault (11)
[gpu005:113218] Signal code: Address not mapped (1)
[gpu005:113218] Failing at address: 0x440000e8
[gpu005:113208] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2b9b5f9ed630]
[gpu005:113208] [ 1] [gpu005:113214] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2aad7dc24630]
[gpu005:113214] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2aad7d58d9e3]
[gpu005:113214] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113214] [ 3] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2b9b5f3569e3]
[gpu005:113208] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113208] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113208] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113208] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113208] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2b9b6094a555]
[gpu005:113208] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113208] *** End of error message ***
/public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113214] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113214] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113214] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2aad7eb81555]
[gpu005:113214] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113214] *** End of error message ***
[gpu005:113197] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2b37bb4ca630]
[gpu005:113197] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2b37bae339e3]
[gpu005:113197] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113197] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113197] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113197] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113197] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2b37bc427555]
[gpu005:113197] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113197] *** End of error message ***
[gpu005:113192] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2afed2a64630]
[gpu005:113192] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2afed23cd9e3]
[gpu005:113192] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113192] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113192] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113192] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113192] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2afed39c1555]
[gpu005:113192] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113192] *** End of error message ***
[gpu005:113200] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2ae68f623630]
[gpu005:113200] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2ae68ef8c9e3]
[gpu005:113200] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113200] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113200] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113200] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113200] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2ae690580555]
[gpu005:113200] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113200] *** End of error message ***
[gpu005:113216] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2af6eceb5630]
[gpu005:113216] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2af6ec81e9e3]
[gpu005:113216] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113216] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113216] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113216] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113216] [ 6] [gpu005:113193] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2ba8ee43b630]
[gpu005:113193] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2ba8edda49e3]
[gpu005:113193] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113193] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113193] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113193] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113193] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2ba8ef398555]
[gpu005:113193] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113193] *** End of error message ***
[gpu005:113204] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2b5309f4c630]
[gpu005:113204] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2b53098b59e3]
[gpu005:113204] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113204] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113204] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113204] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113204] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2b530aea9555]
[gpu005:113204] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113204] *** End of error message ***
/lib64/libc.so.6(__libc_start_main+0xf5)[0x2af6ede12555]
[gpu005:113216] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113216] *** End of error message ***
[gpu005:113202] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2b0fef64f630]
[gpu005:113202] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2b0feefb89e3]
[gpu005:113202] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113202] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113202] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113202] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113202] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2b0ff05ac555]
[gpu005:113202] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113202] *** End of error message ***
--------------------------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
[gpu005:113205] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2b2b12190630]
[gpu005:113205] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2b2b11af99e3]
[gpu005:113205] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113205] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113205] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113205] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113205] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2b2b130ed555]
[gpu005:113205] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113205] *** End of error message ***
[gpu005:113198] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2b17b8b2a630]
[gpu005:113198] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2b17b84939e3]
[gpu005:113198] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113198] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113198] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113198] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113198] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2b17b9a87555]
[gpu005:113198] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113198] *** End of error message ***
[gpu005:113217] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2b23828a5630]
[gpu005:113217] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2b238220e9e3]
[gpu005:113217] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113217] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113217] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113217] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113217] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2b2383802555]
[gpu005:113217] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113217] *** End of error message ***
[gpu005:113213] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2ad06332f630]
[gpu005:113213] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2ad062c989e3]
[gpu005:113213] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113213] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113213] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113213] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113213] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2ad06428c555]
[gpu005:113213] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113213] *** End of error message ***
[gpu005:113195] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2b63d879e630]
[gpu005:113195] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2b63d81079e3]
[gpu005:113195] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113195] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113195] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113195] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113195] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2b63d96fb555]
[gpu005:113195] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113195] *** End of error message ***
[gpu005:113194] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2b75ab952630]
[gpu005:113194] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2b75ab2bb9e3]
[gpu005:113194] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113194] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113194] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113194] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113194] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2b75ac8af555]
[gpu005:113194] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113194] *** End of error message ***
[gpu005:113201] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2b02e47ab630]
[gpu005:113201] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2b02e41149e3]
[gpu005:113201] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113201] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113201] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113201] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113201] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2b02e5708555]
[gpu005:113201] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113201] *** End of error message ***
[gpu005:113212] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2b7fb0e92630]
[gpu005:113212] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2b7fb07fb9e3]
[gpu005:113212] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113212] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113212] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113212] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113212] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2b7fb1def555]
[gpu005:113212] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113212] *** End of error message ***
[gpu005:113206] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2b827a44e630]
[gpu005:113206] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2b8279db79e3]
[gpu005:113206] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113206] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113206] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113206] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113206] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2b827b3ab555]
[gpu005:113206] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113206] *** End of error message ***
[gpu005:113207] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2b087ec0f630]
[gpu005:113207] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2b087e5789e3]
[gpu005:113207] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113207] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113207] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113207] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113207] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2b087fb6c555]
[gpu005:113207] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113207] *** End of error message ***
[gpu005:113199] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2b0a4ea7b630]
[gpu005:113199] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2b0a4e3e49e3]
[gpu005:113199] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113199] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113199] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113199] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113199] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2b0a4f9d8555]
[gpu005:113199] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113199] *** End of error message ***
[gpu005:113209] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2b75efcbb630]
[gpu005:113209] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2b75ef6249e3]
[gpu005:113209] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113209] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113209] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113209] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113209] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2b75f0c18555]
[gpu005:113209] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113209] *** End of error message ***
[gpu005:113210] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2ada4c0bc630]
[gpu005:113210] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2ada4ba259e3]
[gpu005:113210] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113210] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113210] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113210] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113210] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2ada4d019555]
[gpu005:113210] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113210] *** End of error message ***
[gpu005:113211] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2b2175556630]
[gpu005:113211] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2b2174ebf9e3]
[gpu005:113211] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113211] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113211] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113211] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113211] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2b21764b3555]
[gpu005:113211] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113211] *** End of error message ***
[gpu005:113196] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2b7d2d4cd630]
[gpu005:113196] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2b7d2ce369e3]
[gpu005:113196] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113196] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113196] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113196] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113196] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2b7d2e42a555]
[gpu005:113196] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113196] *** End of error message ***
[gpu005:113215] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2b4219b81630]
[gpu005:113215] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2b42194ea9e3]
[gpu005:113215] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113215] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113215] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113215] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113215] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2b421aade555]
[gpu005:113215] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113215] *** End of error message ***
[gpu005:113203] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2b3d0c846630]
[gpu005:113203] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2b3d0c1af9e3]
[gpu005:113203] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113203] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113203] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113203] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113203] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2b3d0d7a3555]
[gpu005:113203] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113203] *** End of error message ***
[gpu005:113191] [ 0] /lib64/libpthread.so.0(+0xf630)[0x2b1ed7cb4630]
[gpu005:113191] [ 1] /ShareData1/opt/cascadelake/linux-centos7-haswell/gcc-4.8.5/openmpi-4.1.5-h3nktl25w2hbo7irqmegr44r4edbvfbw/lib/libmpi.so.40(PMPI_Comm_dup+0x43)[0x2b1ed761d9e3]
[gpu005:113191] [ 2] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x9b47d9]
[gpu005:113191] [ 3] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x96ba90]
[gpu005:113191] [ 4] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x6351a4]
[gpu005:113191] [ 5] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4973fa]
[gpu005:113191] [ 6] /lib64/libc.so.6(__libc_start_main+0xf5)[0x2b1ed8c11555]
[gpu005:113191] [ 7] /public/home/ljz_gpu/src/warpx/build/bin/warpx.2d[0x4e7e4e]
[gpu005:113191] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 2 with PID 113193 on node gpu005 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------