Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test failure in JIT/superpmi/superpmicollect/superpmicollect.sh #53321

Closed
BruceForstall opened this issue May 26, 2021 · 7 comments
Closed

Test failure in JIT/superpmi/superpmicollect/superpmicollect.sh #53321

BruceForstall opened this issue May 26, 2021 · 7 comments
Labels
arch-arm64 area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI JitStress CLR JIT issues involving JIT internal stress modes os-mac-os-x macOS aka OSX
Milestone
Future

Comments

@BruceForstall
Copy link
Member

Failure in macOS arm64, many JitStress modes

https://dev.azure.com/dnceng/public/_build/results?buildId=1156796&view=ms.vss-test-web.build-test-results-tab

(and the related JitStress2 jobs: https://dev.azure.com/dnceng/public/_build/results?buildId=1158176&view=ms.vss-test-web.build-test-results-tab)

    JIT/superpmi/superpmicollect/superpmicollect.sh [FAIL]
      ERROR: No files found to merge.
      ERROR: replay of final file is not error free
      
      Return code:      1
      Raw output file:      /private/tmp/helix/working/A20E08AC/w/B72909CD/e/JIT/superpmi/Reports/JIT.superpmi/superpmicollect/superpmicollect.output.txt
      Raw output:
      BEGIN EXECUTION
      /tmp/helix/working/A20E08AC/p/corerun superpmicollect.dll ''
      SuperPMI collection and playback - BEGIN
      Setting environment variables:
          SuperPMIShimLogPath=/var/folders/qg/vtfm7t5s1mq9s7327_j9l7z40000gs/T/qsmlurjc.zzsSPMI
          SuperPMIShimPath=/tmp/helix/working/A20E08AC/p/libclrjit.dylib
          COMPlus_JitName=libsuperpmi-shim-collector.dylib
      Running: /usr/bin/perl -pi -e 's/\r\n|\n|\r/\n/g' "/private/tmp/helix/working/A20E08AC/w/B72909CD/e/JIT/superpmi/superpmicollect/Bytemark/Bytemark.sh"
      Running: /bin/chmod +x "/private/tmp/helix/working/A20E08AC/w/B72909CD/e/JIT/superpmi/superpmicollect/Bytemark/Bytemark.sh"
      Running: /usr/bin/env bash /private/tmp/helix/working/A20E08AC/w/B72909CD/e/JIT/superpmi/superpmicollect/Bytemark/Bytemark.sh
      BEGIN EXECUTION
      /tmp/helix/working/A20E08AC/p/corerun Bytemark.dll ''
      BBBBBB   YYY   Y  TTTTTTT  EEEEEEE
      BBB   B  YYY   Y    TTT    EEE
      BBB   B  YYY   Y    TTT    EEE
      BBBBBB    YYY Y     TTT    EEEEEEE
      BBB   B    YYY      TTT    EEE
      BBB   B    YYY      TTT    EEE
      BBBBBB     YYY      TTT    EEEEEEE
      
      BYTEmark (tm) C# Mode Benchmark ver. 2 (06/99)
      NUMERIC SORT(jagged):  Iterations/sec: 1743.32263  Index: 44.70860
      NUMERIC SORT(rectangle):  Iterations/sec: 297.98611  Index: 7.64204
      STRING SORT:  Iterations/sec: 2233.82410  Index: 998.13409
      BITFIELD:  Iterations/sec: 384680120.63031  Index: 65.98622
      FP EMULATION(struct):  Iterations/sec: 179.11413  Index: 85.94728
      FP EMULATION(class):  Iterations/sec: 108.25450  Index: 51.94554
      FOURIER:  Iterations/sec: 298200.27745  Index: 339.14220
      ASSIGNMENT(jagged):  Iterations/sec: 48.64192  Index: 185.09101
      ASSIGNMENT(rectangle):  Iterations/sec: 47.62856  Index: 181.23501
      IDEA:  Iterations/sec: 4768.70174  Index: 72.93600
      HUFFMAN:  Iterations/sec: 2834.76473  Index: 78.60808
      NEURAL NET(jagged):  Iterations/sec: 47.75066  Index: 76.70788
      NEURAL NET(rectangle):  Iterations/sec: 40.22224  Index: 64.61405
      LU DECOMPOSITION:  Iterations/sec: 2963.76183  Index: 153.53813
      ===========OVERALL============
      INTEGER INDEX: 84.84104
      FLOATING-POINT INDEX: 126.74804
       (90 MHz Dell Pentium = 1.00)
      ==============================
      Expected: 100
      Actual: 100
      END EXECUTION - PASSED
      Running: /usr/bin/perl -pi -e 's/\r\n|\n|\r/\n/g' "/private/tmp/helix/working/A20E08AC/w/B72909CD/e/JIT/superpmi/superpmicollect/10w5d_cs_do/10w5d_cs_do.sh"
      Running: /bin/chmod +x "/private/tmp/helix/working/A20E08AC/w/B72909CD/e/JIT/superpmi/superpmicollect/10w5d_cs_do/10w5d_cs_do.sh"
      Running: /usr/bin/env bash /private/tmp/helix/working/A20E08AC/w/B72909CD/e/JIT/superpmi/superpmicollect/10w5d_cs_do/10w5d_cs_do.sh
      BEGIN EXECUTION
      /tmp/helix/working/A20E08AC/p/corerun 10w5d_cs_do.dll ''
      Func_0_6_5_6_3: != true
      Func_0_6_5_4_6: <= true
      Func_0_6_5_4_5: > true
      Func_0_6_5_4_3: == false
      Func_0_6_4_6_2: != true
      Func_0_6_4_5_4: < true
      Func_0_6_4_5_1: < true
      Func_0_6_4_4: <= true
      Func_0_6_3_6_5: == false
      Func_0_6_3_4_4: <= true
      Func_0_6_3_4_3: < true
      Func_0_6_3_3: < true
      Func_0_6_3_2_3: >= true
      Func_0_6_3_1_5: < true
      Func_0_6_3_1: <= false
      Func_0_6_3: != true
      Func_0_6_2_5: != true
      Func_0_6_2_1: > false
      Func_0_6_1_6_4: < false
      Func_0_6_1_6_3: > false
      Func_0_6_1_5_4: > true
      Func_0_6_1_3: == false
      Func_0_5_6_6_6: <= true
      Func_0_5_6_6_1: > true
      Func_0_5_6_4_6: <= false
      Func_0_5_6_4_2: >= false
      Func_0_5_6_3_6: < false
      Func_0_5_6_3_1: == false
      Func_0_5_6_3: <= true
      Func_0_5_6_2_1: >= false
      Func_0_5_6_1_3: > true
      Func_0_5_6_1: <= false
      Func_0_5_5_6: != true
      Func_0_5_5_5_6: != true
      Func_0_5_5_5_4: == false
      Func_0_5_5_5_2: == false
      Func_0_5_5_4_5: < true
      Func_0_5_5_4: > true
      Func_0_5_5_3_4: != true
      Func_0_5_5_3_2: <= true
      Func_0_5_5_3_1: > true
      Func_0_5_5_1: < false
      Func_0_5_4_5: >= false
      Func_0_5_4_1_3: <= false
      Func_0_5_4_1_2: == false
      Func_0_5_4: != true
      Func_0_5_3_6: != true
      Func_0_5_3_5_3: < true
      Func_0_5_3_4_2: == false
      Func_0_5_3_4_1: >= true
      Func_0_5_3_4: <= true
      Func_0_5_3_1_2: < true
      Func_0_5_3: >= false
      Func_0_5_2_6_6: != true
      Func_0_5_2_6_3: != true
      Func_0_5_2_5_6: != true
      Func_0_5_2_5_4: == false
      Func_0_5_2_5_3: <= true
      Func_0_5_2_5_2: != true
      Func_0_5_2_4_5: > false
      Func_0_5_2_4_2: <= true
      Func_0_5_2_2_5: > true
      Func_0_5_2_1_6: > false
      Func_0_5_2_1_1: != true
      Func_0_5_1: != true
      Func_0_4_6_6_5: <= true
      Func_0_4_6_6: == false
      Func_0_4_6_5_6: <= true
      Func_0_4_6_5_5: != true
      Func_0_4_6_5_2: <= true
      Func_0_4_6_5: == false
      Func_0_4_6_3_6: >= true
      Func_0_4_6_3_3: == false
      Func_0_4_6_3_2: <= false
      Func_0_4_6_2: == false
      Func_0_4_5_6: >= false
      Func_0_4_5_5: < true
      Func_0_4_5_3_5: == false
      Func_0_4_5_2_6: > false
      Func_0_4_5_2_4: >= true
      Func_0_4_5_2_1: <= false
      Func_0_4_5_2: >= true
      Func_0_4_5_1_5: == false
      Func_0_4_5_1_2: > true
      Func_0_4_4_5: != true
      Func_0_4_4_2_6: < true
      Func_0_4_4_2_5: != false
      Func_0_4_4_2_3: <= true
      Func_0_4_4_2: == false
      Func_0_4_4_1_4: >= false
      Func_0_4_3_6_6: <= true
      Func_0_4_3_6_5: <= true
      Func_0_4_3_6_2: >= true
      Func_0_4_3_6_1: == true
      Func_0_4_3_4: >= true
      Func_0_4_3_2_2: == false
      Func_0_4_3_1_3: > true
      Func_0_4_3_1_1: != true
      Func_0_4_2_5_4: <= true
      Func_0_4_2_5_1: != true
      Func_0_4_1_4: >= true
      Func_0_4_1_3_1: >= true
      Func_0_4_1_2_3: < false
      Func_0_4_1_1_1: >= true
      Func_0_3_6_6_5: >= true
      Func_0_3_6_6_1: < true
      Func_0_3_6_5_5: > false
      Func_0_3_6_4_1: < false
      Func_0_3_6_3_4: != true
      Func_0_3_5_6_6: == true
      Func_0_3_5_6_5: <= true
      Func_0_3_5_6_2: != true
      Func_0_3_5_4: == false
      Func_0_3_5_3: > false
      Func_0_3_5_2_6: != true
      Func_0_3_5_2_5: <= true
      Func_0_3_5_2_4: > false
      Func_0_3_5_2_2: == false
      Func_0_3_5_1_1: != true
      Func_0_3_4_1_1: < true
      Func_0_3_4_1: < true
      Func_0_3_3_6_4: <= false
      Func_0_3_3_6_1: <= true
      Func_0_3_3_5_6: != true
      Func_0_3_3_5_1: != true
      Func_0_3_3_4_6: <= true
      Func_0_3_3_4_5: <= true
      Func_0_3_3_4_2: < true
      Func_0_3_2_6_6: <= true
      Func_0_3_2_6_3: >= false
      Func_0_3_2_6_1: >= true
      Func_0_3_2_5_6: < true
      Func_0_3_2_5_3: >= true
      Func_0_3_2_5_1: > true
      Func_0_3_2_4_3: > true
      Func_0_3_2_3_3: > true
      Func_0_3_2_3_2: <= false
      Func_0_3_2_1_5: != true
      Func_0_3_1_6_6: > true
      Func_0_3_1_6_4: >= false
      Func_0_3_1_4_4: <= true
      Func_0_3_1_4_3: == true
      Func_0_3_1_4_2: == false
      Func_0_3_1_4_1: <= true
      Func_0_3_1_3_5: == false
      Func_0_3_1_3_4: < true
      Func_0_3_1_2_3: < true
      Func_0_2_6_6_4: != false
      Func_0_2_6_6_3: < true
      Func_0_2_6_6_2: != true
      Func_0_2_6_5_2: > true
      Func_0_2_6_4_5: != true
      Func_0_2_6_3_1: >= true
      Func_0_2_6_1_3: <= true
      Func_0_2_6_1_2: == false
      Func_0_2_5_6_6: == false
      Func_0_2_5_6_1: >= false
      Func_0_2_5_5_2: <= false
      Func_0_2_5_5_1: != true
      Func_0_2_5_4_3: <= true
      Func_0_2_5_4_1: > true
      Func_0_2_3_6_5: != true
      Func_0_2_3_6_4: <= true
      Func_0_2_3_6_1: >= false
      Func_0_2_3_4_5: < true
      Func_0_2_3_4_3: < false
      Func_0_2_3_3_4: == false
      Func_0_2_3_3_1: < true
      Func_0_2_3_2_4: < true
      Func_0_2_3_1_6: <= true
      Func_0_2_3_1_2: <= false
      Func_0_2_3_1_1: >= true
      Func_0_2_3_1: == true
      Func_0_2_2_6: != true
      Func_0_2_2_3_5: > false
      Func_0_2_2_3_3: != true
      Func_0_2_2_3_1: < true
      Func_0_2_2_2: != true
      Func_0_2_2_1_5: > true
      Func_0_2_2_1_3: < true
      Func_0_2_2_1_2: > true
      Func_0_2_2_1: < true
      Func_0_2_1_2_2: >= true
      Func_0_1_6_6_5: == false
      Func_0_1_6_2_4: < true
      Func_0_1_6_2_2: <= true
      Func_0_1_6_1_6: != true
      Func_0_1_6_1_3: > false
      Func_0_1_6_1_2: != true
      Func_0_1_6: >= true
      Func_0_1_5_5_1: != true
      Func_0_1_5_4_6: == false
      Func_0_1_5_4_5: == false
      Func_0_1_5_4_4: < true
      Func_0_1_5_4_1: == false
      Func_0_1_5_3_3: == false
      Func_0_1_4_2_3: > true
      Func_0_1_1_6_5: > true
      Func_0_1_1_6_3: >= false
      Func_0_1_1_6_2: != true
      Func_0_1_1_6_1: <= false
      Func_0_1_1_5_2: != true
      Func_0_1_1_2_6: < true
      Func_0_1_1_2_4: > true
      Func_0_1_1_2_3: == false
      Func_0_1_1_2_1: < false
      Func_0_1_1_1_5: >= true
      Func_0: > true
      100
      Expected: 100
      Actual: 100
      END EXECUTION - PASSED
      Running: /tmp/helix/working/A20E08AC/p/mcs -merge /var/folders/qg/vtfm7t5s1mq9s7327_j9l7z40000gs/T/qsmlurjc.zzsSPMI/base.mch /var/folders/qg/vtfm7t5s1mq9s7327_j9l7z40000gs/T/qsmlurjc.zzsSPMI/*.mc -recursive -dedup -thin
      Merging files matching '/var/folders/qg/vtfm7t5s1mq9s7327_j9l7z40000gs/T/qsmlurjc.zzsSPMI/*.mc' into '/var/folders/qg/vtfm7t5s1mq9s7327_j9l7z40000gs/T/qsmlurjc.zzsSPMI/base.mch'
      Appending file '/var/folders/qg/vtfm7t5s1mq9s7327_j9l7z40000gs/T/qsmlurjc.zzsSPMI/52C228CE.mc'
      Loaded 1000 at 47118 per second
      Loaded 2000 at 39016 per second
      Loaded 2897, Saved 2859
      Appending file '/var/folders/qg/vtfm7t5s1mq9s7327_j9l7z40000gs/T/qsmlurjc.zzsSPMI/52DAB381.mc'
      Loaded 581, Saved 252
      Read/Wrote 44 MB @ 518.63 MB/s.
      Running: /tmp/helix/working/A20E08AC/p/superpmi -p -f /var/folders/qg/vtfm7t5s1mq9s7327_j9l7z40000gs/T/qsmlurjc.zzsSPMI/basefail.mcl /var/folders/qg/vtfm7t5s1mq9s7327_j9l7z40000gs/T/qsmlurjc.zzsSPMI/base.mch /tmp/helix/working/A20E08AC/p/libclrjit.dylib
      Using child (/private/tmp/helix/working/A20E08AC/p/superpmi) with args ( /tmp/helix/working/A20E08AC/p/libclrjit.dylib /var/folders/qg/vtfm7t5s1mq9s7327_j9l7z40000gs/T/qsmlurjc.zzsSPMI/base.mch)
       failingMCList=/var/folders/qg/vtfm7t5s1mq9s7327_j9l7z40000gs/T/qsmlurjc.zzsSPMI/basefail.mcl
       workerCount=8, skipCleanup=0.
      MISSING: Method context 5 failed to replay: SuperPMI assertion failed (missing key "key" in map GetIntrinsicID): key 0000000280E59208
      Loaded 3111  Jitted 3111  FailedCompile 1 Excluded 0 Missing 1
      Total time: 732.313291ms
      Running: /tmp/helix/working/A20E08AC/p/mcs -strip /var/folders/qg/vtfm7t5s1mq9s7327_j9l7z40000gs/T/qsmlurjc.zzsSPMI/base.mch /var/folders/qg/vtfm7t5s1mq9s7327_j9l7z40000gs/T/qsmlurjc.zzsSPMI/final.mch
      Reading from '/var/folders/qg/vtfm7t5s1mq9s7327_j9l7z40000gs/T/qsmlurjc.zzsSPMI/base.mch' removing MC Indexes and writing into '/var/folders/qg/vtfm7t5s1mq9s7327_j9l7z40000gs/T/qsmlurjc.zzsSPMI/final.mch'
      Loaded 1000 at 49839 per second
      Loaded 2000 at 46058 per second
      Loaded 3000 at 44763 per second
      Loaded 3111, Saved 3111
      Running: /tmp/helix/working/A20E08AC/p/mcs -toc /var/folders/qg/vtfm7t5s1mq9s7327_j9l7z40000gs/T/qsmlurjc.zzsSPMI/final.mch
      Indexing from '/var/folders/qg/vtfm7t5s1mq9s7327_j9l7z40000gs/T/qsmlurjc.zzsSPMI/final.mch' into '/var/folders/qg/vtfm7t5s1mq9s7327_j9l7z40000gs/T/qsmlurjc.zzsSPMI/final.mch.mct'
      Loaded 3111, added 3111 to Table of Contents
      Running: /tmp/helix/working/A20E08AC/p/superpmi -p -f /var/folders/qg/vtfm7t5s1mq9s7327_j9l7z40000gs/T/qsmlurjc.zzsSPMI/finalfail.mcl /var/folders/qg/vtfm7t5s1mq9s7327_j9l7z40000gs/T/qsmlurjc.zzsSPMI/final.mch /tmp/helix/working/A20E08AC/p/libclrjit.dylib
      Using child (/private/tmp/helix/working/A20E08AC/p/superpmi) with args ( /tmp/helix/working/A20E08AC/p/libclrjit.dylib /var/folders/qg/vtfm7t5s1mq9s7327_j9l7z40000gs/T/qsmlurjc.zzsSPMI/final.mch)
       failingMCList=/var/folders/qg/vtfm7t5s1mq9s7327_j9l7z40000gs/T/qsmlurjc.zzsSPMI/finalfail.mcl
       workerCount=8, skipCleanup=0.
      MISSING: Method context 5 failed to replay: SuperPMI assertion failed (missing key "key" in map GetIntrinsicID): key 0000000280E59208
      Loaded 3111  Jitted 3111  FailedCompile 1 Excluded 0 Missing 1
      Total time: 393.974500ms
      SuperPMI collection and playback - FAILED
      Expected: 100
      Actual: 101
      END EXECUTION - FAILED

First reported here: #32730 (comment)
@BruceForstall BruceForstall added arch-arm64 os-mac-os-x macOS aka OSX area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI blocking-outerloop Blocking the 'runtime-coreclr outerloop' and 'runtime-libraries-coreclr outerloop' runs labels May 26, 2021
@BruceForstall BruceForstall added this to the 6.0.0 milestone May 26, 2021
@dotnet-issue-labeler dotnet-issue-labeler bot added the untriaged New issue has not been triaged by the area owner label May 26, 2021
@BruceForstall BruceForstall mentioned this issue May 26, 2021
Closed
@BruceForstall BruceForstall removed the untriaged New issue has not been triaged by the area owner label May 26, 2021
@BruceForstall
Copy link
Member Author

@sandreenko Can you please investigate this macOS/arm64 JitStress issue?

@BruceForstall
Copy link
Member Author

SuperPMI is complaining about GetIntrinsicID, so maybe #52156 is at fault?

@runfoapp runfoapp bot mentioned this issue May 27, 2021
Closed
@kunalspathak kunalspathak mentioned this issue May 28, 2021
Merged
@BruceForstall
Copy link
Member Author

Maybe due to #53440?

@sandreenko sandreenko mentioned this issue Jun 2, 2021
Merged
@sandreenko sandreenko modified the milestones: 6.0.0, Future Jun 3, 2021
@sandreenko sandreenko removed preview blocking-outerloop Blocking the 'runtime-coreclr outerloop' and 'runtime-libraries-coreclr outerloop' runs labels Jun 3, 2021
This was referenced Jun 3, 2021
Merged
Closed
@sandreenko sandreenko mentioned this issue Jun 10, 2021
Closed
@sandreenko sandreenko added the JitStress CLR JIT issues involving JIT internal stress modes label Jun 11, 2021
@sandreenko sandreenko removed their assignment Nov 13, 2021
@BruceForstall
Copy link
Member Author

I'm going to close this.

@sandreenko
Copy link
Contributor

it is probably still disabled by #53661

@BruceForstall
Copy link
Member Author

Your comment #53661 (comment) made me think we weren't going to do anything about it.

Certainly, if we "scrub" the test exclusion list and see this exclusion, we can again decide to do something.

Basically, I want to close all the "Test failure in... superpmicollect" issues because I think new and different failures are not getting opened as a result. If there's work to do, we should probably open a new/different issue specifically covering that work.

@sandreenko
Copy link
Contributor

I see, maybe it would be useful to:

  1. check that it is still failing;
  2. if it does then replace the comment with this issue number with a description of when the issue should be checked again, so there is no exclusion that mentions a closed issue, it is always confusing.

@ghost ghost locked as resolved and limited conversation to collaborators Jan 3, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
arch-arm64 area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI JitStress CLR JIT issues involving JIT internal stress modes os-mac-os-x macOS aka OSX
Projects
None yet
Milestone
Future
Development

No branches or pull requests
3 participants
@BruceForstall @sandreenko @JulieLeeMSFT