OpenJDK java/lang/Thread/virtual/stress/GetStackTraceALotWhenPinned Invalid JIT return address ASSERTION FAILED swalk.c:1629: ((0 ))

[pshipton]

https://openj9-jenkins.osuosl.org/job/Test_openjdk22_j9_sanity.openjdk_x86-64_mac_Nightly_testList_1/1
jdk_lang_1
java/lang/Thread/virtual/stress/GetStackTraceALotWhenPinned.java#id0

https://openj9-artifactory.osuosl.org/artifactory/ci-openj9/Test/Test_openjdk22_j9_sanity.openjdk_x86-64_mac_Nightly_testList_1/1/openjdk_test_output.tar.gz

21:44:10  *** Invalid JIT return address 48000000D024848B in 00007000087988C0
21:44:10  
21:44:10  02:42:41.635 0x7f81f2854900    j9vm.249    *   ** ASSERTION FAILED ** at /Users/jenkins/workspace/Build_JDK22_x86-64_mac_Nightly/openj9/runtime/vm/swalk.c:1629: ((0 ))

[pshipton]

Perhaps related to #18908

[hzongaro]

Saw a failure with a different symptom in an internal grinder run https://hyc-runtimes-jenkins.swg-devops.com/job/Grinder/37939:

01:02:45  2024-02-13T06:02:19.930075Z 359252 remaining ...
01:02:45  2024-02-13T06:02:20.431950Z 356836 remaining ...
01:02:45  STDERR:
01:02:45  Unhandled exception
01:02:45  Type=Segmentation error vmState=0x00000000
01:02:45  J9Generic_Signal_Number=00000018 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
01:02:45  Handler1=00000000068380E0 Handler2=000000000272F7C0 InaccessibleAddress=0000000000000009
01:02:45  RDI=00007F93CD6140E8 RSI=00000000B3A9E6E9 RAX=0000000000000008 RBX=00007000097388C0
01:02:45  RCX=00000000148C0100 RDX=0000000000000001 R8=0000000000000FDE R9=0000000000001009
01:02:45  R10=00000000FFFFFE00 R11=0000000000000000 R12=000000000F8161E8 R13=00000000140C0100
01:02:45  R14=0000000000000006 R15=0000700009738920
01:02:45  RIP=000000000687A6B9 GS=0000 FS=0000 RSP=0000700009738820
01:02:45  RFlags=0000000000010203 CS=002B RBP=00007000097388A0 ERR=0000000900000004
01:02:45  TRAPNO=000000040000000E CPU=0009000000040000 FAULTVADDR=0000000000000009
01:02:45  XMM0 0000000000000000 (f: 0.000000, d: 0.000000e+00)
01:02:45  XMM1 000000000f7cb6d8 (f: 259831520.000000, d: 1.283738e-315)
01:02:45  XMM2 000000005f000000 (f: 1593835520.000000, d: 7.874594e-315)
01:02:45  XMM3 3e02b34ff0f2b4e0 (f: 4042437888.000000, d: 5.442544e-10)
01:02:45  XMM4 3ea7435e9e8af299 (f: 2659906304.000000, d: 6.932963e-07)
01:02:45  XMM5 00000000001e0000 (f: 1966080.000000, d: 9.713726e-318)
01:02:45  XMM6 3fd31871c9544185 (f: 3377742336.000000, d: 2.983670e-01)
01:02:45  XMM7 402791272ee9dd8e (f: 787078528.000000, d: 1.178350e+01)
01:02:45  XMM8 0000000040400000 (f: 1077936128.000000, d: 5.325712e-315)
01:02:45  XMM9 0000000000000000 (f: 0.000000, d: 0.000000e+00)
01:02:45  XMM10 0000000000000000 (f: 0.000000, d: 0.000000e+00)
01:02:45  XMM11 0000000000000000 (f: 0.000000, d: 0.000000e+00)
01:02:45  XMM12 0000000000000000 (f: 0.000000, d: 0.000000e+00)
01:02:45  XMM13 0000000000000000 (f: 0.000000, d: 0.000000e+00)
01:02:45  XMM14 0000000000000000 (f: 0.000000, d: 0.000000e+00)
01:02:45  XMM15 0000000000000000 (f: 0.000000, d: 0.000000e+00)
01:02:45  Module=/Users/jenkins/workspace/Grinder_iteration_2/jdkbinary/j2sdk-image/lib/default/libj9vm29.dylib
01:02:45  Module_base_address=0000000006800000 Symbol=walkStackFrames
01:02:45  Symbol_address=0000000006879F70
01:02:45  Target=2_90_20240205_7 (Mac OS X 11.2.3)
01:02:45  CPU=amd64 (8 logical CPUs) (0x400000000 RAM)
01:02:45  ----------- Stack Backtrace -----------
01:02:45  walkStackFrames+0x74a (0x000000000687A6BA [libj9vm29.dylib+0x7a6ba])
01:02:45  getStackTraceForThread+0x20d (0x0000000008E3E41D [libjclse29.dylib+0xa41d])
01:02:45  Java_java_lang_Thread_getStackTraceImpl+0x51 (0x0000000008E77D11 [libjclse29.dylib+0x43d11])
01:02:45  ---------------------------------------
01:02:45  JVMDUMP039I Processing dump event "gpf", detail "" at 2024/02/13 01:02:20 - please wait.
01:02:45  JVMDUMP032I JVM requested System dump using '/Users/jenkins/workspace/Grinder_iteration_2/aqa-tests/TKG/output_17078040982155/jdk_custom_0_ITER_1/work/scratch/0/core.20240213.010220.62695.0001.dmp' in response to an event
01:02:45  JVMDUMP010I System dump written to /Users/jenkins/workspace/Grinder_iteration_2/aqa-tests/TKG/output_17078040982155/jdk_custom_0_ITER_1/work/scratch/0/core.20240213.010220.62695.0001.dmp
01:02:45  JVMDUMP032I JVM requested Java dump using '/Users/jenkins/workspace/Grinder_iteration_2/aqa-tests/TKG/output_17078040982155/jdk_custom_0_ITER_1/work/scratch/0/javacore.20240213.010220.62695.0002.txt' in response to an event
01:02:45  JVMDUMP010I Java dump written to /Users/jenkins/workspace/Grinder_iteration_2/aqa-tests/TKG/output_17078040982155/jdk_custom_0_ITER_1/work/scratch/0/javacore.20240213.010220.62695.0002.txt
01:02:45  JVMDUMP032I JVM requested Snap dump using '/Users/jenkins/workspace/Grinder_iteration_2/aqa-tests/TKG/output_17078040982155/jdk_custom_0_ITER_1/work/scratch/0/Snap.20240213.010220.62695.0003.trc' in response to an event
01:02:45  JVMDUMP010I Snap dump written to /Users/jenkins/workspace/Grinder_iteration_2/aqa-tests/TKG/output_17078040982155/jdk_custom_0_ITER_1/work/scratch/0/Snap.20240213.010220.62695.0003.trc
01:02:45  JVMDUMP032I JVM requested JIT dump using '/Users/jenkins/workspace/Grinder_iteration_2/aqa-tests/TKG/output_17078040982155/jdk_custom_0_ITER_1/work/scratch/0/jitdump.20240213.010220.62695.0004.dmp' in response to an event
01:02:45  JVMDUMP051I JIT dump occurred in 'MainThread' thread 0x000000000F772F00
01:02:45  JVMDUMP053I JIT dump is recompiling java/lang/VirtualThread.asyncGetStackTrace()[Ljava/lang/StackTraceElement;
01:02:45  JVMDUMP010I JIT dump written to /Users/jenkins/workspace/Grinder_iteration_2/aqa-tests/TKG/output_17078040982155/jdk_custom_0_ITER_1/work/scratch/0/jitdump.20240213.010220.62695.0004.dmp
01:02:45  JVMDUMP013I Processed dump event "gpf", detail "".

[pshipton]

https://openj9-jenkins.osuosl.org/job/Test_openjdk22_j9_sanity.openjdk_x86-64_mac_Nightly_testList_1/15/
jdk_lang_1
java/lang/Thread/virtual/stress/GetStackTraceALotWhenPinned.java#id0

https://openj9-artifactory.osuosl.org/artifactory/ci-openj9/Test/Test_openjdk22_j9_sanity.openjdk_x86-64_mac_Nightly_testList_1/15/openjdk_test_output.tar.gz

21:22:12  Type=Segmentation error vmState=0x00000000
21:22:12  J9Generic_Signal_Number=00000018 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
21:22:12  Handler1=000000000DB22070 Handler2=000000000D878790 InaccessibleAddress=0000000000000009
21:22:12  RDI=00007FD9C970AA98 RSI=00000000B7C9D080 RAX=0000000000000008 RBX=000070000B2998C0
21:22:12  RCX=00000000148C0100 RDX=0000000000000001 R8=0000000000000066 R9=00000000FFFFFFF0
21:22:12  R10=0000000000FFFFFF R11=0000000000000000 R12=00007FD9C988D7F8 R13=00000000140C0100
21:22:12  R14=0000000000000006 R15=000070000B299920
21:22:12  RIP=000000000DB64669 GS=0000 FS=0000 RSP=000070000B299820
21:22:12  RFlags=0000000000010207 CS=002B RBP=000070000B2998A0 ERR=0000000900000004
21:22:12  TRAPNO=000000040000000E CPU=0009000000040000 FAULTVADDR=0000000000000009
21:22:12  XMM0 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:22:12  XMM1 0080000100800001 (f: 8388609.000000, d: 2.848097e-306)
21:22:12  XMM2 000000005f000000 (f: 1593835520.000000, d: 7.874594e-315)
21:22:12  XMM3 3e3ca4f39d0c5e80 (f: 2634833408.000000, d: 6.669281e-09)
21:22:12  XMM4 3ecee9789b43759a (f: 2604889600.000000, d: 3.684997e-06)
21:22:12  XMM5 0000000000200000 (f: 2097152.000000, d: 1.036131e-317)
21:22:12  XMM6 3f87dc475f810a77 (f: 1602292352.000000, d: 1.165062e-02)
21:22:12  XMM7 402a56ef8ec924cc (f: 2395546880.000000, d: 1.316980e+01)
21:22:12  XMM8 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:22:12  XMM9 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:22:12  XMM10 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:22:12  XMM11 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:22:12  XMM12 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:22:12  XMM13 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:22:12  XMM14 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:22:12  XMM15 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:22:12  Module=/Users/jenkins/workspace/Test_openjdk22_j9_sanity.openjdk_x86-64_mac_Nightly_testList_1/jdkbinary/j2sdk-image/lib/default/libj9vm29.dylib
21:22:12  Module_base_address=000000000DAEA000 Symbol=walkStackFrames
21:22:12  Symbol_address=000000000DB63F20
21:22:12  Target=2_90_20240227_26 (Mac OS X 14.3)
21:22:12  CPU=amd64 (12 logical CPUs) (0x400000000 RAM)
21:22:12  ----------- Stack Backtrace -----------
21:22:12  walkStackFrames+0x74a (0x000000000DB6466A [libj9vm29.dylib+0x7a66a])
21:22:12  getStackTraceForThread+0x20d (0x000000000E11D45D [libjclse29.dylib+0xa45d])
21:22:12  Java_java_lang_Thread_getStackTraceImpl+0x51 (0x000000000E156D51 [libjclse29.dylib+0x43d51])
21:22:12  ---------------------------------------

[pshipton]

https://openj9-jenkins.osuosl.org/job/Test_openjdk22_j9_sanity.openjdk_x86-64_mac_Nightly_testList_0/28
jdk_lang_0
java/lang/Thread/virtual/stress/GetStackTraceALotWhenPinned.java#id0

https://openj9-artifactory.osuosl.org/artifactory/ci-openj9/Test/Test_openjdk22_j9_sanity.openjdk_x86-64_mac_Nightly_testList_0/28/openjdk_test_output.tar.gz

21:30:04  Type=Segmentation error vmState=0x00000000
21:30:04  J9Generic_Signal_Number=00000018 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000000
21:30:04  Handler1=0000000001F16280 Handler2=0000000001C6C790
21:30:04  RDI=00007FCAE484B050 RSI=000000001B337CD5 RAX=41000000A024A480 RBX=0000700010F6A8C0
21:30:04  RCX=0000000000000000 RDX=4C44618B45C38B4C R8=0000000000001AD8 R9=AA9ECF6CDAE52767
21:30:04  R10=0000000000003F01 R11=00007FCAE4800000 R12=0000000005926170 R13=00000000140C0100
21:30:04  R14=B3BB9E74BC531227 R15=0000000001B95FE8
21:30:04  RIP=0000000001F58AA1 GS=0000 FS=0000 RSP=0000700010F6A820
21:30:04  RFlags=0000000000010297 CS=002B RBP=0000700010F6A8A0 ERR=2345600000000000
21:30:04  TRAPNO=000000000000000D CPU=6000000000000000 FAULTVADDR=0000000123456000
21:30:04  XMM0 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:30:04  XMM1 00000000058ce748 (f: 93120328.000000, d: 4.600755e-316)
21:30:04  XMM2 000000005f000000 (f: 1593835520.000000, d: 7.874594e-315)
21:30:04  XMM3 3e43c894bc460f06 (f: 3158707968.000000, d: 9.212419e-09)
21:30:04  XMM4 3ed32b93127d7f18 (f: 310214432.000000, d: 4.570535e-06)
21:30:04  XMM5 00000000001e0000 (f: 1966080.000000, d: 9.713726e-318)
21:30:04  XMM6 3fcdc1bca0abec7d (f: 2695621632.000000, d: 2.324749e-01)
21:30:04  XMM7 402a56ef8ec924cc (f: 2395546880.000000, d: 1.316980e+01)
21:30:04  XMM8 0000000040400000 (f: 1077936128.000000, d: 5.325712e-315)
21:30:04  XMM9 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:30:04  XMM10 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:30:04  XMM11 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:30:04  XMM12 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:30:04  XMM13 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:30:04  XMM14 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:30:04  XMM15 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:30:04  Module=/Users/jenkins/workspace/Test_openjdk22_j9_sanity.openjdk_x86-64_mac_Nightly_testList_0/jdkbinary/j2sdk-image/lib/default/libj9vm29.dylib
21:30:04  Module_base_address=0000000001EDE000 Symbol=walkStackFrames
21:30:04  Symbol_address=0000000001F58190
21:30:04  Target=2_90_20240318_40 (Mac OS X 13.4.1)
21:30:04  CPU=amd64 (12 logical CPUs) (0x400000000 RAM)
21:30:04  ----------- Stack Backtrace -----------
21:30:04  walkStackFrames+0x912 (0x0000000001F58AA2 [libj9vm29.dylib+0x7aaa2])
21:30:04  getStackTraceForThread+0x20d (0x00000000025114ED [libjclse29.dylib+0xa4ed])
21:30:04  Java_java_lang_Thread_getStackTraceImpl+0x51 (0x000000000254ADF1 [libjclse29.dylib+0x43df1])

[vij-singh]

Any new news on this one?

[hzongaro]

Any new news on this one?

I haven't been able to make further progress on this one.

[pshipton]

@hzongaro we won't hold the release for this, pls move it out of the Java 22 milestone.

[JasonFengJ9]

JDK22 x86-64_mac(macx64rt5)

openjdk version "22.0.1" 2024-04-16
IBM Semeru Runtime Open Edition 22.0.1.0-m2 (build 22.0.1+8)
Eclipse OpenJ9 VM 22.0.1.0-m2 (build v0.45.0-release-349ff6eab, JRE 22 Mac OS X amd64-64-Bit Compressed References 20240416_49 (JIT enabled, AOT enabled)
OpenJ9   - 349ff6eab
OMR      - 254af5a04
JCL      - b3c38dcd1fd based on jdk-22.0.1+8)

[2024-04-23T18:09:30.670Z] variation: -Xdump:system:none -Xdump:heap:none -Xdump:system:events=gpf+abort+traceassert+corruptcache -XX:-JITServerTechPreviewMessage Mode650
[2024-04-23T18:09:30.670Z] JVM_OPTIONS:  -Xdump:system:none -Xdump:heap:none -Xdump:system:events=gpf+abort+traceassert+corruptcache -XX:-JITServerTechPreviewMessage -XX:-UseCompressedOops -Xverbosegclog 

[2024-04-23T18:15:35.855Z] TEST: java/lang/Thread/virtual/stress/GetStackTraceALotWhenPinned.java#id0

[2024-04-23T18:15:35.856Z] STDERR:
[2024-04-23T18:15:35.856Z] Unhandled exception
[2024-04-23T18:15:35.856Z] Type=Segmentation error vmState=0x00000000
[2024-04-23T18:15:35.856Z] J9Generic_Signal_Number=00000018 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000000
[2024-04-23T18:15:35.856Z] Handler1=00000000104DD4C0 Handler2=000000001022C9E0
[2024-04-23T18:15:35.856Z] RDI=00007FC0D59BB458 RSI=000000001296EEEA RAX=B3894C0000010080 RBX=000070000B4108C0
[2024-04-23T18:15:35.856Z] RCX=00000000148C0100 RDX=00007FC0D789C7C8 R8=000070000B4107A0 R9=0000000010155FE8
[2024-04-23T18:15:35.856Z] R10=0000000000000480 R11=00007FC0C390F9C5 R12=00007FC0D789C7C8 R13=000070000B4108C0
[2024-04-23T18:15:35.856Z] R14=89481A7703F88348 R15=000070000B410920
[2024-04-23T18:15:35.856Z] RIP=000000001051FE9C GS=0000 FS=0000 RSP=000070000B410820
[2024-04-23T18:15:35.856Z] RFlags=0000000000010282 CS=002B RBP=000070000B4108A0 ERR=1023F00000000000
[2024-04-23T18:15:35.856Z] TRAPNO=000000000000000D CPU=F000000000000000 FAULTVADDR=000000001023F000
[2024-04-23T18:15:35.856Z] XMM0 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-04-23T18:15:35.856Z] XMM1 00007fc0d4046d18 (f: 3557059840.000000, d: 6.939951e-310)
[2024-04-23T18:15:35.856Z] XMM2 000000005f000000 (f: 1593835520.000000, d: 7.874594e-315)
[2024-04-23T18:15:35.856Z] XMM3 3e1d2d3b29444e10 (f: 692342272.000000, d: 1.698307e-09)
[2024-04-23T18:15:35.856Z] XMM4 3eb8d680c731cbde (f: 3341929472.000000, d: 1.480454e-06)
[2024-04-23T18:15:35.856Z] XMM5 0000000000200000 (f: 2097152.000000, d: 1.036131e-317)
[2024-04-23T18:15:35.856Z] XMM6 3fdbc1e08b0dad0a (f: 2332929280.000000, d: 4.337083e-01)
[2024-04-23T18:15:35.856Z] XMM7 402a56ef8ec924cc (f: 2395546880.000000, d: 1.316980e+01)
[2024-04-23T18:15:35.856Z] XMM8 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-04-23T18:15:35.856Z] XMM9 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-04-23T18:15:35.856Z] XMM10 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-04-23T18:15:35.856Z] XMM11 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-04-23T18:15:35.856Z] XMM12 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-04-23T18:15:35.856Z] XMM13 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-04-23T18:15:35.856Z] XMM14 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-04-23T18:15:35.856Z] XMM15 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-04-23T18:15:35.856Z] Module=/Users/jenkins/workspace/Test_openjdk22_j9_sanity.openjdk_x86-64_mac_testList_1/jdkbinary/j2sdk-image/Contents/Home/lib/default/libj9vm29.dylib
[2024-04-23T18:15:35.856Z] Module_base_address=00000000104A5000 Symbol=walkStackFrames
[2024-04-23T18:15:35.856Z] Symbol_address=000000001051F320
[2024-04-23T18:15:35.856Z] Target=2_90_20240416_49 (Mac OS X 13.2.1)
[2024-04-23T18:15:35.856Z] CPU=amd64 (12 logical CPUs) (0x400000000 RAM)
[2024-04-23T18:15:35.856Z] ----------- Stack Backtrace -----------
[2024-04-23T18:15:35.856Z] walkStackFrames+0xb7d (0x000000001051FE9D [libj9vm29.dylib+0x7ae9d])
[2024-04-23T18:15:35.856Z] getStackTraceForThread+0x20d (0x0000000010B1F94D [libjclse29.dylib+0x894d])
[2024-04-23T18:15:35.856Z] Java_java_lang_Thread_getStackTraceImpl+0x51 (0x0000000010B59251 [libjclse29.dylib+0x42251])
[2024-04-23T18:15:35.856Z] ---------------------------------------
[2024-04-23T18:15:35.856Z] JVMDUMP039I Processing dump event "gpf", detail "" at 2024/04/23 14:13:59 - please wait.

[2024-04-23T18:15:35.856Z] TEST RESULT: Failed. Unexpected exit from test [exit code: 255]
[2024-04-23T18:15:35.856Z] --------------------------------------------------
[2024-04-23T18:16:46.796Z] Test results: passed: 927; failed: 1
[2024-04-23T18:16:54.595Z] Report written to /Users/jenkins/workspace/Test_openjdk22_j9_sanity.openjdk_x86-64_mac_testList_1/aqa-tests/TKG/output_1713895769342/jdk_lang_1/report/html/report.html
[2024-04-23T18:16:54.595Z] Results written to /Users/jenkins/workspace/Test_openjdk22_j9_sanity.openjdk_x86-64_mac_testList_1/aqa-tests/TKG/output_1713895769342/jdk_lang_1/work
[2024-04-23T18:16:54.595Z] Error: Some tests failed or other problems occurred.
[2024-04-23T18:16:54.595Z] -----------------------------------
[2024-04-23T18:16:54.595Z] jdk_lang_1_FAILED

50x grinder - passed