Complete report #1172818
Frame # |
Function |
Binary |
Source or offset |
Line |
1
|
_raw_spin_lock
|
vmlinux |
0xffffffff8168de52
Build id: 3.10.0-514.10.2.el7.x86_64
|
0x32
|
2
|
at_measured
|
ptlrpc |
0xffffffffa0c33854
Build id: 3.10.0-514.10.2.el7.x86_64
|
0x114
|
3
|
|
libcfs |
0xffffffffa08a70c7
Build id: 3.10.0-514.10.2.el7.x86_64
|
0x57
|
4
|
ptlrpc_connect_import
|
ptlrpc |
0xffffffffa0c349bf
Build id: 3.10.0-514.10.2.el7.x86_64
|
0xeff
|
5
|
ptlrpc_initiate_recovery
|
ptlrpc |
0xffffffffa0c0e370
Build id: 3.10.0-514.10.2.el7.x86_64
|
0x40
|
6
|
ptlrpc_pinger_main
|
ptlrpc |
0xffffffffa0c2bc6c
Build id: 3.10.0-514.10.2.el7.x86_64
|
0x28c
|
7
|
|
vmlinux |
0xffffffff810c5080
Build id: 3.10.0-514.10.2.el7.x86_64
|
0x20
|
8
|
|
ptlrpc |
0xffffffffa0c2b9e0
Build id: 3.10.0-514.10.2.el7.x86_64
|
0x130
|
9
|
kthread
|
vmlinux |
0xffffffff810b06ff
Build id: 3.10.0-514.10.2.el7.x86_64
|
0xcf
|
10
|
|
vmlinux |
0xffffffff810b0630
Build id: 3.10.0-514.10.2.el7.x86_64
|
0x140
|
11
|
ret_from_fork
|
vmlinux |
0xffffffff81696a58
Build id: 3.10.0-514.10.2.el7.x86_64
|
0x58
|
12
|
|
vmlinux |
0xffffffff810b0630
Build id: 3.10.0-514.10.2.el7.x86_64
|
0x140
|
NMI watchdog: BUG: soft lockup - CPU#19 stuck for 22s! [ll_cfg_requeue:3896]
NMI watchdog: BUG: soft lockup - CPU#10 stuck for 22s! [ll_ping:3879]
Modules linked in: tcp_diag udp_diag inet_diag osc(OE) mgc(OE) lustre(OE) lmv(OE) fld(OE) mdc(OE) fid(OE) lov(OE) ko2iblnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) sha512_ssse3 sha512_generic nfs_layout_nfsv41_files crypto_null libcfs(OE) dell_rbu rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache rpcrdma ib_isert iscsi_target_mod target_core_mod ib_iser libiscsi scsi_transport_iscsi ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ipmi_devintf iTCO_wdt iTCO_vendor_support dcdbas intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass pcspkr sg mei_me sb_edac mei edac_core lpc_ich shpchp ipmi_si ipmi_msghandler acpi_power_meter nfsd auth_rpcgss nfs_acl lockd grace ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic mxm_wmi crct10dif_pclmul crct10dif_common
crc32_pclmul crc32c_intel ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper drm_kms_helper cryptd syscopyarea sysfillrect sysimgblt fb_sys_fops hfi1(OE) ttm rdmavt(OE) ib_core drm ahci i2c_algo_bit dca libahci tg3 i2c_core libata ptp megaraid_sas pps_core fjes wmi cdc_ether usbnet mii sunrpc dm_mirror dm_region_hash dm_log dm_mod
CPU: 10 PID: 3879 Comm: ll_ping Tainted: G OEL ------------ 3.10.0-514.10.2.el7.x86_64 #1
Hardware name: Dell Inc. PowerEdge R630/0CNCJW, BIOS 2.13.0 05/14/2021
task: ffff88181b846dd0 ti: ffff88181b86c000 task.ti: ffff88181b86c000
RIP: 0010:[<ffffffff8168de52>] [<ffffffff8168de52>] _raw_spin_lock+0x32/0x50
RSP: 0018:ffff88181b86fca8 EFLAGS: 00000293
RAX: 000000000000768d RBX: ffff88181b86fce8 RCX: 0000000000000006
RDX: 0000000000000004 RSI: 0000000000000004 RDI: ffff88301c9ed3f8
RBP: ffff88181b86fca8 R08: 000000000000000a R09: ffff88301c68ba80
R10: ffff88301c9ed3f8 R11: 0000000000000258 R12: 0000000000000028
R13: ffff88181b86fc78 R14: ffffffffa08bc3dc R15: ffffffffa08bc3dc
FS: 0000000000000000(0000) GS:ffff88181e740000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f9742ce6bf0 CR3: 00000000019ba000 CR4: 00000000001407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff88181b86fd18 ffffffffa0c33854 ffff88181b86fd18 ffffffffa08a70c7
0000000000000010 ffff88181b86fd28 ffff88181b86fce8 0000025808057076
ffff88301c9ed3f8 ffff88301c68ba80 ffff88301c9ed2b0 ffff882e8121ad90
Call Trace:
[<ffffffffa0c33854>] at_measured+0x114/0x380 [ptlrpc]
[<ffffffffa08a70c7>] ? libcfs_debug_msg+0x57/0x80 [libcfs]
[<ffffffffa0c349bf>] ptlrpc_connect_import+0xeff/0x13d0 [ptlrpc]
[<ffffffffa0c0e370>] ptlrpc_initiate_recovery+0x40/0x180 [ptlrpc]
[<ffffffffa0c2bc6c>] ptlrpc_pinger_main+0x28c/0xb30 [ptlrpc]
[<ffffffff810c5080>] ? wake_up_state+0x20/0x20
[<ffffffffa0c2b9e0>] ? ptlrpc_obd_ping+0x130/0x130 [ptlrpc]
[<ffffffff810b06ff>] kthread+0xcf/0xe0
[<ffffffff810b0630>] ? kthread_create_on_node+0x140/0x140
[<ffffffff81696a58>] ret_from_fork+0x58/0x90
[<ffffffff810b0630>] ? kthread_create_on_node+0x140/0x140
Code: 00 02 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 75 01 c3 55 83 e2 fe 0f b7 f2 48 89 e5 b8 00 80 00 00 eb 0d 66 0f 1f 44 00 00 f3 90 <83> e8 01 74 0a 0f b7 0f 66 39 ca 75 f1 5d c3 0f 1f 80 00 00 00