Info

Permalink
Function
ip6addrlbl_net_exit
First occurrence
2021-01-15
Last occurrence
2025-08-20
State
NEW
Components
kernel
Quality
-23

Statistics

Operating system Count
CentOS 7 930
Architecture Count
x86_64 930
Related packages Count
kernel 930
 0:3.10.0-957.el7 725
 0:3.10.0-1127.18.2.el7 193
 0:3.10.0-1160.6.1.el7 4
 0:3.10.0-1160.el7 4
 0:3.10.0-1160.119.1.el7 3
 0:3.10.0-1160.59.1.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

Report backtrace


Complete report #1267398
Frame # Function Binary Source or offset Line
1
ip6addrlbl_net_exit
vmlinux 0xffffffff8cf0911c
Build id: 3.10.0-957.el7.x86_64
0x3c
2
ops_exit_list.isra.5
vmlinux 0xffffffff8ce2d49c
Build id: 3.10.0-957.el7.x86_64
0x3c
3
cleanup_net
vmlinux 0xffffffff8ce2e540
Build id: 3.10.0-957.el7.x86_64
0x1d0
4
process_one_work
vmlinux 0xffffffff8c8b9dcf
Build id: 3.10.0-957.el7.x86_64
0x17f
5
worker_thread
vmlinux 0xffffffff8c8bae66
Build id: 3.10.0-957.el7.x86_64
0x126
6
? manage_workers.isra.25
vmlinux 0xffffffff8c8bad40
Build id: 3.10.0-957.el7.x86_64
0x2a0
7
kthread
vmlinux 0xffffffff8c8c1cb1
Build id: 3.10.0-957.el7.x86_64
0xd1
8
? insert_kthread_work
vmlinux 0xffffffff8c8c1be0
Build id: 3.10.0-957.el7.x86_64
0x40
9
ret_from_fork_nospec_begin
vmlinux 0xffffffff8cf74c24
Build id: 3.10.0-957.el7.x86_64
0xe
10
? insert_kthread_work
vmlinux 0xffffffff8c8c1be0
Build id: 3.10.0-957.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#14 stuck for 22s! [kworker/u64:3:19809]
Modules linked in: ip_vs_rr xt_ipvs ip_vs xt_nat veth vxlan ip6_udp_tunnel udp_tunnel xt_mark xt_CHECKSUM iptable_mangle ipt_REJECT nf_reject_ipv4 tun ebtable_filter ebtables ip6table_filter ip6_tables ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype iptable_filter xt_conntrack nf_nat nf_conntrack libcrc32c br_netfilter bridge stp llc nfsv3 nfs_acl nfs uio_pci_generic uio fscache vfio_pci vfio_iommu_type1 vfio binfmt_misc cuse fuse hyfs(OEK) rdma_ucm(OE) rdma_cm(OE) iw_cm(OE) hycu(OE) ib_ipoib(OE) ib_cm(OE) ib_umad(OE) hydrm_ttm_helper(OE) hycu_sched(OE) hyttm(OE) overlay(T) hykcl(OE) hydrm_buddy(OE) hy_extra(OE) amd_iommu_v2 lockd grace sunrpc dm_mirror dm_region_hash dm_log dm_mod vfat fat amd64_edac_mod edac_mce_amd kvm_amd
kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev sg pcspkr k10temp ipmi_si ipmi_devintf ipmi_msghandler i2c_piix4 acpi_cpufreq sch_fq_codel knem(OE) hydcu_pci_fixup_header(OE) ip_tables ext4 mbcache jbd2 sr_mod cdrom mlx5_ib(OE) ib_uverbs(OE) ib_core(OE) sd_mod crc_t10dif crct10dif_generic uas usb_storage ast drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci libahci crct10dif_pclmul crct10dif_common igb drm_panel_orientation_quirks libata mlx5_core(OE) crc32c_intel dca i2c_algo_bit mlxfw(OE) psample auxiliary(OE) devlink mlx_compat(OE) ptp pps_core nfit libnvdimm xpmem(OE)
CPU: 14 PID: 19809 Comm: kworker/u64:3 Kdump: loaded Tainted: G        W  OELK------------ T 3.10.0-957.el7.x86_64 #1
Hardware name: Suma CY32-T28/37D08B, BIOS CZMLU413 10/14/2021
Workqueue: netns cleanup_net
task: ffff89e973bfc100 ti: ffff89d8136f8000 task.ti: ffff89d8136f8000
RIP: 0010:[<ffffffff8cf0911c>]  [<ffffffff8cf0911c>] ip6addrlbl_net_exit+0x3c/0xa0
RSP: 0018:ffff89d8136fbd70  EFLAGS: 00000202
RAX: ffff89d36e8fede0 RBX: ffff89e1caf04000 RCX: ffffffff8d558420
RDX: ffffffff8d478500 RSI: 00000000000162c0 RDI: 0000000000000246
RBP: ffff89d8136fbd80 R08: 0000000000000000 R09: 00000001802a0028
R10: 00000000dd812c01 R11: ffffcf8821760480 R12: ffffffff8d558420
R13: 00000001802a0028 R14: 0000000000000001 R15: 0000000180080006
FS:  00007f6a937fe700(0000) GS:ffff89e1dfd80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f7b2c214000 CR3: 0000000211014000 CR4: 00000000003407e0
Call Trace:
[<ffffffff8ce2d49c>] ops_exit_list.isra.5+0x3c/0x70
[<ffffffff8ce2e540>] cleanup_net+0x1d0/0x2c0
[<ffffffff8c8b9dcf>] process_one_work+0x17f/0x440
[<ffffffff8c8bae66>] worker_thread+0x126/0x3c0
[<ffffffff8c8bad40>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffff8c8c1cb1>] kthread+0xd1/0xe0
[<ffffffff8c8c1be0>] ? insert_kthread_work+0x40/0x40
[<ffffffff8cf74c24>] ret_from_fork_nospec_begin+0xe/0x21
[<ffffffff8c8c1be0>] ? insert_kthread_work+0x40/0x40
Code: 28 c2 a4 8d 53 e8 05 13 06 00 48 8b 05 1e 31 b4 00 48 85 c0 74 59 48 83 e8 28 eb 0c 0f 1f 00 48 85 db 74 4b 48 8d 43 d8 4c 3b 20 <48> 8b 58 28 75 ee 48 8b 50 30 48 85 db 48 89 1a 74 04 48 89 53 
Complete report #708855
Frame # Function Binary Source or offset Line
1
inet_twsk_purge
vmlinux 0xffffffff940aaf10
Build id: 3.10.0-1160.el7.x86_64
0x40
2
tcpv6_net_exit_batch
vmlinux 0xffffffff94145b61
Build id: 3.10.0-1160.el7.x86_64
0x21
3
ops_exit_list.isra.5
vmlinux 0xffffffff94048799
Build id: 3.10.0-1160.el7.x86_64
0x59
4
cleanup_net
vmlinux 0xffffffff94049830
Build id: 3.10.0-1160.el7.x86_64
0x1d0
5
process_one_work
vmlinux 0xffffffff93abdc4f
Build id: 3.10.0-1160.el7.x86_64
0x17f
6
worker_thread
vmlinux 0xffffffff93abed66
Build id: 3.10.0-1160.el7.x86_64
0x126
7
? manage_workers.isra.26
vmlinux 0xffffffff93abec40
Build id: 3.10.0-1160.el7.x86_64
0x2a0
8
kthread
vmlinux 0xffffffff93ac5c21
Build id: 3.10.0-1160.el7.x86_64
0xd1
9
? insert_kthread_work
vmlinux 0xffffffff93ac5b50
Build id: 3.10.0-1160.el7.x86_64
0x40
10
ret_from_fork_nospec_begin
vmlinux 0xffffffff94193df7
Build id: 3.10.0-1160.el7.x86_64
0x21
11
? insert_kthread_work
vmlinux 0xffffffff93ac5b50
Build id: 3.10.0-1160.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u32:1:21517]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel vmw_balloon lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg parport_pc vmw_vmci parport i2c_piix4 ip_tables xfs libcrc32c ata_generic sr_mod cdrom pata_acpi vmwgfx drm_kms_helper
syscopyarea sysfillrect sysimgblt fb_sys_fops ttm sd_mod ahci crc_t10dif nfit libahci crct10dif_generic ata_piix crct10dif_pclmul drm crct10dif_common libnvdimm libata vmxnet3 crc32c_intel serio_raw drm_panel_orientation_quirks vmw_pvscsi dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 21517 Comm: kworker/u32:1 Kdump: loaded Tainted: G             L ------------   3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
Workqueue: netns cleanup_net
task: ffff8ba8667e2100 ti: ffff8ba803d98000 task.ti: ffff8ba803d98000
RIP: 0010:[<ffffffff940aaf10>]  [<ffffffff940aaf10>] inet_twsk_purge+0x40/0x140
RSP: 0018:ffff8ba803d9bd38  EFLAGS: 00010206
RAX: ffffa0c28629c000 RBX: ffffffff947238c0 RCX: 0000000000066dff
RDX: 0000000000066e00 RSI: ffffffff9471c5c0 RDI: ffffffff94c6a9c0
RBP: ffff8ba803d9bd70 R08: ffff8bb064479300 R09: 00000001801a0019
R10: 0000000000000001 R11: ffff8bb064479300 R12: ffff8bb064479300
R13: 00000001801a0019 R14: ffffffff93c26642 R15: ffff8ba803d9bcb0
FS:  0000000000000000(0000) GS:ffff8bb117280000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000000196b300 CR3: 00000009631c4000 CR4: 00000000003607e0
Call Trace:
[<ffffffff94145b61>] tcpv6_net_exit_batch+0x21/0x30
[<ffffffff94048799>] ops_exit_list.isra.5+0x59/0x70
[<ffffffff94049830>] cleanup_net+0x1d0/0x2c0
[<ffffffff93abdc4f>] process_one_work+0x17f/0x440
[<ffffffff93abed66>] worker_thread+0x126/0x3c0
[<ffffffff93abec40>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff93ac5c21>] kthread+0xd1/0xe0
[<ffffffff93ac5b50>] ? insert_kthread_work+0x40/0x40
[<ffffffff94193df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff93ac5b50>] ? insert_kthread_work+0x40/0x40
Code: 41 54 53 48 83 ec 10 48 89 7d c8 c7 45 d4 00 00 00 00 48 8b 45 c8 44 8b 65 d4 48 8b 00 4e 8d 34 e0 66 2e 0f 1f 84 00 00 00 00 00 <49> 8b 0e f6 c1 01 74 10 e9 83 00 00 00 0f 1f 00 48 8b 09 f6 c1 
Complete report #39158
Frame # Function Binary Source or offset Line
1
inet_twsk_purge
vmlinux 0xffffffffa4ea9d50
Build id: 3.10.0-1127.18.2.el7.x86_64
0x40
2
tcpv6_net_exit_batch
vmlinux 0xffffffffa4f447f1
Build id: 3.10.0-1127.18.2.el7.x86_64
0x21
3
ops_exit_list.isra.5
vmlinux 0xffffffffa4e47799
Build id: 3.10.0-1127.18.2.el7.x86_64
0x59
4
cleanup_net
vmlinux 0xffffffffa4e48830
Build id: 3.10.0-1127.18.2.el7.x86_64
0x1d0
5
process_one_work
vmlinux 0xffffffffa48be6bf
Build id: 3.10.0-1127.18.2.el7.x86_64
0x17f
6
worker_thread
vmlinux 0xffffffffa48bf7d6
Build id: 3.10.0-1127.18.2.el7.x86_64
0x126
7
? manage_workers.isra.26
vmlinux 0xffffffffa48bf6b0
Build id: 3.10.0-1127.18.2.el7.x86_64
0x2a0
8
kthread
vmlinux 0xffffffffa48c6691
Build id: 3.10.0-1127.18.2.el7.x86_64
0xd1
9
? insert_kthread_work
vmlinux 0xffffffffa48c65c0
Build id: 3.10.0-1127.18.2.el7.x86_64
0x40
10
ret_from_fork_nospec_begin
vmlinux 0xffffffffa4f92d1d
Build id: 3.10.0-1127.18.2.el7.x86_64
0x7
11
? insert_kthread_work
vmlinux 0xffffffffa48c65c0
Build id: 3.10.0-1127.18.2.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#9 stuck for 23s! [kworker/u24:3:380]
Modules linked in: tcp_lp cmac rfcomm fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun drbg ansi_cprng ccm devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter bnep hwmon_vid ext4 mbcache jbd2 sunrpc arc4 vfat fat iwlmvm mac80211 intel_pmc_core iwlwifi snd_hda_codec_hdmi iTCO_wdt mei_wdt iTCO_vendor_support intel_powerclamp snd_hda_codec_realtek coretemp intel_rapl snd_hda_codec_generic kvm_intel
kvm snd_hda_intel irqbypass snd_hda_codec crc32_pclmul ghash_clmulni_intel snd_hda_core aesni_intel snd_hwdep lrw snd_seq gf128mul cfg80211 snd_seq_device glue_helper ablk_helper cryptd snd_pcm btusb pcspkr btrtl btbcm btintel snd_timer snd bluetooth joydev i2c_i801 soundcore mei_me sg mei rfkill bff(OE) afe(OE) wmi pinctrl_cannonlake pinctrl_intel acpi_pad ip_tables xfs libcrc32c uas usb_storage hid_multitouch sd_mod crc_t10dif crct10dif_generic i915 iosf_mbi drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops drm ahci igb libahci e1000e libata crct10dif_pclmul dca crct10dif_common crc32c_intel ptp pps_core i2c_algo_bit drm_panel_orientation_quirks video i2c_hid dm_mirror dm_region_hash dm_log dm_mod i2c_dev
CPU: 9 PID: 380 Comm: kworker/u24:3 Kdump: loaded Tainted: G           OE  ------------   3.10.0-1127.18.2.el7.x86_64 #1
Hardware name: Default string Default string/Default string, BIOS V2.02 02/04/2020
Workqueue: netns cleanup_net
task: ffff8eaf03829070 ti: ffff8eaf03834000 task.ti: ffff8eaf03834000
RIP: 0010:[<ffffffffa4ea9d50>]  [<ffffffffa4ea9d50>] inet_twsk_purge+0x40/0x140
RSP: 0018:ffff8eaf03837d38  EFLAGS: 00000287
RAX: ffff9f21431cb000 RBX: ffffffffa5523700 RCX: 0000000000001e00
RDX: 0000000000001600 RSI: ffffffffa551c400 RDI: ffffffffa5a69980
RBP: ffff8eaf03837d70 R08: ffff8eaee0494740 R09: 00000001801a0017
R10: 00000000e0494c01 R11: ffff8eaee0494740 R12: ffff8eaee0494740
R13: 00000001801a0017 R14: ffffffffa4a26702 R15: ffff8eaf03837cb0
FS:  0000000000000000(0000) GS:ffff8eaf0b440000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000555ea401c530 CR3: 0000000786a10000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffa4f447f1>] tcpv6_net_exit_batch+0x21/0x30
[<ffffffffa4e47799>] ops_exit_list.isra.5+0x59/0x70
[<ffffffffa4e48830>] cleanup_net+0x1d0/0x2c0
[<ffffffffa48be6bf>] process_one_work+0x17f/0x440
[<ffffffffa48bf7d6>] worker_thread+0x126/0x3c0
[<ffffffffa48bf6b0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffa48c6691>] kthread+0xd1/0xe0
[<ffffffffa48c65c0>] ? insert_kthread_work+0x40/0x40
[<ffffffffa4f92d1d>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffffa48c65c0>] ? insert_kthread_work+0x40/0x40
Code: 41 54 53 48 83 ec 10 48 89 7d c8 c7 45 d4 00 00 00 00 48 8b 45 c8 44 8b 65 d4 48 8b 00 4e 8d 34 e0 66 2e 0f 1f 84 00 00 00 00 00 <49> 8b 0e f6 c1 01 74 10 e9 83 00 00 00 0f 1f 00 48 8b 09 f6 c1 
Complete report #1015145
Frame # Function Binary Source or offset Line
1
ip6addrlbl_net_exit
vmlinux 0xffffffffb230911c
Build id: 3.10.0-957.el7.x86_64
0x3c
2
ops_exit_list.isra.5
vmlinux 0xffffffffb222d49c
Build id: 3.10.0-957.el7.x86_64
0x3c
3
cleanup_net
vmlinux 0xffffffffb222e540
Build id: 3.10.0-957.el7.x86_64
0x1d0
4
process_one_work
vmlinux 0xffffffffb1cb9dcf
Build id: 3.10.0-957.el7.x86_64
0x17f
5
worker_thread
vmlinux 0xffffffffb1cbae66
Build id: 3.10.0-957.el7.x86_64
0x126
6
? manage_workers.isra.25
vmlinux 0xffffffffb1cbad40
Build id: 3.10.0-957.el7.x86_64
0x2a0
7
kthread
vmlinux 0xffffffffb1cc1cb1
Build id: 3.10.0-957.el7.x86_64
0xd1
8
? SyS_futex
vmlinux 0xffffffffb1d0fe20
Build id: 3.10.0-957.el7.x86_64
0x80
9
? insert_kthread_work
vmlinux 0xffffffffb1cc1be0
Build id: 3.10.0-957.el7.x86_64
0x40
10
ret_from_fork_nospec_begin
vmlinux 0xffffffffb2374c24
Build id: 3.10.0-957.el7.x86_64
0xe
11
? insert_kthread_work
vmlinux 0xffffffffb1cc1be0
Build id: 3.10.0-957.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#20 stuck for 23s! [kworker/u64:0:23668]
Modules linked in: nls_utf8 isofs loop hydcu(OE) hydrm_ttm_helper(OE) hydcu_sched(OE) hyttm(OE) hykcl(OE) hydrm_buddy(OE) hy_extra(OE) ip_vs_rr xt_ipvs ip_vs xt_nat veth vxlan ip6_udp_tunnel udp_tunnel xt_mark xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter nfsv3 nfs_acl nfs fscache uio_pci_generic uio vfio_pci vfio_iommu_type1 vfio binfmt_misc cuse fuse rdma_ucm(OE) rdma_cm(OE) iw_cm(OE) ib_ipoib(OE) ib_cm(OE) ib_umad(OE) mlx5_ib(OE) mlx5_core(OE) overlay(T) mlxfw(OE) auxiliary(OE) ib_uverbs(OE) ib_core(OE) mlx_compat(OE) psample devlink
amd_iommu_v2 lockd grace sunrpc dm_mirror dm_region_hash dm_log dm_mod vfat fat amd64_edac_mod edac_mce_amd kvm_amd kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr sg ipmi_si ipmi_devintf ipmi_msghandler acpi_cpufreq i2c_piix4 k10temp sch_fq_codel hydcu_pci_fixup_header(OE) knem(OE) ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic ast drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci libahci crct10dif_pclmul crct10dif_common libata igb crc32c_intel drm_panel_orientation_quirks ptp pps_core dca i2c_algo_bit nfit libnvdimm xpmem(OE) [last unloaded: hydrm_buddy]
CPU: 20 PID: 23668 Comm: kworker/u64:0 Kdump: loaded Tainted: G           OEL ------------ T 3.10.0-957.el7.x86_64 #1
Hardware name: Suma CY32-T28/37D08B, BIOS 0ZMLU207 06/21/2021
Workqueue: netns cleanup_net
task: ffff8a50d3dd1040 ti: ffff8a546af3c000 task.ti: ffff8a546af3c000
RIP: 0010:[<ffffffffb230911c>]  [<ffffffffb230911c>] ip6addrlbl_net_exit+0x3c/0xa0
RSP: 0018:ffff8a546af3fd70  EFLAGS: 00000287
RAX: ffff8a65aac35cc0 RBX: ffffffffffffff10 RCX: ffffffffb2958420
RDX: ffffffffb2878500 RSI: 00000000000162c0 RDI: 0000000000000246
RBP: ffff8a546af3fd80 R08: 0000000000000000 R09: 00000001802a0018
R10: 000000009a5dca01 R11: fffff0b625697700 R12: 00000000000162c0
R13: ffffffffb2878500 R14: ffffffffb2958420 R15: 000000000002cc39
FS:  00007f4df44b8dc0(0000) GS:ffff8a669fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000006e9360 CR3: 00000014b8c10000 CR4: 00000000003407e0
Call Trace:
[<ffffffffb222d49c>] ops_exit_list.isra.5+0x3c/0x70
[<ffffffffb222e540>] cleanup_net+0x1d0/0x2c0
[<ffffffffb1cb9dcf>] process_one_work+0x17f/0x440
[<ffffffffb1cbae66>] worker_thread+0x126/0x3c0
[<ffffffffb1cbad40>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffffb1cc1cb1>] kthread+0xd1/0xe0
[<ffffffffb1d0fe20>] ? SyS_futex+0x80/0x190
[<ffffffffb1cc1be0>] ? insert_kthread_work+0x40/0x40
[<ffffffffb2374c24>] ret_from_fork_nospec_begin+0xe/0x21
[<ffffffffb1cc1be0>] ? insert_kthread_work+0x40/0x40
Code: 28 c2 e4 b2 53 e8 05 13 06 00 48 8b 05 1e 31 b4 00 48 85 c0 74 59 48 83 e8 28 eb 0c 0f 1f 00 48 85 db 74 4b 48 8d 43 d8 4c 3b 20 <48> 8b 58 28 75 ee 48 8b 50 30 48 85 db 48 89 1a 74 04 48 89 53 
Complete report #1014040
Frame # Function Binary Source or offset Line
1
ip6addrlbl_net_exit
vmlinux 0xffffffffb230911c
Build id: 3.10.0-957.el7.x86_64
0x3c
2
ops_exit_list.isra.5
vmlinux 0xffffffffb222d49c
Build id: 3.10.0-957.el7.x86_64
0x3c
3
cleanup_net
vmlinux 0xffffffffb222e540
Build id: 3.10.0-957.el7.x86_64
0x1d0
4
process_one_work
vmlinux 0xffffffffb1cb9dcf
Build id: 3.10.0-957.el7.x86_64
0x17f
5
worker_thread
vmlinux 0xffffffffb1cbae66
Build id: 3.10.0-957.el7.x86_64
0x126
6
? manage_workers.isra.25
vmlinux 0xffffffffb1cbad40
Build id: 3.10.0-957.el7.x86_64
0x2a0
7
kthread
vmlinux 0xffffffffb1cc1cb1
Build id: 3.10.0-957.el7.x86_64
0xd1
8
? insert_kthread_work
vmlinux 0xffffffffb1cc1be0
Build id: 3.10.0-957.el7.x86_64
0x40
9
ret_from_fork_nospec_begin
vmlinux 0xffffffffb2374c24
Build id: 3.10.0-957.el7.x86_64
0xe
10
? insert_kthread_work
vmlinux 0xffffffffb1cc1be0
Build id: 3.10.0-957.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 22s! [kworker/u64:1:18745]
Modules linked in: nls_utf8 isofs loop hydcu(OE) hydrm_ttm_helper(OE) hydcu_sched(OE) hyttm(OE) hykcl(OE) hydrm_buddy(OE) hy_extra(OE) ip_vs_rr xt_ipvs ip_vs xt_nat veth vxlan ip6_udp_tunnel udp_tunnel xt_mark xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter nfsv3 nfs_acl nfs fscache uio_pci_generic uio vfio_pci vfio_iommu_type1 vfio binfmt_misc cuse fuse rdma_ucm(OE) rdma_cm(OE) iw_cm(OE) ib_ipoib(OE) ib_cm(OE) ib_umad(OE) mlx5_ib(OE) mlx5_core(OE) overlay(T) mlxfw(OE) auxiliary(OE) ib_uverbs(OE) ib_core(OE) mlx_compat(OE) psample devlink
amd_iommu_v2 lockd grace sunrpc dm_mirror dm_region_hash dm_log dm_mod vfat fat amd64_edac_mod edac_mce_amd kvm_amd kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr sg ipmi_si ipmi_devintf ipmi_msghandler acpi_cpufreq i2c_piix4 k10temp sch_fq_codel hydcu_pci_fixup_header(OE) knem(OE) ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic ast drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci libahci crct10dif_pclmul crct10dif_common libata igb crc32c_intel drm_panel_orientation_quirks ptp pps_core dca i2c_algo_bit nfit libnvdimm xpmem(OE) [last unloaded: hydrm_buddy]
CPU: 5 PID: 18745 Comm: kworker/u64:1 Kdump: loaded Tainted: G           OEL ------------ T 3.10.0-957.el7.x86_64 #1
Hardware name: Suma CY32-T28/37D08B, BIOS 0ZMLU207 06/21/2021
Workqueue: netns cleanup_net
task: ffff8a63146ca080 ti: ffff8a506f9cc000 task.ti: ffff8a506f9cc000
RIP: 0010:[<ffffffffb230911c>]  [<ffffffffb230911c>] ip6addrlbl_net_exit+0x3c/0xa0
RSP: 0018:ffff8a506f9cfd70  EFLAGS: 00000283
RAX: ffff8a6dd472a900 RBX: ffffffffffffff10 RCX: ffffffffb2958420
RDX: ffffffffb2878500 RSI: 00000000000162c0 RDI: 0000000000000246
RBP: ffff8a506f9cfd80 R08: 0000000000000000 R09: 00000001802a000c
R10: 000000003d4e3201 R11: fffff0b60bf53880 R12: 00000000000162c0
R13: ffffffffb2878500 R14: ffffffffb2958420 R15: 000000000000df64
FS:  00007f978f51b700(0000) GS:ffff8a569f140000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fa21d95ad00 CR3: 00000014b8c10000 CR4: 00000000003407e0
Call Trace:
[<ffffffffb222d49c>] ops_exit_list.isra.5+0x3c/0x70
[<ffffffffb222e540>] cleanup_net+0x1d0/0x2c0
[<ffffffffb1cb9dcf>] process_one_work+0x17f/0x440
[<ffffffffb1cbae66>] worker_thread+0x126/0x3c0
[<ffffffffb1cbad40>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffffb1cc1cb1>] kthread+0xd1/0xe0
[<ffffffffb1cc1be0>] ? insert_kthread_work+0x40/0x40
[<ffffffffb2374c24>] ret_from_fork_nospec_begin+0xe/0x21
[<ffffffffb1cc1be0>] ? insert_kthread_work+0x40/0x40
Code: 28 c2 e4 b2 53 e8 05 13 06 00 48 8b 05 1e 31 b4 00 48 85 c0 74 59 48 83 e8 28 eb 0c 0f 1f 00 48 85 db 74 4b 48 8d 43 d8 4c 3b 20 <48> 8b 58 28 75 ee 48 8b 50 30 48 85 db 48 89 1a 74 04 48 89 53 
Complete report #95534
Frame # Function Binary Source or offset Line
1
ip6addrlbl_net_exit
vmlinux 0xffffffffac7276bc
Build id: 3.10.0-1160.6.1.el7.x86_64
0x3c
2
ops_exit_list.isra.5
vmlinux 0xffffffffac6487dc
Build id: 3.10.0-1160.6.1.el7.x86_64
0x3c
3
cleanup_net
vmlinux 0xffffffffac649890
Build id: 3.10.0-1160.6.1.el7.x86_64
0x1d0
4
process_one_work
vmlinux 0xffffffffac0bdc4f
Build id: 3.10.0-1160.6.1.el7.x86_64
0x17f
5
worker_thread
vmlinux 0xffffffffac0bed66
Build id: 3.10.0-1160.6.1.el7.x86_64
0x126
6
? manage_workers.isra.26
vmlinux 0xffffffffac0bec40
Build id: 3.10.0-1160.6.1.el7.x86_64
0x2a0
7
kthread
vmlinux 0xffffffffac0c5c21
Build id: 3.10.0-1160.6.1.el7.x86_64
0xd1
8
? insert_kthread_work
vmlinux 0xffffffffac0c5b50
Build id: 3.10.0-1160.6.1.el7.x86_64
0x40
9
ret_from_fork_nospec_begin
vmlinux 0xffffffffac794df7
Build id: 3.10.0-1160.6.1.el7.x86_64
0x21
10
? insert_kthread_work
vmlinux 0xffffffffac0c5b50
Build id: 3.10.0-1160.6.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [kworker/u96:1:602]
Modules linked in: nf_conntrack_netlink xt_addrtype ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_log_ipv4 nf_log_common xt_LOG xt_limit xt_recent ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables xt_REDIRECT nf_nat_redirect ip_vs_rr xt_ipvs ip_vs xt_nat veth vxlan ip6_udp_tunnel udp_tunnel xt_mark br_netfilter overlay(T) xt_conntrack bridge stp llc iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle nf_conntrack libcrc32c ip_set nfnetlink iptable_filter iTCO_wdt iTCO_vendor_support sb_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel
kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr i2c_i801 lpc_ich joydev mei_me mei sg ioatdma wmi ipmi_si ipmi_devintf ipmi_msghandler acpi_power_meter acpi_pad ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci drm igb libahci crct10dif_pclmul crct10dif_common crc32c_intel libata megaraid_sas ptp pps_core dca i2c_algo_bit drm_panel_orientation_quirks nfit libnvdimm [last unloaded: ip6_tables]
CPU: 1 PID: 602 Comm: kworker/u96:1 Kdump: loaded Tainted: G               ------------ T 3.10.0-1160.6.1.el7.x86_64 #1
Hardware name: Supermicro Super Server/X10DRL-i, BIOS 3.1 06/07/2018
Workqueue: netns cleanup_net
task: ffff8a34ee0e3180 ti: ffff8a2ee48ec000 task.ti: ffff8a2ee48ec000
RIP: 0010:[<ffffffffac7276bc>]  [<ffffffffac7276bc>] ip6addrlbl_net_exit+0x3c/0xa0
RSP: 0018:ffff8a2ee48efd70  EFLAGS: 00000206
RAX: ffff8a3095ec47e0 RBX: 0000000000000092 RCX: ffffffffacd5de80
RDX: ffffffffacc7a380 RSI: 0000000000016380 RDI: 0000000000000246
RBP: ffff8a2ee48efd80 R08: 0000000000000000 R09: 00000001002a0022
R10: 000000006fd5fa01 R11: ffff8a2b6fd5fbc0 R12: 0000000000016380
R13: ffffffffacc7a380 R14: ffffffffacd5de80 R15: 000000000003f7b9
FS:  0000000000000000(0000) GS:ffff8a309fc40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007efd44c92000 CR3: 0000000dea810000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffac6487dc>] ops_exit_list.isra.5+0x3c/0x70
[<ffffffffac649890>] cleanup_net+0x1d0/0x2c0
[<ffffffffac0bdc4f>] process_one_work+0x17f/0x440
[<ffffffffac0bed66>] worker_thread+0x126/0x3c0
[<ffffffffac0bec40>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffac0c5c21>] kthread+0xd1/0xe0
[<ffffffffac0c5b50>] ? insert_kthread_work+0x40/0x40
[<ffffffffac794df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffac0c5b50>] ? insert_kthread_work+0x40/0x40
Code: a8 d6 26 ad 53 e8 95 24 06 00 48 8b 05 fe 5f b4 00 48 85 c0 74 59 48 83 e8 28 eb 0c 0f 1f 00 48 85 db 74 4b 48 8d 43 d8 4c 3b 20 <48> 8b 58 28 75 ee 48 8b 50 30 48 85 db 48 89 1a 74 04 48 89 53 
Complete report #1153027
Frame # Function Binary Source or offset Line
1
__call_rcu
vmlinux 0xffffffffa6953868
Build id: 3.10.0-957.el7.x86_64
0x98
2
call_rcu_sched
vmlinux 0xffffffffa6953aad
Build id: 3.10.0-957.el7.x86_64
0x1d
3
ip6addrlbl_net_exit
vmlinux 0xffffffffa6f0915b
Build id: 3.10.0-957.el7.x86_64
0x7b
4
ops_exit_list.isra.5
vmlinux 0xffffffffa6e2d49c
Build id: 3.10.0-957.el7.x86_64
0x3c
5
cleanup_net
vmlinux 0xffffffffa6e2e540
Build id: 3.10.0-957.el7.x86_64
0x1d0
6
process_one_work
vmlinux 0xffffffffa68b9dcf
Build id: 3.10.0-957.el7.x86_64
0x17f
7
worker_thread
vmlinux 0xffffffffa68bae66
Build id: 3.10.0-957.el7.x86_64
0x126
8
? manage_workers.isra.25
vmlinux 0xffffffffa68bad40
Build id: 3.10.0-957.el7.x86_64
0x2a0
9
kthread
vmlinux 0xffffffffa68c1cb1
Build id: 3.10.0-957.el7.x86_64
0xd1
10
? insert_kthread_work
vmlinux 0xffffffffa68c1be0
Build id: 3.10.0-957.el7.x86_64
0x40
11
ret_from_fork_nospec_begin
vmlinux 0xffffffffa6f74c24
Build id: 3.10.0-957.el7.x86_64
0xe
12
? insert_kthread_work
vmlinux 0xffffffffa68c1be0
Build id: 3.10.0-957.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 23s! [kworker/u64:2:32662]
Modules linked in: ip_vs_rr xt_ipvs ip_vs xt_nat veth vxlan ip6_udp_tunnel udp_tunnel xt_mark xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter nfsv3 nfs_acl nfs fscache uio_pci_generic uio vfio_pci vfio_iommu_type1 vfio binfmt_misc cuse fuse rdma_ucm(OE) rdma_cm(OE) iw_cm(OE) hycu(OE) ib_ipoib(OE) ib_cm(OE) ib_umad(OE) hydrm_ttm_helper(OE) hycu_sched(OE) hyttm(OE) overlay(T) hykcl(OE) hydrm_buddy(OE) hy_extra(OE) amd_iommu_v2 lockd grace sunrpc dm_mirror dm_region_hash dm_log dm_mod vfat fat amd64_edac_mod edac_mce_amd kvm_amd kvm irqbypass
crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg k10temp ipmi_si ipmi_devintf ipmi_msghandler i2c_piix4 acpi_cpufreq sch_fq_codel knem(OE) hydcu_pci_fixup_header(OE) ip_tables ext4 mbcache jbd2 sr_mod cdrom mlx5_ib(OE) ib_uverbs(OE) ib_core(OE) sd_mod crc_t10dif crct10dif_generic ast drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci libahci igb crct10dif_pclmul crct10dif_common drm_panel_orientation_quirks libata crc32c_intel mlx5_core(OE) dca i2c_algo_bit mlxfw(OE) psample auxiliary(OE) devlink mlx_compat(OE) ptp pps_core nfit libnvdimm uas usb_storage xpmem(OE)
CPU: 5 PID: 32662 Comm: kworker/u64:2 Kdump: loaded Tainted: G           OEL ------------ T 3.10.0-957.el7.x86_64 #1
Hardware name: Suma CY32-T28/37D08B, BIOS CZMLU413 10/14/2021
Workqueue: netns cleanup_net
task: ffff9501fd269040 ti: ffff950aed9f8000 task.ti: ffff950aed9f8000
RIP: 0010:[<ffffffffa6953868>]  [<ffffffffa6953868>] __call_rcu+0x98/0x2c0
RSP: 0018:ffff950aed9fbd28  EFLAGS: 00000246
RAX: 0000000000007f8c RBX: ffff9507c55f2240 RCX: ffffffffa7558420
RDX: ffffffffa7478500 RSI: 00000000000162c0 RDI: 0000000000000246
RBP: ffff950aed9fbd50 R08: 0000000000000000 R09: 00000001002a0024
R10: 00000000c55f3201 R11: ffffe1abde157c80 R12: ffff94fcb3df5000
R13: ffffffffa6a1b391 R14: ffff950aed9fbd40 R15: ffffe1abde157c80
FS:  00007fd936815da0(0000) GS:ffff94f89f140000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f6cf6ffda08 CR3: 0000001b9da24000 CR4: 00000000003407e0
Call Trace:
[<ffffffffa6953aad>] call_rcu_sched+0x1d/0x20
[<ffffffffa6f0915b>] ip6addrlbl_net_exit+0x7b/0xa0
[<ffffffffa6e2d49c>] ops_exit_list.isra.5+0x3c/0x70
[<ffffffffa6e2e540>] cleanup_net+0x1d0/0x2c0
[<ffffffffa68b9dcf>] process_one_work+0x17f/0x440
[<ffffffffa68bae66>] worker_thread+0x126/0x3c0
[<ffffffffa68bad40>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffffa68c1cb1>] kthread+0xd1/0xe0
[<ffffffffa68c1be0>] ? insert_kthread_work+0x40/0x40
[<ffffffffa6f74c24>] ret_from_fork_nospec_begin+0xe/0x21
[<ffffffffa68c1be0>] ? insert_kthread_work+0x40/0x40
Code: 3c cd a0 b9 54 a7 80 3d 16 80 04 01 00 8b 87 70 01 00 00 0f 85 3a 01 00 00 80 3d 73 82 bd 00 00 0f 84 bd 01 00 00 4c 89 ef 57 9d <66> 66 90 66 90 48 83 c4 10 5b 41 5c 41 5d 5d c3 0f 1f 84 00 00