syzbot


INFO: rcu detected stall in tcp_write_timer (2)

Status: upstream: reported on 2025/02/22 02:50
Reported-by: syzbot+[email protected]
First crash: 124d, last: 40d
Similar bugs (15)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in tcp_write_timer (2) bpf 2 1604d 1660d 0/29 auto-closed as invalid on 2021/05/03 11:59
upstream INFO: rcu detected stall in tcp_write_timer (4) net 1 345d 345d 0/29 auto-obsoleted due to no activity on 2024/10/13 08:46
linux-5.15 INFO: rcu detected stall in tcp_write_timer 4 254d 307d 0/3 auto-obsoleted due to no activity on 2025/01/22 08:13
upstream INFO: rcu detected stall in tcp_write_timer net 3 2153d 2148d 0/29 auto-closed as invalid on 2019/10/25 14:11
upstream INFO: rcu detected stall in tcp_write_timer (3) net 1 1471d 1471d 0/29 auto-closed as invalid on 2021/09/13 13:17
linux-6.1 INFO: rcu detected stall in tcp_write_timer 16 140d 370d 0/3 auto-obsoleted due to no activity on 2025/05/16 12:07
upstream BUG: soft lockup in tcp_write_timer (4) kasan mm 4 355d 379d 26/29 fixed on 2024/07/09 19:14
linux-4.14 INFO: rcu detected stall in tcp_write_timer 4 1756d 1998d 0/1 auto-closed as invalid on 2021/01/02 05:45
linux-4.19 INFO: rcu detected stall in tcp_write_timer 2 1884d 1939d 0/1 auto-closed as invalid on 2020/08/26 06:46
linux-4.19 BUG: soft lockup in tcp_write_timer (3) 2 908d 921d 0/1 upstream: reported on 2022/12/17 21:41
linux-4.19 BUG: soft lockup in tcp_write_timer (2) 2 1317d 1381d 0/1 auto-closed as invalid on 2022/03/16 10:56
linux-4.19 BUG: soft lockup in tcp_write_timer 1 1546d 1546d 0/1 auto-closed as invalid on 2021/07/30 14:52
upstream BUG: soft lockup in tcp_write_timer (2) kvm 1 1157d 1157d 0/29 auto-closed as invalid on 2022/06/24 22:31
upstream BUG: soft lockup in tcp_write_timer (3) net 6 534d 642d 0/29 closed as invalid on 2024/03/18 17:07
android-5-15 BUG: soft lockup in tcp_write_timer 11 318d 430d 0/2 auto-obsoleted due to no activity on 2024/11/10 05:27

Sample crash report:
rcu: INFO: rcu_preempt self-detected stall on CPU
rcu: 	1-....: (10501 ticks this GP) idle=7f9/1/0x4000000000000000 softirq=28517/28517 fqs=90 
	(t=10502 jiffies g=38785 q=366)
rcu: rcu_preempt kthread starved for 1327 jiffies! g38785 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0
rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt     state:R  running task     stack:28032 pid:   15 ppid:     2 flags:0x00004000
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5030 [inline]
 __schedule+0x11b8/0x43b0 kernel/sched/core.c:6376
 schedule+0x11b/0x1e0 kernel/sched/core.c:6459
 schedule_timeout+0x15c/0x280 kernel/time/timer.c:1914
 rcu_gp_fqs_loop+0x29e/0x11b0 kernel/rcu/tree.c:1972
 rcu_gp_kthread+0x98/0x350 kernel/rcu/tree.c:2145
 kthread+0x436/0x520 kernel/kthread.c:334
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:287
 </TASK>
rcu: Stack dump where RCU GP kthread last ran:
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 9958 Comm: syz.4.2039 Not tainted 5.15.182-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 04/19/2025
RIP: 0010:asm_sysvec_apic_timer_interrupt+0x0/0x20 arch/x86/include/asm/idtentry.h:675
Code: e9 e5 04 00 00 90 90 90 90 90 0f 01 ca fc 6a ff e8 e5 03 00 00 48 89 c4 48 89 e7 e8 0a 1b e1 ff e9 c5 04 00 00 90 90 90 90 90 <0f> 01 ca fc 6a ff e8 c5 03 00 00 48 89 c4 48 89 e7 e8 5a 19 e1 ff
RSP: 0018:ffffc90000007458 EFLAGS: 00000002
RAX: 0000000000000003 RBX: ffffc900000075c8 RCX: 0000000000000001
RDX: ffffc900000075c8 RSI: ffffc90000007848 RDI: ffffc90000007848
RBP: ffffc90000008000 R08: dffffc0000000000 R09: ffffc900000075d8
R10: fffff52000000ebd R11: 1ffff92000000ebb R12: dffffc0000000000
R13: ffffc90000000000 R14: ffffc90000007848 R15: ffffc90000007588
FS:  0000000000000000(0000) GS:ffff8880b9000000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fff96b91f19 CR3: 00000000524f4000 CR4: 00000000003506f0
DR0: 0000200000000300 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000600
Call Trace:
 <IRQ>
RIP: 0010:__read_once_word_nocheck+0x3/0x10 include/asm-generic/rwonce.h:67
Code: 8c c6 fc ff ff 4c 89 e7 e8 2a a3 88 00 48 ba 00 00 00 00 00 fc ff df e9 af fc ff ff 66 2e 0f 1f 84 00 00 00 00 00 90 48 8b 07 <c3> 00 00 cc cc 00 00 cc cc 00 00 cc cc 31 c0 81 ff 03 00 00 40 0f
RSP: 0018:ffffc90000007488 EFLAGS: 00000202
 deref_stack_reg+0xd0/0x120 arch/x86/kernel/unwind_orc.c:360
 unwind_next_frame+0x115d/0x1d90 arch/x86/kernel/unwind_orc.c:-1
 arch_stack_walk+0x10c/0x140 arch/x86/kernel/stacktrace.c:25
 stack_trace_save+0x98/0xe0 kernel/stacktrace.c:122
 save_stack+0xf3/0x1e0 mm/page_owner.c:119
 __reset_page_owner+0x51/0x180 mm/page_owner.c:140
 reset_page_owner include/linux/page_owner.h:24 [inline]
 free_pages_prepare mm/page_alloc.c:1340 [inline]
 free_pcp_prepare mm/page_alloc.c:1391 [inline]
 free_unref_page_prepare+0x637/0x6c0 mm/page_alloc.c:3317
 free_unref_page+0x94/0x280 mm/page_alloc.c:3396
 put_page include/linux/mm.h:1247 [inline]
 __skb_frag_unref include/linux/skbuff.h:3231 [inline]
 skb_release_data+0x3fa/0x850 net/core/skbuff.c:672
 skb_release_all net/core/skbuff.c:742 [inline]
 __kfree_skb+0x4c/0x60 net/core/skbuff.c:756
 tcp_write_queue_purge+0x13d/0x3e0 net/ipv4/tcp.c:2963
 tcp_done_with_error+0x3f/0xc0 net/ipv4/tcp_input.c:4385
 tcp_write_err net/ipv4/tcp_timer.c:70 [inline]
 tcp_write_timeout net/ipv4/tcp_timer.c:273 [inline]
 tcp_retransmit_timer+0x118e/0x2500 net/ipv4/tcp_timer.c:543
 tcp_write_timer_handler+0x205/0x9a0 net/ipv4/tcp_timer.c:655
 tcp_write_timer+0x126/0x280 net/ipv4/tcp_timer.c:675
 call_timer_fn+0x16c/0x530 kernel/time/timer.c:1451
 expire_timers kernel/time/timer.c:1496 [inline]
 __run_timers+0x525/0x7c0 kernel/time/timer.c:1767
 run_timer_softirq+0x63/0xf0 kernel/time/timer.c:1780
 handle_softirqs+0x328/0x820 kernel/softirq.c:558
 __do_softirq kernel/softirq.c:592 [inline]
 invoke_softirq kernel/softirq.c:432 [inline]
 __irq_exit_rcu+0x12f/0x220 kernel/softirq.c:641
 irq_exit_rcu+0x5/0x20 kernel/softirq.c:653
 instr_sysvec_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1108 [inline]
 sysvec_apic_timer_interrupt+0xa0/0xc0 arch/x86/kernel/apic/apic.c:1108
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:676
RIP: 0010:zap_pte_range mm/memory.c:1438 [inline]
RIP: 0010:zap_pmd_range mm/memory.c:1505 [inline]
RIP: 0010:zap_pud_range mm/memory.c:1534 [inline]
RIP: 0010:zap_p4d_range mm/memory.c:1555 [inline]
RIP: 0010:unmap_page_range+0x18df/0x2520 mm/memory.c:1576
Code: 00 00 00 fc ff df 41 80 3c 04 00 74 0a 48 8b 7c 24 10 e8 14 72 10 00 49 89 1f 48 8b 5c 24 10 4c 39 74 24 78 0f 84 5f 03 00 00 <49> 83 c7 08 e8 48 fe ca ff 48 83 c3 08 49 81 c6 00 10 00 00 e9 ba
RSP: 0018:ffffc900030af560 EFLAGS: 00000206
RAX: ffffffff81acb7a5 RBX: ffff888067394d88 RCX: ffff88802bce9dc0
RDX: 0000000000000000 RSI: 00000000000001fe RDI: 00000000000000c8
RBP: ffffc900030af6d0 R08: dffffc0000000000 R09: fffff9400031e90f
R10: fffff9400031e90f R11: 1ffffd400031e90e R12: ffffea00018f4870
R13: ffffc900030af840 R14: 00007fecc09b2000 R15: ffff888067394d88
 unmap_vmas+0x11b/0x230 mm/memory.c:1653
 exit_mmap+0x38f/0x5f0 mm/mmap.c:3204
 __mmput+0x115/0x3b0 kernel/fork.c:1127
 exit_mm+0x567/0x6c0 kernel/exit.c:550
 do_exit+0x599/0x20a0 kernel/exit.c:861
 do_group_exit+0x12e/0x300 kernel/exit.c:996
 get_signal+0x6ca/0x12c0 kernel/signal.c:2900
 arch_do_signal_or_restart+0xc1/0x1300 arch/x86/kernel/signal.c:867
 handle_signal_work kernel/entry/common.c:154 [inline]
 exit_to_user_mode_loop+0x9e/0x130 kernel/entry/common.c:178
 exit_to_user_mode_prepare+0xb1/0x140 kernel/entry/common.c:214
 __syscall_exit_to_user_mode_work kernel/entry/common.c:296 [inline]
 syscall_exit_to_user_mode+0x16/0x40 kernel/entry/common.c:307
 do_syscall_64+0x58/0xa0 arch/x86/entry/common.c:86
 entry_SYSCALL_64_after_hwframe+0x66/0xd0
RIP: 0033:0x7fecc1e55969
Code: Unable to access opcode bytes at RIP 0x7fecc1e5593f.
RSP: 002b:00007fecbfcbd038 EFLAGS: 00000246 ORIG_RAX: 000000000000012a
RAX: ffffffffffffffea RBX: 00007fecc207cfa0 RCX: 00007fecc1e55969
RDX: ffffffffffffffff RSI: 0000000000000000 RDI: 0000200000000500
RBP: 00007fecc1ed7ab1 R08: 0000000000000000 R09: 0000000000000000
R10: ffffffffffffffff R11: 0000000000000246 R12: 0000000000000000
R13: 0000000000000000 R14: 00007fecc207cfa0 R15: 00007ffc0fe71fe8
 </TASK>
NMI backtrace for cpu 1
CPU: 1 PID: 9946 Comm: syz.3.2036 Not tainted 5.15.182-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 04/19/2025
Call Trace:
 <IRQ>
 dump_stack_lvl+0x168/0x230 lib/dump_stack.c:106
 nmi_cpu_backtrace+0x397/0x3d0 lib/nmi_backtrace.c:111
 nmi_trigger_cpumask_backtrace+0x163/0x280 lib/nmi_backtrace.c:62
 trigger_single_cpu_backtrace include/linux/nmi.h:166 [inline]
 rcu_dump_cpu_stacks+0x22f/0x380 kernel/rcu/tree_stall.h:349
 print_cpu_stall+0x31d/0x5f0 kernel/rcu/tree_stall.h:633
 check_cpu_stall kernel/rcu/tree_stall.h:727 [inline]
 rcu_pending kernel/rcu/tree.c:3932 [inline]
 rcu_sched_clock_irq+0x6d8/0x1110 kernel/rcu/tree.c:2619
 update_process_times+0x193/0x200 kernel/time/timer.c:1818
 tick_sched_handle kernel/time/tick-sched.c:254 [inline]
 tick_sched_timer+0x37d/0x560 kernel/time/tick-sched.c:1473
 __run_hrtimer kernel/time/hrtimer.c:1690 [inline]
 __hrtimer_run_queues+0x4fe/0xc40 kernel/time/hrtimer.c:1754
 hrtimer_interrupt+0x3bb/0x8d0 kernel/time/hrtimer.c:1816
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1097 [inline]
 __sysvec_apic_timer_interrupt+0x137/0x4a0 arch/x86/kernel/apic/apic.c:1114
 instr_sysvec_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1108 [inline]
 sysvec_apic_timer_interrupt+0x4d/0xc0 arch/x86/kernel/apic/apic.c:1108
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:676
RIP: 0010:orc_find arch/x86/kernel/unwind_orc.c:169 [inline]
RIP: 0010:unwind_next_frame+0x1ca/0x1d90 arch/x86/kernel/unwind_orc.c:448
Code: f0 0f 86 f5 14 00 00 44 89 f0 4c 8d 24 85 38 5f 7b 8e 4c 89 e0 48 c1 e8 03 42 0f b6 04 28 84 c0 0f 85 8b 16 00 00 45 8b 24 24 <44> 89 f0 ff c0 4c 8d 3c 85 38 5f 7b 8e 4c 89 f8 48 c1 e8 03 42 0f
RSP: 0018:ffffc90000dd0448 EFLAGS: 00000246
RAX: 0000000000000000 RBX: ffffc90000dd0508 RCX: ffffffff960a0f00
RDX: 000000000008e07f RSI: ffffffff87c58732 RDI: 0000000000000001
RBP: ffffffff87c58731 R08: ffffc90000dd05d0 R09: 0000000000000020
R10: fffff520001ba0ad R11: 1ffff920001ba0ab R12: 0000000000142bc9
R13: dffffc0000000000 R14: 000000000006c587 R15: ffffc90000dd0550
 arch_stack_walk+0x10c/0x140 arch/x86/kernel/stacktrace.c:25
 stack_trace_save+0x98/0xe0 kernel/stacktrace.c:122
 kasan_save_stack mm/kasan/common.c:38 [inline]
 kasan_set_track+0x4b/0x70 mm/kasan/common.c:46
 kasan_set_free_info+0x1f/0x40 mm/kasan/generic.c:360
 ____kasan_slab_free+0xd5/0x110 mm/kasan/common.c:366
 kasan_slab_free include/linux/kasan.h:230 [inline]
 slab_free_hook mm/slub.c:1705 [inline]
 slab_free_freelist_hook+0xea/0x170 mm/slub.c:1731
 slab_free mm/slub.c:3499 [inline]
 kfree+0xef/0x2a0 mm/slub.c:4559
 skb_free_head net/core/skbuff.c:655 [inline]
 skb_release_data+0x6fe/0x850 net/core/skbuff.c:677
 skb_release_all net/core/skbuff.c:742 [inline]
 __kfree_skb+0x4c/0x60 net/core/skbuff.c:756
 tcp_write_queue_purge+0x13d/0x3e0 net/ipv4/tcp.c:2963
 tcp_done_with_error+0x3f/0xc0 net/ipv4/tcp_input.c:4385
 tcp_write_err net/ipv4/tcp_timer.c:70 [inline]
 tcp_write_timeout net/ipv4/tcp_timer.c:273 [inline]
 tcp_retransmit_timer+0x118e/0x2500 net/ipv4/tcp_timer.c:543
 tcp_write_timer_handler+0x205/0x9a0 net/ipv4/tcp_timer.c:655
 tcp_write_timer+0x126/0x280 net/ipv4/tcp_timer.c:675
 call_timer_fn+0x16c/0x530 kernel/time/timer.c:1451
 expire_timers kernel/time/timer.c:1496 [inline]
 __run_timers+0x525/0x7c0 kernel/time/timer.c:1767
 run_timer_softirq+0x63/0xf0 kernel/time/timer.c:1780
 handle_softirqs+0x328/0x820 kernel/softirq.c:558
 __do_softirq kernel/softirq.c:592 [inline]
 invoke_softirq kernel/softirq.c:432 [inline]
 __irq_exit_rcu+0x12f/0x220 kernel/softirq.c:641
 irq_exit_rcu+0x5/0x20 kernel/softirq.c:653
 instr_sysvec_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1108 [inline]
 sysvec_apic_timer_interrupt+0xa0/0xc0 arch/x86/kernel/apic/apic.c:1108
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:676
RIP: 0010:preempt_schedule_irq+0xac/0x150 kernel/sched/core.c:6780
Code: 44 24 20 f6 44 24 21 02 74 0b 0f 0b 48 f7 03 08 00 00 00 74 70 bf 01 00 00 00 e8 3f f1 a7 f7 e8 ca 72 d4 f7 fb bf 01 00 00 00 <e8> cf b5 ff ff 48 c7 44 24 40 00 00 00 00 9c 8f 44 24 40 8b 44 24
RSP: 0018:ffffc9000324ef60 EFLAGS: 00000286
RAX: 6b2f3fccbb1a7600 RBX: 0000000000000000 RCX: 6b2f3fccbb1a7600
RDX: dffffc0000000000 RSI: ffffffff8a0b0fc0 RDI: 0000000000000001
RBP: ffffc9000324f010 R08: dffffc0000000000 R09: fffffbfff1ff3432
R10: fffffbfff1ff3432 R11: 1ffffffff1ff3431 R12: 0000000000000000
R13: 0000000000000000 R14: dffffc0000000000 R15: 1ffff92000649dec
 irqentry_exit+0x63/0x70 kernel/entry/common.c:432
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:676
RIP: 0010:lock_is_held_type+0x13a/0x190 kernel/locking/lockdep.c:5671
Code: 75 40 48 c7 04 24 00 00 00 00 9c 8f 04 24 f7 04 24 00 02 00 00 75 46 41 f7 c5 00 02 00 00 74 01 fb 65 48 8b 04 25 28 00 00 00 <48> 3b 44 24 08 75 3c 89 e8 48 83 c4 10 5b 41 5c 41 5d 41 5e 41 5f
RSP: 0018:ffffc9000324f0d8 EFLAGS: 00000206
RAX: 6b2f3fccbb1a7600 RBX: ffff888017d99dc0 RCX: 6b2f3fccbb1a7600
RDX: 0000000000000002 RSI: ffffffff8a0b2260 RDI: ffffffff8a59a2c0
RBP: 0000000000000001 R08: dffffc0000000000 R09: fffffbfff1ff3419
R10: fffffbfff1ff3419 R11: 1ffffffff1ff3418 R12: 0000000000000001
R13: 0000000000000246 R14: ffffffff8c11bea0 R15: ffff888017d9a8d8
 nf_hook+0x162/0x350 include/linux/netfilter.h:229
 NF_HOOK_COND include/linux/netfilter.h:290 [inline]
 ip_output+0x1ea/0x2b0 net/ipv4/ip_output.c:430
 dst_output include/net/dst.h:452 [inline]
 ip_local_out net/ipv4/ip_output.c:126 [inline]
 __ip_queue_xmit+0x11c3/0x1c00 net/ipv4/ip_output.c:532
 __tcp_transmit_skb+0x1d2a/0x3410 net/ipv4/tcp_output.c:1404
 tcp_transmit_skb net/ipv4/tcp_output.c:1422 [inline]
 tcp_write_xmit+0x1907/0x6590 net/ipv4/tcp_output.c:2707
 __tcp_push_pending_frames+0x92/0x250 net/ipv4/tcp_output.c:2892
 tcp_sendmsg_locked+0x1bed/0x3590 net/ipv4/tcp.c:1408
 tcp_sendmsg+0x2b/0x40 net/ipv4/tcp.c:1457
 sock_sendmsg_nosec net/socket.c:704 [inline]
 __sock_sendmsg net/socket.c:716 [inline]
 ____sys_sendmsg+0x5a2/0x8c0 net/socket.c:2436
 ___sys_sendmsg+0x1f0/0x260 net/socket.c:2490
 __sys_sendmsg net/socket.c:2519 [inline]
 __do_sys_sendmsg net/socket.c:2528 [inline]
 __se_sys_sendmsg+0x190/0x250 net/socket.c:2526
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x4c/0xa0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x66/0xd0
RIP: 0033:0x7f29822ef969
Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 a8 ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007f2980157038 EFLAGS: 00000246 ORIG_RAX: 000000000000002e
RAX: ffffffffffffffda RBX: 00007f2982516fa0 RCX: 00007f29822ef969
RDX: 00000000000052cc RSI: 0000200000000040 RDI: 0000000000000003
RBP: 00007f2982371ab1 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
R13: 0000000000000000 R14: 00007f2982516fa0 R15: 00007ffd039502f8
 </TASK>

Crashes (2):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2025/05/17 02:13 linux-5.15.y 3b8db0e4f263 f41472b0 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan-perf INFO: rcu detected stall in tcp_write_timer
2025/02/22 02:49 linux-5.15.y c16c81c81336 d34966d1 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan-perf INFO: rcu detected stall in tcp_write_timer
* Struck through repros no longer work on HEAD.
OSZAR »