All the mail mirrored from lore.kernel.org
 help / color / mirror / Atom feed
* another perf_fuzzer hard lockup
@ 2014-03-10 15:44 Vince Weaver
  2014-03-10 16:22 ` Vince Weaver
  2014-03-31 17:34 ` perf_fuzzer lockup in x86_schedule_events() Vince Weaver
  0 siblings, 2 replies; 3+ messages in thread
From: Vince Weaver @ 2014-03-10 15:44 UTC (permalink / raw
  To: linux-kernel; +Cc: Peter Zijlstra, Ingo Molnar, Paul Mackerras


Triggered by the perf_fuzzer on a core2 machine, 3.14-rc6.

Hopefully the trace_do_page_fault in the stack trace is incidental and not
showing that something was missed with the recent page fault tracing
fixes.

Vince

[ 7321.924284] BUG: unable to handle kernel NULL pointer dereference at           (null)
[ 7321.928004] IP: [<ffffffff81534f7b>] _raw_spin_lock_irqsave+0x11/0x2d
[ 7321.928004] PGD 118d2b067 PUD 11952d067 PMD 0
[ 7321.928004] Oops: 0002 [#1] SMP
[ 7321.928004] Modules linked in: cpufreq_userspace cpufreq_stats cpufreq_powersave cpufreq_conservative f71882fg mcs7830 usbnet evdev ohci_pci psmouse serio_raw coretemp pcspkr ohci_hcd video wmi i2c_nforce2 acpi_cpufreq button processor thermal_sys sg ehci_pci ehci_hcd sd_mod usbcore usb_common
[ 7321.928004] CPU: 0 PID: 983 Comm: perf_fuzzer Not tainted 3.14.0-rc6 #36
[ 7321.928004] Hardware name: AOpen   DE7000/nMCP7ALPx-DE R1.06 Oct.19.2012, BIOS 080015  10/19/2012
[ 7321.928004] task: ffff8801190b47e0 ti: ffff8800c7b28000 task.ti: ffff8800c7b28000
[ 7321.928004] RIP: 0010:[<ffffffff81534f7b>]  [<ffffffff81534f7b>] _raw_spin_lock_irqsave+0x11/0x2d                                                            
[ 7321.928004] RSP: 0018:ffff8800c7b29a08  EFLAGS: 00010046
[ 7321.928004] RAX: 0000000000000046 RBX: ffff88011a592c00 RCX: 0000000000000000
[ 7321.928004] RDX: 0000000000010000 RSI: ffff88011a592c00 RDI: 0000000000000000
[ 7321.928004] RBP: ffff8800c7b29a08 R08: ffff88011a592c00 R09: 0000000000000000
[ 7321.928004] R10: 0000000000000000 R11: ffff88011b280000 R12: ffff88011fc0b940
[ 7321.928004] R13: 0000000000000000 R14: ffff88011a592d58 R15: 0000000000000000
[ 7321.928004] FS:  0000000002195840(0063) GS:ffff88011fc00000(0000) knlGS:0000000000000000                                                                     
[ 7321.928004] CS:  0010 DS: 002b ES: 002b CR0: 000000008005003b
[ 7321.928004] CR2: 0000000000000000 CR3: 0000000118dad000 CR4: 00000000000407f0
[ 7321.928004] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 7321.928004] DR3: 0000000002197000 DR6: 00000000ffff0ff0 DR7: 0000000000000600
[ 7321.928004] Stack:
[ 7321.928004]  ffff8800c7b29a58 ffffffff810198cc 0000000000000000 0000000000000000                                                                             
[ 7321.928004]  ffff88011fff8d68 0000000000000000 ffff88011a592c00 ffff88011fc0b940                                                                             
[ 7321.928004]  0000000000000040 0000000000000000 ffff8800c7b29a88 ffffffff81019a8f                                                                             
[ 7321.928004] Call Trace:                                                      
[ 7321.928004]  [<ffffffff810198cc>] __intel_shared_reg_get_constraints+0x5e/0x19c                                                                              
[ 7321.928004]  [<ffffffff81019a8f>] intel_get_event_constraints+0x85/0x154     
[ 7321.928004]  [<ffffffff8101434d>] x86_schedule_events+0x54/0x185             
[ 7321.928004]  [<ffffffff81012de6>] x86_pmu_commit_txn+0x51/0x9a               
[ 7321.928004]  [<ffffffff810dbb46>] ? __alloc_pages_nodemask+0x174/0x737       
[ 7321.928004]  [<ffffffff810f3d50>] ? unmap_single_vma+0x605/0x669             
[ 7321.928004]  [<ffffffff810cd121>] ? event_sched_in+0x11d/0x12d               
[ 7321.928004]  [<ffffffff810cd1c9>] group_sched_in+0x98/0x147                  
[ 7321.928004]  [<ffffffff810cd3d6>] ctx_sched_in+0x15e/0x185                   
[ 7321.928004]  [<ffffffff810cd466>] perf_event_sched_in+0x69/0x72              
[ 7321.928004]  [<ffffffff810cd537>] __perf_install_in_context+0xc8/0xf1        
[ 7321.928004]  [<ffffffff810cdd6a>] ? perf_event_task_output+0x13d/0x13d       
[ 7321.928004]  [<ffffffff810cdda6>] remote_function+0x3c/0x43                  
[ 7321.928004]  [<ffffffff810954a3>] smp_call_function_single+0x8a/0x101        
[ 7321.928004]  [<ffffffff810cddf1>] task_function_call+0x44/0x4e               
[ 7321.928004]  [<ffffffff810cd46f>] ? perf_event_sched_in+0x72/0x72            
[ 7321.928004]  [<ffffffff810cdf26>] perf_install_in_context+0x81/0xbc          
[ 7321.928004]  [<ffffffff8153330b>] ? mutex_lock+0x16/0x37                     
[ 7321.928004]  [<ffffffff810d21f5>] SYSC_perf_event_open+0x647/0x7f5           
[ 7321.928004]  [<ffffffff810d23ac>] SyS_perf_event_open+0x9/0xb                
[ 7321.928004]  [<ffffffff8153bf26>] system_call_fastpath+0x1a/0x1f             
[ 7321.928004] Code: c1 07 89 c2 c1 ea 10 66 39 c2 74 0c 66 8b 07 66 39 d0 74 04 f3 90 eb f4 c9 c3 55 48 89 e5 66 66 66 66 90 9c 58 fa ba 00 00 01 00 <f0> 0f c1 17 89 d1 c1 e9 10 66 39 d1 74 0c 66 8b 17 66 39 ca 74                          
[ 7321.928004] RIP  [<ffffffff81534f7b>] _raw_spin_lock_irqsave+0x11/0x2d       
[ 7321.928004]  RSP <ffff8800c7b29a08>                                          
[ 7321.928004] CR2: 0000000000000000                                            
[ 7321.928004] ---[ end trace d36f8f2ae570dc66 ]---                             
[ 7381.931999] INFO: rcu_sched detected stalls on CPUs/tasks: { 0} (detected by 1, t=15002 jiffies, g=55073, c=55072, q=25)                                     
[ 7381.932000] sending NMI to all CPUs:                                         
[ 7381.932000] NMI backtrace for cpu 1                                          
[ 7381.932000] CPU: 1 PID: 1702 Comm: perf_fuzzer Tainted: G      D      3.14.0-rc6 #36                                                                         
[ 7381.932000] Hardware name: AOpen   DE7000/nMCP7ALPx-DE R1.06 Oct.19.2012, BIOS 080015  10/19/2012                                                            
[ 7381.932000] task: ffff880119785010 ti: ffff880119306000 task.ti: ffff880119306000                                                                            
[ 7381.932000] RIP: 0010:[<ffffffff812a7277>]  [<ffffffff812a7277>] __const_udelay+0x1b/0x27                                                                    
[ 7381.932000] RSP: 0000:ffff88011fc83d98  EFLAGS: 00000803                     
[ 7381.932000] RAX: 0000000039558400 RBX: 0000000000000001 RCX: 0000000000000003
[ 7381.932000] RDX: 00000000002658dc RSI: 0000000000000200 RDI: 0000000000418958
[ 7381.932000] RBP: ffff88011fc83d98 R08: 0000000000000000 R09: 0000000000000008
[ 7381.932000] R10: 0000000000000000 R11: 0000000000000005 R12: ffff88011fc8d510
[ 7381.932000] R13: 0000000000000001 R14: ffffffff81a37300 R15: 0000000000000001
[ 7381.932000] FS:  0000000002195840(0063) GS:ffff88011fc80000(0000) knlGS:0000000000000000                                                                     
[ 7381.932000] CS:  0010 DS: 002b ES: 002b CR0: 000000008005003b                
[ 7381.932000] CR2: 000000000040b040 CR3: 00000001196d2000 CR4: 00000000000407e0
[ 7381.932000] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000002197000
[ 7381.932000] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000600
[ 7381.932000] Stack:                                                           
[ 7381.932000]  ffff88011fc83db8 ffffffff8102c1ed 000000000000d720 ffffffff81a37300                                                                             
[ 7381.932000]  ffff88011fc83e18 ffffffff81087ee3 0000000000000000 0000000000000019                                                                             
[ 7381.932000]  ffffffff81a9eb60 0000000000000083 ffff88011fc83e08 ffff880119785010                                                                             
[ 7381.932000] Call Trace:                                                      
[ 7381.932000]  <IRQ>                                                           
[ 7381.932000]  [<ffffffff8102c1ed>] arch_trigger_all_cpu_backtrace+0x79/0x8d   
[ 7381.932000]  [<ffffffff81087ee3>] rcu_check_callbacks+0x462/0x5dd            
[ 7381.932000]  [<ffffffff8104a14c>] update_process_times+0x41/0x6a             
[ 7381.932000]  [<ffffffff81090ebd>] tick_sched_handle+0x4a/0x59                
[ 7381.932000]  [<ffffffff8109108e>] tick_sched_timer+0x5d/0x7c                 
[ 7381.932000]  [<ffffffff8105e5e4>] __run_hrtimer+0xba/0x145                   
[ 7381.932000]  [<ffffffff81091031>] ? tick_nohz_handler+0xb0/0xb0              
[ 7381.932000]  [<ffffffff8105e8b9>] hrtimer_interrupt+0xd5/0x1c3               
[ 7381.932000]  [<ffffffff8102b2a3>] local_apic_timer_interrupt+0x58/0x5d       
[ 7381.932000]  [<ffffffff8102bc5f>] smp_trace_apic_timer_interrupt+0x53/0x91   
[ 7381.932000]  [<ffffffff8153cc3a>] trace_apic_timer_interrupt+0x6a/0x70       
[ 7381.932000]  <EOI>                                                           
[ 7381.932000] Code: 48 89 e5 66 66 66 66 90 ff 15 ee 8f 7b 00 c9 c3 55 48 8d 04 bd 00 00 00 00 65 48 8b 14 25 e0 22 01 00 48 89 e5 48 6b d2 3e f7 e2 <48> 8d 7a 01 ff 15 c7 8f 7b 00 c9 c3 55 48 89 e5 66 66 66 66 90                          
[ 7322.969219] NMI backtrace for cpu 0                                          
[ 7381.932000] INFO: NMI handler (arch_trigger_all_cpu_backtrace_handler) took too long to run: 692.154 msecs                                                   
[ 7322.969219] CPU: 0 PID: 983 Comm: perf_fuzzer Tainted: G      D      3.14.0-rc6 #36                                                                          
[ 7322.969219] Hardware name: AOpen   DE7000/nMCP7ALPx-DE R1.06 Oct.19.2012, BIOS 080015  10/19/2012                                                            
[ 7322.969219] task: ffff8801190b47e0 ti: ffff8800c7b28000 task.ti: ffff8800c7b28000                                                                            
[ 7322.969219] RIP: 0010:[<ffffffff81534ff3>]  [<ffffffff81534ff3>] _raw_spin_lock+0x26/0x2a                                                                    
[ 7322.969219] RSP: 0018:ffff88011fc03e48  EFLAGS: 00000097                     
[ 7322.969219] RAX: 000000006f8f6f8e RBX: ffff88011a2a92c0 RCX: ffff88011fc03e98
[ 7322.969219] RDX: 0000000000006f8f RSI: ffff88011a2a92c0 RDI: ffff88011fc15b2c
[ 7322.969219] RBP: ffff88011fc03e48 R08: ffff88011fc0d010 R09: 0000000000000104
[ 7322.969219] R10: ffff88011fc12ae0 R11: ffff88011fc0d010 R12: ffff88011a2a92c0
[ 7322.969219] R13: ffff88011fc15c08 R14: 0000000000000000 R15: ffff88011fc0d0c8
[ 7322.969219] FS:  0000000002195840(0063) GS:ffff88011fc00000(0000) knlGS:0000000000000000                                                                     
[ 7322.969219] CS:  0010 DS: 002b ES: 002b CR0: 000000008005003b                
[ 7322.969219] CR2: 0000000000000000 CR3: 0000000118dad000 CR4: 00000000000407f0
[ 7322.969219] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 7322.969219] DR3: 0000000002197000 DR6: 00000000ffff0ff0 DR7: 0000000000000600
[ 7322.969219] Stack:                                                           
[ 7322.969219]  ffff88011fc03e68 ffffffff810cb8df ffff88011fc03e98 ffff88011fc15b20                                                                             
[ 7322.969219]  ffff88011fc03e98 ffffffff810cd5da ffff88011fc15c08 ffff88011fc0d010                                                                             
[ 7322.969219]  ffff88011fc0d050 ffff88011fc03f28 ffff88011fc03ee8 ffffffff8105e5e4                                                                             
[ 7322.969219] Call Trace:                                                      
[ 7322.969219]  <IRQ>                                                           
[ 7322.969219]  [<ffffffff810cb8df>] perf_ctx_lock+0x15/0x27                    
[ 7322.969219]  [<ffffffff810cd5da>] perf_cpu_hrtimer_handler+0x7a/0x1b0        
[ 7322.969219]  [<ffffffff8105e5e4>] __run_hrtimer+0xba/0x145                   
[ 7322.969219]  [<ffffffff810cd560>] ? __perf_install_in_context+0xf1/0xf1      
[ 7322.969219]  [<ffffffff8105e8b9>] hrtimer_interrupt+0xd5/0x1c3               
[ 7322.969219]  [<ffffffff8102b2a3>] local_apic_timer_interrupt+0x58/0x5d       
[ 7322.969219]  [<ffffffff8102bc5f>] smp_trace_apic_timer_interrupt+0x53/0x91   
[ 7322.969219]  [<ffffffff8153cc3a>] trace_apic_timer_interrupt+0x6a/0x70       
[ 7322.969219]  <EOI>                                                           
[ 7322.969219]  [<ffffffff8105f36d>] ? blocking_notifier_call_chain+0x14/0x16   
[ 7322.969219]  [<ffffffff8109be4f>] ? acct_collect+0x175/0x17d                 
[ 7322.969219]  [<ffffffff81041a14>] do_exit+0x22f/0x947                        
[ 7322.969219]  [<ffffffff81535fd2>] oops_end+0xb5/0xbd                         
[ 7322.969219]  [<ffffffff81034a30>] no_context+0x26d/0x27c                     
[ 7322.969219]  [<ffffffff81034bfc>] __bad_area_nosemaphore+0x1bd/0x1dd         
[ 7322.969219]  [<ffffffff81034c78>] bad_area+0x47/0x4e                         
[ 7322.969219]  [<ffffffff8153831d>] __do_page_fault+0x25b/0x3ed                
[ 7322.969219]  [<ffffffff810cd3d6>] ? ctx_sched_in+0x15e/0x185                 
[ 7322.969219]  [<ffffffff810cd466>] ? perf_event_sched_in+0x69/0x72            
[ 7322.969219]  [<ffffffff81538539>] trace_do_page_fault+0x8a/0x93              
[ 7322.969219]  [<ffffffff81535572>] trace_page_fault+0x22/0x30                 
[ 7322.969219]  [<ffffffff81534f7b>] ? _raw_spin_lock_irqsave+0x11/0x2d         
[ 7322.969219]  [<ffffffff810198cc>] __intel_shared_reg_get_constraints+0x5e/0x19c                                                                              
[ 7322.969219]  [<ffffffff81019a8f>] intel_get_event_constraints+0x85/0x154     
[ 7322.969219]  [<ffffffff8101434d>] x86_schedule_events+0x54/0x185             
[ 7322.969219]  [<ffffffff81012de6>] x86_pmu_commit_txn+0x51/0x9a               
[ 7322.969219]  [<ffffffff810dbb46>] ? __alloc_pages_nodemask+0x174/0x737       
[ 7322.969219]  [<ffffffff810f3d50>] ? unmap_single_vma+0x605/0x669             
[ 7322.969219]  [<ffffffff810cd121>] ? event_sched_in+0x11d/0x12d               
[ 7322.969219]  [<ffffffff810cd1c9>] group_sched_in+0x98/0x147                  
[ 7322.969219]  [<ffffffff810cd3d6>] ctx_sched_in+0x15e/0x185                   
[ 7322.969219]  [<ffffffff810cd466>] perf_event_sched_in+0x69/0x72              
[ 7322.969219]  [<ffffffff810cd537>] __perf_install_in_context+0xc8/0xf1        
[ 7322.969219]  [<ffffffff810cdd6a>] ? perf_event_task_output+0x13d/0x13d       
[ 7322.969219]  [<ffffffff810cdda6>] remote_function+0x3c/0x43                  
[ 7322.969219]  [<ffffffff810954a3>] smp_call_function_single+0x8a/0x101        
[ 7322.969219]  [<ffffffff810cddf1>] task_function_call+0x44/0x4e               
[ 7322.969219]  [<ffffffff810cd46f>] ? perf_event_sched_in+0x72/0x72            
[ 7322.969219]  [<ffffffff810cdf26>] perf_install_in_context+0x81/0xbc          
[ 7322.969219]  [<ffffffff8153330b>] ? mutex_lock+0x16/0x37                     
[ 7322.969219]  [<ffffffff810d21f5>] SYSC_perf_event_open+0x647/0x7f5           
[ 7322.969219]  [<ffffffff810d23ac>] SyS_perf_event_open+0x9/0xb                
[ 7322.969219]  [<ffffffff8153bf26>] system_call_fastpath+0x1a/0x1f             
[ 7322.969219] Code: 90 eb f4 c9 c3 55 48 89 e5 66 66 66 66 90 b8 00 00 01 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 74 0c 66 8b 07 66 39 d0 74 04 f3 90 <eb> f4 c9 c3 55 48 89 e5 41 56 41 55 41 54 53 66 66 66 66 90 48                          
[ 7322.969219] INFO: NMI handler (arch_trigger_all_cpu_backtrace_handler) took too long to run: 1971.954 msecs                                                  



^ permalink raw reply	[flat|nested] 3+ messages in thread

* Re: another perf_fuzzer hard lockup
  2014-03-10 15:44 another perf_fuzzer hard lockup Vince Weaver
@ 2014-03-10 16:22 ` Vince Weaver
  2014-03-31 17:34 ` perf_fuzzer lockup in x86_schedule_events() Vince Weaver
  1 sibling, 0 replies; 3+ messages in thread
From: Vince Weaver @ 2014-03-10 16:22 UTC (permalink / raw
  To: Vince Weaver; +Cc: linux-kernel, Peter Zijlstra, Ingo Molnar, Paul Mackerras


Another one, not sure if related to the last one.

These are easy to trigger, but not reproducible at all even with pretty 
exact syscall trace matches.  So I'm not sure what's going on.

3.14-rc6, core2

[ 2696.228000] BUG: soft lockup - CPU#0 stuck for 23s! [perf_fuzzer:10256]      
[ 2696.228000] Modules linked in: cpufreq_userspace cpufreq_stats cpufreq_powersave cpufreq_conservative f71882fg ohci_pci acpi_cpufreq coretemp evdev video mcs7830 usbnet wmi psmouse processor button thermal_sys serio_raw pcspkr ohci_hcd i2c_nforce2 sg ehci_pci ehci_hcd sd_mod usbcore usb_common                       
[ 2696.228000] CPU: 0 PID: 10256 Comm: perf_fuzzer Not tainted 3.14.0-rc6 #36   
[ 2696.228000] Hardware name: AOpen   DE7000/nMCP7ALPx-DE R1.06 Oct.19.2012, BIOS 080015  10/19/2012                                                            
[ 2696.228000] task: ffff88011a6a17e0 ti: ffff8800cbab6000 task.ti: ffff8800cbab6000                                                                            
[ 2696.228000] RIP: 0010:[<ffffffff810d0767>]  [<ffffffff810d0767>] __perf_sw_event+0x117/0x192                                                                 
[ 2696.228000] RSP: 0000:ffff8800cbab7c88  EFLAGS: 00000246                     
[ 2696.228000] RAX: ffff88011a7b5cba RBX: 0000000000000000 RCX: ffff88011a9c4000
[ 2696.228000] RDX: ffff88011a7b5c00 RSI: 0400000000000000 RDI: 4000000000000000
[ 2696.228000] RBP: ffff8800cbab7d48 R08: 0010000000000000 R09: ffff88011fc12ac0
[ 2696.228000] R10: 0000000000000000 R11: ffff880119dfcb60 R12: 0000000000000000
[ 2696.228000] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
[ 2696.228000] FS:  0000000000bd5840(0063) GS:ffff88011fc00000(0000) knlGS:0000000000000000                                                                     
[ 2696.228000] CS:  0010 DS: 002b ES: 002b CR0: 000000008005003b                
[ 2696.228000] CR2: 0000000000bd5ac8 CR3: 00000000ca4c8000 CR4: 00000000000407f0
[ 2696.228000] DR0: 0000000000bd7000 DR1: 0000000000bd7000 DR2: 0000000000000000
[ 2696.228000] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000600
[ 2696.228000] Stack:                                                           
[ 2696.228000]  0000000000000000 0000000000000000 0000000000000000 0000000000000000                                                                             
[ 2696.228000]  0000000000bd5ac8 0000000000000000 0000000000000000 0000000000000000                                                                             
[ 2696.228000]  0000000000000000 0000000000000000 0000000000000000 0000000000000000                                                                             
[ 2696.228000] Call Trace:                                                      
[ 2696.228000]  [<ffffffff81538273>] __do_page_fault+0x1b1/0x3ed                
[ 2696.228000]  [<ffffffff81009ab2>] ? native_sched_clock+0x21/0x3e             
[ 2696.228000]  [<ffffffff81069de7>] ? sched_clock_local+0x1c/0x82              
[ 2696.228000]  [<ffffffff8106a0e2>] ? sched_clock_cpu+0x8e/0xaa                
[ 2696.228000]  [<ffffffff8106a119>] ? local_clock+0x1b/0x24                    
[ 2696.228000]  [<ffffffff810cd2ad>] ? ctx_sched_in+0x35/0x185                  
[ 2696.228000]  [<ffffffff8153854e>] do_page_fault+0xc/0xe                      
[ 2696.228000]  [<ffffffff815355a2>] page_fault+0x22/0x30                       
[ 2696.228000]  [<ffffffff812a8280>] ? __put_user_4+0x20/0x30                   
[ 2696.228000]  [<ffffffff81069373>] ? schedule_tail+0x5c/0x60                  
[ 2696.228000]  [<ffffffff8153be0f>] ret_from_fork+0xf/0xb0                     
[ 2696.228000] Code: 00 48 8d 50 c0 48 85 c0 4c 0f 45 ea eb 50 41 83 bd c0 00 00 00 01 75 39 4d 39 bd c8 00 00 00 75 30 41 f6 85 90 01 00 00 01 75 26 <48> 85 db 74 4d 41 8a 85 e8 00 00 00 a8 10 74 09 f6 83 88 00 00                          
                                                                                

^ permalink raw reply	[flat|nested] 3+ messages in thread

* perf_fuzzer lockup in x86_schedule_events()
  2014-03-10 15:44 another perf_fuzzer hard lockup Vince Weaver
  2014-03-10 16:22 ` Vince Weaver
@ 2014-03-31 17:34 ` Vince Weaver
  1 sibling, 0 replies; 3+ messages in thread
From: Vince Weaver @ 2014-03-31 17:34 UTC (permalink / raw
  To: Vince Weaver; +Cc: linux-kernel, Peter Zijlstra, Ingo Molnar, Paul Mackerras


I've been seeing some more of these lockups up x86_schedule_events(),
not sure if they are related.  The fuzzer triggers them often (both
on core2 and haswell) but they are not reproducible with the same random 
seed.

This one is on 3.14 on haswell.

[ 3838.480346] BUG: unable to handle kernel paging request at ffffffff7d760be0
[ 3838.491875] IP: [<ffffffff81029c8c>] x86_schedule_events+0x10c/0x270
[ 3838.502767] PGD 1811067 PUD 0 
[ 3838.510163] Oops: 0000 [#1] SMP 
[ 3838.517638] Dumping ftrace buffer:
[ 3838.525137]    (ftrace buffer empty)
[ 3838.532700] Modules linked in: nfsd auth_rpcgss oid_registry nfs_acl nfs lockd fscache sunrpc fuse snd_hda_codec_hdmi i915 x86_pkg_temp_thermal intel_powerclamp coretemp drm_kms_helper drm kvm crct10dif_pclmul crc32_pclmul parport_pc ghash_clmulni_intel snd_hda_codec_realtek snd_hda_codec_generic snd_hda_intel aesni_intel snd_hda_codec snd_hwdep aes_x86_64 snd_pcm lrw gf128mul glue_helper tpm_tis iTCO_wdt iTCO_vendor_support parport tpm video battery ablk_helper lpc_ich snd_seq snd_seq_device i2c_algo_bit snd_timer psmouse button pcspkr i2c_i801 mei_me serio_raw wmi i2c_core processor mei cryptd snd mfd_core soundcore evdev sg sd_mod sr_mod crc_t10dif cdrom crct10dif_common hid_generic usbhid hid ahci libahci libata scsi_mod e1000e ehci_pci xhci_hcd ehci_hcd ptp pps_core crc32c_intel usbcore usb_common thermal fan thermal_sys
[ 3838.636984] CPU: 2 PID: 28866 Comm: perf_fuzzer Tainted: G        W    3.14.0+ #14
[ 3838.649070] Hardware name: LENOVO 10AM000AUS/SHARKBAY, BIOS FBKT72AUS 01/26/2014
[ 3838.660899] task: ffff8801156e6450 ti: ffff8800cfe66000 task.ti: ffff8800cfe66000
[ 3838.672858] RIP: 0010:[<ffffffff81029c8c>]  [<ffffffff81029c8c>] x86_schedule_events+0x10c/0x270
[ 3838.686239] RSP: 0018:ffff8800cfe67950  EFLAGS: 00010046
[ 3838.695912] RAX: 0000000000000000 RBX: ffff88011ea8ca60 RCX: 0000000000110000
[ 3838.707555] RDX: ffffffff8181e128 RSI: ffff8801181bc400 RDI: ffffffffdead0000
[ 3838.719257] RBP: ffff8800cfe679a8 R08: 0000000000000000 R09: ffffffff81a06be0
[ 3838.730928] R10: ffff88011ea8ee00 R11: 0000000000000005 R12: ffff880116f5a400
[ 3838.742611] R13: ffff88011ea8cf90 R14: 0000000000000004 R15: 0000000000000000
[ 3838.754296] FS:  00007f8b3820c700(0000) GS:ffff88011ea80000(0000) knlGS:0000000000000000
[ 3838.767010] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 3838.777259] CR2: ffffffff7d760be0 CR3: 00000000cf246000 CR4: 00000000001407e0
[ 3838.788988] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 3838.800750] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600
[ 3838.812414] Stack:
[ 3838.818623]  ffff88011ea8cf80 000000021ea57068 0000000000000001 ffff8800cfe679b8
[ 3838.830794]  ffff88011ea8cf90 0000000000000000 ffff88011ea8ca60 ffff880118768ac0
[ 3838.842990]  0000000000000002 ffffffff8181afe0 0000000000000000 ffff8800cfe67ad8
[ 3838.855151] Call Trace:
[ 3838.861900]  [<ffffffff81028829>] x86_pmu_commit_txn+0x49/0xa0
[ 3838.872274]  [<ffffffff8101cba5>] ? native_sched_clock+0x35/0x90
[ 3838.882839]  [<ffffffff8102aa0f>] ? arch_perf_update_userpage+0x7f/0x90
[ 3838.894110]  [<ffffffff8112e076>] ? perf_event_update_userpage+0xa6/0x120
[ 3838.905494]  [<ffffffff8101cba5>] ? native_sched_clock+0x35/0x90
[ 3838.915928]  [<ffffffff8101cc09>] ? sched_clock+0x9/0x10
[ 3838.925549]  [<ffffffff8109afe5>] ? local_clock+0x25/0x30
[ 3838.935186]  [<ffffffff811297a7>] ? cpu_clock_event_stop+0x37/0x50
[ 3838.945515]  [<ffffffff8112c137>] ? perf_pmu_enable+0x27/0x30
[ 3838.955307]  [<ffffffff8112c29b>] ? event_sched_out.isra.75+0x15b/0x1f0
[ 3838.965936]  [<ffffffff8112cd70>] ? event_sched_in.isra.77+0x140/0x1d0
[ 3838.976427]  [<ffffffff8112cfc0>] group_sched_in+0x1c0/0x1e0
[ 3838.985931]  [<ffffffff8112c793>] ? ctx_sched_out+0x123/0x130
[ 3838.995504]  [<ffffffff8112d12b>] ctx_sched_in+0x14b/0x1d0
[ 3839.004775]  [<ffffffff8112d1ea>] perf_event_sched_in+0x3a/0x90
[ 3839.014481]  [<ffffffff8112d6b8>] perf_event_context_sched_in+0x78/0xc0
[ 3839.024927]  [<ffffffff8112ddbc>] __perf_event_task_sched_in+0x18c/0x1a0
[ 3839.035467]  [<ffffffff81091818>] finish_task_switch+0xa8/0x100
[ 3839.045174]  [<ffffffff8155c8ac>] __schedule+0x2cc/0x730
[ 3839.054178]  [<ffffffff8155cd39>] schedule+0x29/0x70
[ 3839.062864]  [<ffffffff8155c019>] schedule_timeout+0x1b9/0x250
[ 3839.072469]  [<ffffffff8131d2eb>] ? debug_object_active_state+0x12b/0x170
[ 3839.083157]  [<ffffffff8155d75f>] wait_for_completion+0x9f/0x110
[ 3839.092953]  [<ffffffff81098130>] ? wake_up_state+0x20/0x20
[ 3839.102279]  [<ffffffff810c4110>] ? call_rcu_bh+0x20/0x20
[ 3839.111418]  [<ffffffff810c1aea>] wait_rcu_gp+0x5a/0x70
[ 3839.120362]  [<ffffffff810c1a30>] ? ftrace_raw_output_rcu_utilization+0x50/0x50
[ 3839.131520]  [<ffffffff810c377a>] synchronize_sched+0x3a/0x50
[ 3839.141007]  [<ffffffff8111bb0b>] perf_trace_event_unreg.isra.1+0x3b/0x90
[ 3839.151643]  [<ffffffff8111be36>] perf_trace_destroy+0x36/0x50
[ 3839.161242]  [<ffffffff81128829>] tp_perf_event_destroy+0x9/0x10
[ 3839.171085]  [<ffffffff8112a583>] __free_event+0x23/0x60
[ 3839.180047]  [<ffffffff8112aac6>] free_event+0x96/0x170
[ 3839.188879]  [<ffffffff81130fce>] SYSC_perf_event_open+0x51e/0xb40
[ 3839.198778]  [<ffffffff8112aff3>] ? perf_event_enable+0x33/0xf0
[ 3839.208402]  [<ffffffff811319b9>] SyS_perf_event_open+0x9/0x10
[ 3839.217942]  [<ffffffff81568d6d>] system_call_fastpath+0x1a/0x1f
[ 3839.227649] Code: 8d 40 01 74 32 48 8b b4 c3 28 05 00 00 48 83 c0 01 48 63 be 4c 01 00 00 4c 8b 8e 88 01 00 00 83 ff ff 0f 84 22 01 00 00 41 89 c0 <49> 0f a3 39 45 19 c9 45 85 c9 75 a0 45 31 e4 44 3b 45 b4 be 01 
[ 3839.256436] RIP  [<ffffffff81029c8c>] x86_schedule_events+0x10c/0x270
[ 3839.266604]  RSP <ffff8800cfe67950>
[ 3839.273438] CR2: ffffffff7d760be0
[ 3839.392197] ---[ end trace 15b4d5d0a680d664 ]---


^ permalink raw reply	[flat|nested] 3+ messages in thread

end of thread, other threads:[~2014-03-31 17:31 UTC | newest]

Thread overview: 3+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2014-03-10 15:44 another perf_fuzzer hard lockup Vince Weaver
2014-03-10 16:22 ` Vince Weaver
2014-03-31 17:34 ` perf_fuzzer lockup in x86_schedule_events() Vince Weaver

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.