System Crash at "s_show+0x118/0x300"

Asset ID:	1-72-1932673.1
Update Date:	2018-01-08
Keywords:

Solution Type Problem Resolution Sure

Solution 1932673.1 : System Crash at "s_show+0x118/0x300"

Applies to:

Linux OS - Version Oracle Linux 5.0 and later
Sun Server X3-2 - Version All Versions to All Versions [Release All Releases]
Linux x86-64
Linux x86

Symptoms

System crashes and unexpectedly reboots. The following stack trace can be seen at the system logs or from the vmcore dump:

...
BUG: unable to handle kernel NULL pointer dereference at 0000000000000020
IP: [<ffffffff81159618>] s_show+0x118/0x300
PGD e6da19067 PUD efe314067 PMD 0
Oops: 0000 [#1] SMP
CPU 19
Modules linked in: oracleacfs(P)(U) oracleadvm(P)(U) oracleoks(P)(U) ipmi_poweroff ipmi_watchdog ipmi_devintf ipmi_si nfs fscache auth_rpcgss nfs_acl lockd sunrpc bonding rds_rdma rds ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 mlx4_ib ib_sa ib_mad ib_core mlx4_core video sbs sbshc acpi_pad acpi_memhotplug acpi_ipmi ipmi_msghandler fuse parport_pc lp parport ixgbe hwmon igb snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_mixer_oss snd_pcm snd_timer snd soundcore i2c_i801 snd_page_alloc iTCO_wdt ioatdma i2c_core iTCO_vendor_support dca pcspkr ghes ahci hed libahci dm_snapshot dm_zero dm_mirror dm_region_hash dm_log dm_mod usb_storage ata_piix mpt2sas scsi_transport_sas raid_class sg scsi_dh_rdac scsi_dh_emc scsi_dh_alua sr_mod cdrom shpchp megaraid_sas ext3 jbd mbcache sd_mod crc_t10dif

Pid: 53011, comm: cat Tainted: P 2.6.39-400.128.1.el5uek #1 Oracle Corporation SUN FIRE X4170 M2 SERVER /ASSY,MOTHERBOARD,X4170
RIP: 0010:[<ffffffff81159618>] [<ffffffff81159618>] s_show+0x118/0x300
RSP: 0018:ffff881002247dc8 EFLAGS: 00010003
RAX: 0000000000000000 RBX: ffff8817ed6a4ec0 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 000000000000000f RDI: ffff8817ed6a4ed0
RBP: ffff881002247e38 R08: 0000000000000000 R09: 000000000000fffe
R10: 0000000000000001 R11: 0000ffff00066c0a R12: ffffffff816eb9d8
R13: ffff8817ed6a4f00 R14: 0000000000000078 R15: 0000000000000009
FS: 00007fd31217c6e0(0000) GS:ffff88187f460000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 0000000000000020 CR3: 00000010044f7000 CR4: 00000000000006a0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process cat (pid: 53011, threadinfo ffff881002246000, task ffff880ecbba8640)
Stack:
ffff88100000001e ffff880f00000001 ffff880e711bbf40 ffff8817ea9b2700
0000000000000000 0000000000000000 0000000000000000 0000000002247e78
000000000000000f ffff8817ea9ba758 ffff880e711bbf40 00000000000008da
Call Trace:
[<ffffffff8118cc39>] seq_read+0x2a9/0x3e0
[<ffffffff8118c990>] ? seq_path+0xc0/0xc0
[<ffffffff811c8e06>] proc_reg_read+0x86/0xc0
[<ffffffff8116beeb>] vfs_read+0xcb/0x180
[<ffffffff8116c445>] sys_read+0x55/0x90
[<ffffffff8150ed82>] system_call_fastpath+0x16/0x1b
Code: a8 8b b2 18 80 00 00 eb 22 84 c0 74 0d 85 d2 48 c7 c0 d8 b9 6e 81 4c 0f 44 e0 48 8b 09 89 d0 49 83 c7 01 49 01 c6 48 39 d9 74 1a <8b> 51 20 4d 85 e4 0f 94 c0 39 f2 75 d1 84 c0 74 de 49 c7 c4 b0
RIP [<ffffffff81159618>] s_show+0x118/0x300
RSP <ffff881002247dc8>
CR2: 0000000000000020
...

This problem has been observed on an Exadata compute node, but may be seen on other servers.

Cause

Being called by the Memory Check Exception (MCE), the function "s_show()" usually points to a corruption in the memory. The system may have a faulty processor, memory or on another hardware component.

Solution

Please do an extended test for the hardware.

References

<BUG:19239271> - EXADATA RCA REQUEST : UNABLE TO HANDLE KERNEL NULL POINTER DEREFERENCE

Attachments

This solution has no attachment