Memory information and FRU identification from prtdiag on the Sun Fire[TM] V440

Asset ID:	1-71-1012312.1
Update Date:	2018-02-14
Keywords:

Solution Type Technical Instruction Sure

Solution 1012312.1 : Memory information and FRU identification from prtdiag on the Sun Fire[TM] V440

Applies to:

Sun Netra 440 Server - Version Not Applicable to Not Applicable [Release N/A]
Sun Fire V440 Server - Version Not Applicable to Not Applicable [Release N/A]
All Platforms

Goal

To discuss this information further with Oracle experts and industry peers, we encourage you to review, join or start a discussion in the My Oracle Support Community - SPARC Legacy Servers

The Sun Fire[TM] V440 prior to Solaris 10, reports memory information differently in prtdiag, which can lead to the wrong FRU being sent out when a DIMM bank has been determined faulty. This document will help explain the display.

Solution

An example of the memory section of "prtdiag -v" from a v440:

System Configuration: Sun Microsystems sun4u Sun Fire V440
System clock frequency: 183 MHZ
Memory size: 16GB

==================================== CPUs ====================================
               E$          CPU                   CPU     Temperature
CPU Freq      Size        Implementation      Mask    Die   Amb. Status      Location
--- -------- ---------- --------------------- -----   ---- ---- ------      --------
0 1281 MHz 1MB         SUNW,UltraSPARC-IIIi     3.4     -     -    online       -
1 1281 MHz 1MB         SUNW,UltraSPARC-IIIi     3.4     -     -    online       -
2 1281 MHz 1MB         SUNW,UltraSPARC-IIIi     3.4     -     -    online       -
3 1281 MHz 1MB         SUNW,UltraSPARC-IIIi     3.4     -     -    online       -

---   Snip Additional output -----

============================ Memory Configuration ============================
Segment Table:
-----------------------------------------------------------------------
Base Address       Size       Interleave Factor Contains
-----------------------------------------------------------------------
0x0                4GB               16          BankIDs 0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15
0x1000000000       4GB               16          BankIDs 16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31
0x2000000000       4GB               16          BankIDs 32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47
0x3000000000       4GB               16          BankIDs 48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63

Bank Table:
-----------------------------------------------------------
           Physical Location
ID       ControllerID GroupID   Size       Interleave Way
-----------------------------------------------------------
0        0             0         256MB           0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15
1        0             0         256MB
2        0             1         256MB
3        0             1         256MB
4        0             0         256MB
5        0             0         256MB
6        0             1         256MB
7        0             1         256MB
8        0             1         256MB
9        0             1         256MB
10       0             0         256MB
11       0             0         256MB
12       0             1         256MB
13       0             1         256MB
14       0             0         256MB
15       0             0         256MB
16       1             0         256MB           0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15
17       1             0         256MB
18       1             1         256MB
19       1             1         256MB
20       1             0         256MB
21       1             0         256MB
22       1             1         256MB
23       1             1         256MB
24       1             1         256MB
25       1             1         256MB
26       1             0         256MB
27       1             0         256MB
28       1             1         256MB
29       1             1         256MB
30       1             0         256MB
31       1             0         256MB
32       2             0         256MB           0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15
33       2             0         256MB
34       2             1         256MB
35       2             1         256MB
36       2             0         256MB
37       2             0         256MB
38       2             1         256MB
39       2             1         256MB
40       2             1         256MB
41       2             1         256MB
42       2             0         256MB
43       2             0         256MB
44       2             1         256MB
45       2             1         256MB
46       2             0         256MB
47       2             0         256MB
48       3             0         256MB           0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15
49       3             0         256MB
50       3             1         256MB
51       3             1         256MB
52       3             0         256MB
53       3             0         256MB
54       3             1         256MB
55       3             1         256MB
56       3             1         256MB
57       3             1         256MB
58       3             0         256MB
59       3             0         256MB
60       3             1         256MB
61       3             1         256MB
62       3             0         256MB
63       3             0         256MB

Memory Module Groups:
--------------------------------------------------
ControllerID   GroupID Labels         Status
--------------------------------------------------
0              0        C0/P0/B0/D0
0              0        C0/P0/B0/D1
0              1        C0/P0/B1/D0
0              1        C0/P0/B1/D1
1              0        C1/P0/B0/D0
1              0        C1/P0/B0/D1
1              1        C1/P0/B1/D0
1              1        C1/P0/B1/D1
2              0        C2/P0/B0/D0
2              0        C2/P0/B0/D1
2              1        C2/P0/B1/D0
2              1        C2/P0/B1/D1
3              0        C3/P0/B0/D0
3              0        C3/P0/B0/D1
3              1        C3/P0/B1/D0
3              1        C3/P0/B1/D1

In this output, we see that the memory is interleaved 16-way (default) for each board. There are four boards on this system. Sometimes an attempt is made to replace a failed DIMM location with the logical interleaved segment size (in this case, 256MB) instead of the physical DIMM size (1G in this case).

The only supported DIMM sizes currently for the V440 are 512MB, 1GB, and 2GB, and the FRU consists of two memory modules. There are 4 DIMM slots per CPU Memory Board. The DIMMs are set up in 2 banks of 2 DIMMS. To determine the physical sizes of the individual DIMM in the FRU, divide the total memory per board (as seen in the "size" section of the segment table in prtdiag) by 4 if there 2 banks installed, or by 2 if there is one bank installed on that particular board.

See this document to relate the J0XXX number to the CPU/Bank/DIMM.

CPU / Memory Dimm Map Sun Fire V440, Sun Fire V445 and Netra 440 (Doc ID 1490956.1)

Further detailed information about the V440 memory:

JEDEC Industry Standard Double Data Rate (DDR-1) SDRAM memory sub-system with ECC protection
Nominal speed operates up to 133MHz frequency, providing 266MHz DDR-1 (PC2100) support
Supports Industry Standard 1.2" high 184-pin DDR-1 SDRAM Registered ECC DIMM's (Note: Per the DDR Memory Big Rules, only Sun tested and approved DIMM's are officially supported by Sun)
Total of 4 DIMM slots per CPU/Memory Module; 16 slots per system with 4 CPU/Memory Modules
DIMM sizes supported at RR/GA are 512MB, 1GB & 2 GB (Note: 256MB DIMM's are NOT supported in V440)
System Min/Max Memory is 1 GB/32 GB
Each module DIMM slots are arranged in 2 physical groups of 2 DIMM's
Each DIMM group (pair) provides 1 or 2 external logical banks depending on whether the DIMM's are single-sided or double-sided, and 4 internal banks per pair which are interleaved by default.
XOR is a new type of interleaving that distributes memory areas into the CPU L2$ more optimally, increasing the CPU L2$ hit rate, and maximizing utilization of the L2$
Maximum performance per CPU/Memory module occurs when using 4 double-sided DIMM's of the same type and size. This is visible in "prtdiag" as Interleave Factor "16"
Interleaving and XOR occurs between DIMM pairs that are the same capacity and type installed on the same CPU. "prtdiag" Interleave Factor of "16" if the DIMM's are double-sided and "4" if the DIMM's are single-sided
If only 1 pair of DIMM's is installed, XOR is always enabled and interleaving occurs between the 2 external logical banks if the DIMM's are both double-sided. "prtdiag" Interleave Factor "2" if double-sided, "1" if single-sided
No memory interleaving or XOR between DIMM pairs of different capacity installed on the same CPU. Interleaving may still occur within the pair if either pair has double-sided DIMM's installed showing in "prtdiag" as Interleave Factor "2". If either pair is single-sided DIMM's, "prtdiag" will show Interleave Factor "1"
No memory interleaving between CPU/Memory modules.
Automatic System Recovery support for automatic offlining of failed DIMM banks
72 data bits per memory DIMM; 2 DIMM's (144 bits) min per group (Note: DIMM's MUST be installed/removed in PAIRS; the FRU is the PAIR)
At least 1 pair must be present and functioning for the system to boot.
2.1 GB/s transfer rate per pair; 4.2 GB/s per module

References

<NOTE:1490956.1> - CPU / Memory Dimm Map Sun Fire V440, Sun Fire V445 and Netra 440

Attachments

This solution has no attachment