![]() | Oracle System Handbook - ISO 7.0 May 2018 Internal/Partner Edition | ||
|
|
![]() |
||||||||||||||||
Solution Type Technical Instruction Sure Solution 1601740.1 : [SPARC T4/T5] Booting primary and guest domains with EFI/GPT labeled Disk
In this Document
Created from <SR 3-7838172231> Applies to:SPARC T5-4 - Version All Versions to All Versions [Release All Releases]Netra SPARC T4-2 Server - Version All Versions to All Versions [Release All Releases] SPARC T5-2 - Version All Versions to All Versions [Release All Releases] Netra SPARC T4-1B - Version All Versions to All Versions [Release All Releases] SPARC T4-1 - Version All Versions to All Versions [Release All Releases] Oracle Solaris on SPARC (64-bit) GoalThe purpose of this document is to discuss how to create a bootable EFI/GPT disk on SPARC T4 and T5 platform SolutionSMI and EFI/GPT Label In Solaris a disk partition and label is required before a filesystem ( ZFS or UFS ) can be created on a physical raw disk. Other disk management software like Oracle ASM or Solaris Volume Manager also requires a disk label and partition before the physical disk can be used by these disk management software. Solaris currently support 2 types of disk labeling on SPARC ,they are SMI label and EFI/GPT label. Virtual Table of Contents (VTOC) Label is also known as the Sun Microsystems Inc (SMI) Disk label, The SMI label was the default disk label used by Solaris when it was originally derived from AT&T SVR V (4.2) UNIX. The Solaris VTOC (SMI) implemention is similar but not identical to AT&T SVR V (4.2) UNIX VTOC. The SMI label's significant limitation is that SMI label does not support disk larger than 2TB. An example of a disk with a traditional VTOC/SMI label will have 8 partitions (0-7) Example A (Solaris format/partition utility) partition> p Current partition table (default): Total disk cylinders available: 24620 + 2 (reserved cylinders) Part Tag Flag Cylinders Size Blocks 0 root wm 0 - 90 128.37MB (91/0/0) 262899 1 swap wu 91 - 181 128.37MB (91/0/0) 262899 2 backup wu 0 - 24619 33.92GB (24620/0/0) 71127180 3 unassigned wm 0 0 (0/0/0) 0 4 unassigned wm 0 0 (0/0/0) 0 5 unassigned wm 0 0 (0/0/0) 0 6 usr wm 182 - 24619 33.67GB (24438/0/0) 70601382 7 unassigned wm 0 0 (0/0/0) 0 partition> GUID Partition Table (GPT) is an industry standard definition for disk partition table, GPT is part of the Unified Extensible Firmware Interface (UEFI) standard. In Solaris we call this the EFI/GPT label. EFI/GPT label is required to support DISK greater that 2TB in size, Solaris ZFS uses EFI/GPT labels by default. The EFI label standard can support up to 128 partitions, Solaris currently supports 7 partitions for disk with EFI/GPT labels. Example of EFI label with default partition. Slice 0 contains all the usable sector of the disk and slice 8 contains the alternate sector. Example B (Solaris format/partition utility) partition> print Current partition table (default): Total disk sectors available: 285673405 + 16384 (reserved sectors) Part Tag Flag First Sector Size Last Sector 0 usr wm 34 136.22GB 285673438 1 unassigned wm 0 0 0 2 unassigned wm 0 0 0 3 unassigned wm 0 0 0 4 unassigned wm 0 0 0 5 unassigned wm 0 0 0 6 unassigned wm 0 0 0 8 reserved wm 285673439 8.00MB 285689822 partition> Another example of a disk with EFI label with customize 7 partitions (0-6 ),slice 8 contains the alternate sector. Example C (Solaris format/partition utility) partition> print Current partition table (original): Total disk sectors available: 285673405 + 16384 (reserved sectors) Part Tag Flag First Sector Size Last Sector 0 usr wm 34 100.00GB 209715233 1 usr wm 209715234 1.00GB 211812385 2 usr wm 211812386 1.00GB 213909537 3 usr wm 213909538 1.00GB 216006689 4 usr wm 216006690 1.00GB 218103841 5 usr wm 218103842 1.00GB 220200993 6 usr wm 220200994 1.00GB 222298145 8 reserved wm 285673439 8.00MB 285689822 partition> The quickest way to determine from Solaris if the disk is EFI/GPT labelled is to check the partitions on the disk with Solaris format utility, an EFI/GPT labeled disk will have partition 8 while an SMI labeled will have partition 7. The issue with EFI labeled disk is that it could not be configured as a bootable device on SPARC systems. This had not been a major limitation because the largest bootable internal disk that is qualified on a SPARC T5 is 600GB in capacity (as of November 2013). System Firmware 8.4+ (SPARC T4) and 9.1+ (SPARC T5) removes this EFI/GPT booting limitation. Disk Relabeling The label on the physical disk may be changed by doing the following. WARNING: Deleting the disk label and relabeling the disk will destroy ALL DATA on the disk. STEP 1: delete the disk label with "dd if=/dev/zero of=/dev/rdsk/cXtXdXsX count=100 Example D t5-8-a:/dev/dsk# dd if=/dev/zero of=/dev/rdsk/c13t4d0s0 bs=512 count=100 100+0 records in 100+0 records out root@t5-8-sin06-a:/dev/dsk# STEP 2: Relabel the disk with the command "format -e cXt4XdX " Example E root@t5-8-a:~# format -e c13t4d0 selecting c13t4d0 [disk formatted] FORMAT MENU: disk - select a disk type - select (define) a disk type partition - select (define) a partition table current - describe the current disk format - format and analyze the disk repair - repair a defective sector label - write label to the disk analyze - surface analysis defect - defect list management backup - search for backup labels verify - read and display labels inquiry - show disk ID scsi - independent SCSI mode selects cache - enable, disable or query SCSI disk cache volname - set 8-character volume name !<cmd> - execute <cmd>, then return quit format> label [0] SMI Label [1] EFI Label Specify Label type[1]: 1 Ready to label disk, continue? yes format> format> par PARTITION MENU: 0 - change `0' partition 1 - change `1' partition 2 - change `2' partition 3 - change `3' partition 4 - change `4' partition 5 - change `5' partition 6 - change `6' partition select - select a predefined table modify - modify a predefined partition table name - name the current table print - display the current table label - write partition map and label to the disk !<cmd> - execute <cmd>, then return quit partition> print Current partition table (original): Total disk sectors available: 285673405 + 16384 (reserved sectors) Part Tag Flag First Sector Size Last Sector 0 usr wm 34 136.22GB 285673438 1 unassigned wm 0 0 0 2 unassigned wm 0 0 0 3 unassigned wm 0 0 0 4 unassigned wm 0 0 0 5 unassigned wm 0 0 0 6 unassigned wm 0 0 0 8 reserved wm 285673439 8.00MB 285689822 partition> EFI/GPT boot disk requirement Booting EFI/GPT boot disk on SPARC T4 and SPARC T5 requires that the following minimum software requirement must be met. Note:The Solaris 11.1 installer will prompt that the disk be relabeled to SMI label if OBP firmware does not support EFI/GPT boot. System Firmware 8.4 and System Firmware 9.1 includes SPARC OBP software enhancement bug 15779737, This enhanced feature has been bundled into OBP build 4.35.3. Bug 15779737 - SUNBT7154725 OBP should support booting from GPT-partitioned devices EFI/GPT Disk OVM SPARC (LDOM) environment In a guest LDOM environment, the EFI/GPT label disk should be allocated through DIO (Direct I/O). DIO is a way of exposing the PCI rootcomplex or PCI device endpoints to the Guest Domain. Assigning and EFI/GPT labeled disk slice as a backend resource to an LDOM virtual disk server will cause solaris to fail during solaris Guest LDOM installation. This is a known Solaris issue and is currently being fix. In the example below an EFI/GPT labeled disk is attached to a QLE2562 Fibre Controller on PCIE slot 5. The PCIe rootcomplex pci_8 which control's PCIE slot 5 is assigned as a DIO resource to guest domain (guestdom1). Example F Primary Domain --------------- root@t5-8-a:~# ldm list NAME STATE FLAGS CONS VCPU MEMORY UTIL NORM UPTIME primary active -n-cv- UART 16 128G 0.2% 0.2% 23h 43m guestdom1 active -n---- 5000 128 128G 0.0% 0.0% 17h 16m root@t5-8-sin06-a:~# ldm list -o physio guestdom1 NAME guestdom1 IO DEVICE PSEUDONYM OPTIONS pci@500 pci_8 pci@500/pci@1/pci@0/pci@e /SYS/RCSA/PCIE5 root@t5-8-a:~# Example G Guest Domain ( guestdom1 ) ------------- root@solaris:~# zpool status rpool pool: rpool state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM rpool ONLINE 0 0 0 c3t4d0 ONLINE 0 0 0 errors: No known data errors root@solaris:~# root@solaris:~# format Searching for disks...done AVAILABLE DISK SELECTIONS: 0. c3t4d0 <SUN-CSM200_R-0760-136.23GB> /pci@500/pci@1/pci@0/pci@e/SUNW,qlc@0/fp@0,0/ssd@w201500a0b811fc24,0 1. c3t4d1 <SUN-CSM200_R-0760-136.23GB> /pci@500/pci@1/pci@0/pci@e/SUNW,qlc@0/fp@0,0/ssd@w201500a0b811fc24,1 Specify disk (enter its number): 0 selecting c3t4d0 [disk formatted] /dev/dsk/c3t4d0s0 is part of active ZFS pool rpool. Please see zpool(1M). FORMAT MENU: disk - select a disk type - select (define) a disk type partition - select (define) a partition table current - describe the current disk format - format and analyze the disk repair - repair a defective sector label - write label to the disk analyze - surface analysis defect - defect list management backup - search for backup labels verify - read and display labels inquiry - show disk ID volname - set 8-character volume name !<cmd> - execute <cmd>, then return quit format> partition PARTITION MENU: 0 - change `0' partition 1 - change `1' partition 2 - change `2' partition 3 - change `3' partition 4 - change `4' partition 5 - change `5' partition 6 - change `6' partition select - select a predefined table modify - modify a predefined partition table name - name the current table print - display the current table label - write partition map and label to the disk !<cmd> - execute <cmd>, then return quit partition> print Current partition table (original): Total disk sectors available: 285673405 + 16384 (reserved sectors) Part Tag Flag First Sector Size Last Sector 0 usr wm 256 136.22GB 285673438 1 unassigned wm 0 0 0 2 unassigned wm 0 0 0 3 unassigned wm 0 0 0 4 unassigned wm 0 0 0 5 unassigned wm 0 0 0 6 unassigned wm 0 0 0 8 reserved wm 285673439 8.00MB 285689822 partition> References<NOTE:1012091.1> - Overview of Extensible Firmware Interface (EFI) Disk Labels Versus Volume Table of Contents (VTOC) in the Solaris Operating System<NOTE:1594662.1> - [SPARC T3/T4 and T5] OVM SPARC: LDOM: PCI Root Complex Table <NOTE:1017927.1> - Understanding the Disk Label (VTOC) Attachments This solution has no attachment |
||||||||||||||||
|