Sun ZFS Storage Appliance: Client Tuning - 1MB Block Size Best Practices

Asset ID:	1-79-1640013.1
Update Date:	2018-05-02
Keywords:

Solution Type Predictive Self-Healing Sure

Solution 1640013.1 : Sun ZFS Storage Appliance: Client Tuning - 1MB Block Size Best Practices

Applies to:

Sun ZFS Storage 7320 - Version All Versions to All Versions [Release All Releases]
Oracle ZFS Storage ZS3-2 - Version All Versions to All Versions [Release All Releases]
Sun ZFS Storage 7120 - Version All Versions to All Versions [Release All Releases]
Sun ZFS Storage 7420 - Version All Versions to All Versions [Release All Releases]
Oracle ZFS Storage ZS3-4 - Version All Versions to All Versions [Release All Releases]
7000 Appliance OS (Fishworks)

Purpose

The 1MB block size feature introduced in the 2013.1.1 release of the ZFS Storage Appliance may need additional tuning on all attached hosts to achieve 1MB IO sizes.

This document details the necessary requirements on Windows, Linux, and Solaris when the maxblocksize or recordsize is set to 1MB.

Details

Fibre Channel

Linux - Oracle Linux 6.5 uek3 kernel (previous releases do not support 1MB sizes for multipath)

Create a new file called 99-zfssa.rules inside /etc/udev/rules.d with the following contents:

ACTION=="add", SYSFS{vendor}=="SUN", SYSFS{model}=="*ZFS*", ENV{ID_FS_USAGE}!="filesystem", ENV{ID_PATH}=="*-fc-*", RUN+="/bin/sh -c 'echo 1024 > /sys$DEVPATH/queue/max_sectors_kb'"

Reboot

Windows

QLogic [qlfc]
C:\> qlfcx64.exe -tsize /fc /set 1024
Reboot

Emulex [HBAnyware]
set ExtTransferSize = 1
Reboot

Solaris

# echo 'set maxphys=1048576' >> /etc/system
Reboot

iSCSI

Linux

Create a new file called 99-zfssa.rules inside /etc/udev/rules.d with the following contents:

ACTION=="add", SYSFS{vendor}=="SUN", SYSFS{model}=="*ZFS*", ENV{ID_FS_USAGE}!="filesystem", ENV{ID_PATH}=="*-iscsi-*", RUN+="/bin/sh -c 'echo 1024 > /sys$DEVPATH/queue/max_sectors_kb'"

Reboot

Windows

Open up the Registry Editor (regedit)
Navigate to HKLM\SYSTEM\CurrentControlSet\Control\Class\{4D36E97B-E325-11CE-BFC1-08002BE10318}\<Instance Number>\Parameters
Change the following parameters to 1048576 in Decimal form:
    FirstBurstLength
    MaxBurstLength
    MaxRecvDataSegmentLength
    MaxTransferLength
Reboot

Solaris

# echo 'set maxphys=1048576' >> /etc/system
Reboot

NFS

Linux

# mount -t nfs -o rsize=1048576,wsize=1048576 target:/export/share /mnt/share

Solaris

# mount -F nfs -o rsize=1048576,wsize=1048576 target:/export/share /mnt/share

LUN alignment

Aligning Partitions to Maximize Storage Performance (white paper for Solaris, Linux, Windows, OVM, VMware)
Detecting and Resolving Oracle Solaris LUN Alignment Problems (white paper for Solaris only)
Document 1175573.1 : Sun Storage 7000 Unified Storage System: Configuration and Tuning for iSCSI performance.

Attachments

This solution has no attachment