This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--Ws0vktcTD2mUitWkSGTPQ66o6G9jGKeSd
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
On 03/11/2014 10:48, Tom Evans wrote:
> On Tue, Mar 11, 2014 at 3:28 PM, Danny Schales <dan@latech.edu> wrote:
>> I'm seeing very slow performance with certain operations on a ZFS
>> filesystem built on ISCSI LUN's on a 10.0 system (new ISCSI
>> implementation). The issue appears to be with BIO_DELETE operations.
>> Monitoring the system with gstat shows expected times for read and wri=
te
>> operations, but deletes are in the multiple hundreds of milliseconds
>> under normal operation. Destroying a snapshot sends the times to
>> astronomical levels. sysctl says the system is using UNMAP for delete=
s:
>>
>> kern.cam.da.0.delete_method: UNMAP
>>
>> I searched and found where Oracle issued a performance alert for Solar=
is
>> 11.1 where ZFS using UNMAP was in use. Here's a link to a blog
>> discussing it:
>>
>> http://schalwad.blogspot.com/2013/12/solaris-111-zfs-write-performance=
=2Ehtml
>>
>>
>> Is FreeBSD also impacted? If so, is there a fix or a workaround?
>=20
> FreeBSD is affected the same way Solaris is. IMHO, neither are
> affected, it is merely a consequence of using a device with a poor
> TRIM/UNMAP algorithm.
>=20
> You can trivially tell ZFS to not use TRIM, or tweak the tunings to
> suit your devices. I'm afraid I don't know what they all mean
> precisely..
>=20
> vfs.zfs.vdev.trim_on_init: 1
> vfs.zfs.vdev.trim_max_bytes: 2147483648
> vfs.zfs.vdev.trim_max_pending: 64
> vfs.zfs.trim.enabled: 1
> vfs.zfs.trim.txg_delay: 32
> vfs.zfs.trim.timeout: 30
> vfs.zfs.trim.max_interval: 1
>=20
> Of course, if you disable TRIM you will end up with new (but
> different) poor performance characteristics. Probably.
The backend is an ISCSI LUN from a SAN (Dell Compellent). From
research, it seems the SAN *does* support SCSI UNMAP requests for
deletes, but the performance is horrible. I don't know if this is a
FreeBSD issue or a Compellent issue. I haven't seen the problem with
other devices, but I don't think anything else is using UNMAP (yet).
Danny
--Ws0vktcTD2mUitWkSGTPQ66o6G9jGKeSd
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.22 (FreeBSD)
iEYEARECAAYFAlMfNQMACgkQymYKbvs0SzE50gCeOxYTP+f4ZUWSRMxIzLAwelLH
QtAAn28Fqtg98S402ew+flQ+Jq2i8Ckk
=vHZk
-----END PGP SIGNATURE-----
--Ws0vktcTD2mUitWkSGTPQ66o6G9jGKeSd--