I recently had a major disaster with my QNAP TFS-453A while using HFS+ formatted sparseimages. Unfortunately the QNAP somehow corrupts the images after being mounted and then written to at some point. It's very unsettling since they are backups and they can no longer be read or written to. I was able to recover some of the data via a week of restoring from another disk, although I'm concerned about using the QNAP for anything important moving forward.
Does QNAP not support HFS+ formatted images or disks? If it does then what is the proper way of insuring that this undesired behavior does not happen ever again?
This thread from 2010 is similar, but not specific to sparseimages; the last reply is unanswered so maybe the issue still exists.
QNAP TFS-453A corrupted HFS+ sparseimages
-
- Starting out
- Posts: 15
- Joined: Sat Sep 03, 2016 3:37 am
- Trexx
- Ask me anything
- Posts: 5393
- Joined: Sat Oct 01, 2011 7:50 am
- Location: Minnesota
Re: QNAP TFS-453A corrupted HFS+ sparseimages
Have you opened a helpdesk ticket to QNAP?
What version/build of QTS are you using?
How are you getting to the storing/reading the sparseimages? Protocol/app/etc.
More information is needed.
What version/build of QTS are you using?
How are you getting to the storing/reading the sparseimages? Protocol/app/etc.
More information is needed.
Paul
Model: TS-877-1600 FW: 4.5.3.x
QTS (SSD): [RAID-1] 2 x 1TB WD Blue m.2's
Data (HDD): [RAID-5] 6 x 3TB HGST DeskStar
VMs (SSD): [RAID-1] 2 x1TB SK Hynix Gold
Ext. (HDD): TR-004 [Raid-5] 4 x 4TB HGST Ultastor
RAM: Kingston HyperX Fury 64GB DDR4-2666
UPS: CP AVR1350
Model:TVS-673 32GB & TS-228a Offline[/color]
-----------------------------------------------------------------------------------------------------------------------------------------
2018 Plex NAS Compatibility Guide | QNAP Plex FAQ | Moogle's QNAP Faq
Model: TS-877-1600 FW: 4.5.3.x
QTS (SSD): [RAID-1] 2 x 1TB WD Blue m.2's
Data (HDD): [RAID-5] 6 x 3TB HGST DeskStar
VMs (SSD): [RAID-1] 2 x1TB SK Hynix Gold
Ext. (HDD): TR-004 [Raid-5] 4 x 4TB HGST Ultastor
RAM: Kingston HyperX Fury 64GB DDR4-2666
UPS: CP AVR1350
Model:TVS-673 32GB & TS-228a Offline[/color]
-----------------------------------------------------------------------------------------------------------------------------------------
2018 Plex NAS Compatibility Guide | QNAP Plex FAQ | Moogle's QNAP Faq
- schumaku
- Guru
- Posts: 43579
- Joined: Mon Jan 21, 2008 4:41 pm
- Location: Kloten (Zurich), Switzerland -- Skype: schumaku
- Contact:
Re: QNAP TFS-453A corrupted HFS+ sparseimages
When mounting and accessing whatever files - here file used as sparsebundles - these are for the NAS just file(s). The NAS does not know about the content, about the file system used in there, does not use any HFS+ drivers, ...
What protocol do you use, how do you mount the sparsebundles located on the NAS on the Mac.
What protocol do you use, how do you mount the sparsebundles located on the NAS on the Mac.
- Trexx
- Ask me anything
- Posts: 5393
- Joined: Sat Oct 01, 2011 7:50 am
- Location: Minnesota
Re: QNAP TFS-453A corrupted HFS+ sparseimages
Also if user has encrypted volumes, could be related to the SMB bug that was fixed in the latest QTS build.schumaku wrote:When mounting and accessing whatever files - here file used as sparsebundles - these are for the NAS just file(s). The NAS does not know about the content, about the file system used in there, does not use any HFS+ drivers, ...
What protocol do you use, how do you mount the sparsebundles located on the NAS on the Mac.
Paul
Model: TS-877-1600 FW: 4.5.3.x
QTS (SSD): [RAID-1] 2 x 1TB WD Blue m.2's
Data (HDD): [RAID-5] 6 x 3TB HGST DeskStar
VMs (SSD): [RAID-1] 2 x1TB SK Hynix Gold
Ext. (HDD): TR-004 [Raid-5] 4 x 4TB HGST Ultastor
RAM: Kingston HyperX Fury 64GB DDR4-2666
UPS: CP AVR1350
Model:TVS-673 32GB & TS-228a Offline[/color]
-----------------------------------------------------------------------------------------------------------------------------------------
2018 Plex NAS Compatibility Guide | QNAP Plex FAQ | Moogle's QNAP Faq
Model: TS-877-1600 FW: 4.5.3.x
QTS (SSD): [RAID-1] 2 x 1TB WD Blue m.2's
Data (HDD): [RAID-5] 6 x 3TB HGST DeskStar
VMs (SSD): [RAID-1] 2 x1TB SK Hynix Gold
Ext. (HDD): TR-004 [Raid-5] 4 x 4TB HGST Ultastor
RAM: Kingston HyperX Fury 64GB DDR4-2666
UPS: CP AVR1350
Model:TVS-673 32GB & TS-228a Offline[/color]
-----------------------------------------------------------------------------------------------------------------------------------------
2018 Plex NAS Compatibility Guide | QNAP Plex FAQ | Moogle's QNAP Faq
-
- Starting out
- Posts: 15
- Joined: Sat Sep 03, 2016 3:37 am
Re: QNAP TFS-453A corrupted HFS+ sparseimages
@Trexx
To answer your questions:
A sparse disk image is a type of read/write disk image that grows as you copy files to it. In general, sparse disk images only consume as much space as the files they contain consume on disk, making this an ideal format for storing backups.
Read/write "sparsebundle" disk images
A sparse bundle disk image is similar to a sparseimage insofar as it grows as you add data to it, but it retains its data in many smaller files inside of a bundle rather than inside a single file. A sparse bundle may be desirable if the underlying filesystem upon which you save the disk image has a file size limitation (such as FAT32).
Other thoughts:
The behavior is unpredictable also; the sparseimages worked until a certain point then became corrupted. I'm not exactly sure what might have caused it other than A) writing to the sparseimage from NAS (instead of writing from the system and copying the entire image over), B) the sparseimage growing, C) both or something else unknown. Having a backup did me no good though as the corrupted version was copied to the other drive. I tried using RAID 0, RAID 1, and JBOD all with the same end result. I tried mounting the sparseimage via diskutil with the debug flag on which does show a very long and detailed log (with possibly useful information); I'm happy to provide it if it's helpful to anyone.
To answer your questions:
- 1. Yes I've opened a support ticket (still open, and no response)
- 2. Version 4.3.3.0238
- 3. Not encrypted
- 4. Protocol tried was SMB and AFP, both appear to have the same effect
- 5. Writing to the images was done via Finder and through Terminal
- 1. sparse (disk) images are a bit different from sparse (disk) bundles
A sparse disk image is a type of read/write disk image that grows as you copy files to it. In general, sparse disk images only consume as much space as the files they contain consume on disk, making this an ideal format for storing backups.
Read/write "sparsebundle" disk images
A sparse bundle disk image is similar to a sparseimage insofar as it grows as you add data to it, but it retains its data in many smaller files inside of a bundle rather than inside a single file. A sparse bundle may be desirable if the underlying filesystem upon which you save the disk image has a file size limitation (such as FAT32).
Other thoughts:
The behavior is unpredictable also; the sparseimages worked until a certain point then became corrupted. I'm not exactly sure what might have caused it other than A) writing to the sparseimage from NAS (instead of writing from the system and copying the entire image over), B) the sparseimage growing, C) both or something else unknown. Having a backup did me no good though as the corrupted version was copied to the other drive. I tried using RAID 0, RAID 1, and JBOD all with the same end result. I tried mounting the sparseimage via diskutil with the debug flag on which does show a very long and detailed log (with possibly useful information); I'm happy to provide it if it's helpful to anyone.
- Trexx
- Ask me anything
- Posts: 5393
- Joined: Sat Oct 01, 2011 7:50 am
- Location: Minnesota
Re: QNAP TFS-453A corrupted HFS+ sparseimages
Have you tried creating an iSCSI volume on the Qnap and then connecting via iSCSI?
Sent from my iPad using Tapatalk
Sent from my iPad using Tapatalk
Paul
Model: TS-877-1600 FW: 4.5.3.x
QTS (SSD): [RAID-1] 2 x 1TB WD Blue m.2's
Data (HDD): [RAID-5] 6 x 3TB HGST DeskStar
VMs (SSD): [RAID-1] 2 x1TB SK Hynix Gold
Ext. (HDD): TR-004 [Raid-5] 4 x 4TB HGST Ultastor
RAM: Kingston HyperX Fury 64GB DDR4-2666
UPS: CP AVR1350
Model:TVS-673 32GB & TS-228a Offline[/color]
-----------------------------------------------------------------------------------------------------------------------------------------
2018 Plex NAS Compatibility Guide | QNAP Plex FAQ | Moogle's QNAP Faq
Model: TS-877-1600 FW: 4.5.3.x
QTS (SSD): [RAID-1] 2 x 1TB WD Blue m.2's
Data (HDD): [RAID-5] 6 x 3TB HGST DeskStar
VMs (SSD): [RAID-1] 2 x1TB SK Hynix Gold
Ext. (HDD): TR-004 [Raid-5] 4 x 4TB HGST Ultastor
RAM: Kingston HyperX Fury 64GB DDR4-2666
UPS: CP AVR1350
Model:TVS-673 32GB & TS-228a Offline[/color]
-----------------------------------------------------------------------------------------------------------------------------------------
2018 Plex NAS Compatibility Guide | QNAP Plex FAQ | Moogle's QNAP Faq
-
- Starting out
- Posts: 15
- Joined: Sat Sep 03, 2016 3:37 am
Re: QNAP TFS-453A corrupted HFS+ sparseimages
@Trexx, I've have, although I didn't pursue it because it appeared there was no iSCSI initiator natively built-in to macOS / OS X, is that true?
- Trexx
- Ask me anything
- Posts: 5393
- Joined: Sat Oct 01, 2011 7:50 am
- Location: Minnesota
Re: QNAP TFS-453A corrupted HFS+ sparseimages
There isn't but there is a free one you can download though.12345 wrote:@Trexx, I've have, although I didn't pursue it because it appeared there was no iSCSI initiator natively built-in to macOS / OS X, is that true?
http://www.kernsafe.com/product/macos-i ... iator.aspx
Sent from my iPhone using Tapatalk
Paul
Model: TS-877-1600 FW: 4.5.3.x
QTS (SSD): [RAID-1] 2 x 1TB WD Blue m.2's
Data (HDD): [RAID-5] 6 x 3TB HGST DeskStar
VMs (SSD): [RAID-1] 2 x1TB SK Hynix Gold
Ext. (HDD): TR-004 [Raid-5] 4 x 4TB HGST Ultastor
RAM: Kingston HyperX Fury 64GB DDR4-2666
UPS: CP AVR1350
Model:TVS-673 32GB & TS-228a Offline[/color]
-----------------------------------------------------------------------------------------------------------------------------------------
2018 Plex NAS Compatibility Guide | QNAP Plex FAQ | Moogle's QNAP Faq
Model: TS-877-1600 FW: 4.5.3.x
QTS (SSD): [RAID-1] 2 x 1TB WD Blue m.2's
Data (HDD): [RAID-5] 6 x 3TB HGST DeskStar
VMs (SSD): [RAID-1] 2 x1TB SK Hynix Gold
Ext. (HDD): TR-004 [Raid-5] 4 x 4TB HGST Ultastor
RAM: Kingston HyperX Fury 64GB DDR4-2666
UPS: CP AVR1350
Model:TVS-673 32GB & TS-228a Offline[/color]
-----------------------------------------------------------------------------------------------------------------------------------------
2018 Plex NAS Compatibility Guide | QNAP Plex FAQ | Moogle's QNAP Faq