Files Disappeared! Thanks QNAP!
-
- Starting out
- Posts: 12
- Joined: Thu Nov 10, 2016 9:24 pm
Files Disappeared! Thanks QNAP!
So I have a TS-431P for some time now working fine with 3 non-RAID disks just hosting a variety of videos / photos / etc.
Today I brought my 3TB Seagate externall hdd (NTFS) and plugged it into the USB port in the front and using the web interface / File Station - I 'moved' a bunch of videos from the 3TB to QNAP. I saw the process was moving along swimmingly - but after a while, I was only at 30% - so decided to just leave it.
When I come back to check hours later; I see:
1) A bunch of errors on QNAP (unfortunately I cant paste a copy of such an error because the NAS has restarted since and seems to have cleared the log since the restart).
2) Files not on the QNAP
3) Files not on the Seagate HDD
GONE! Terrabytes of data, just gone. Call me stupid/a noob for "moving" instead of copying. But I assumed in the 21st century, a simple 'move' operation wasnt rocket science. Surely if something fails in the move, it should abort, hence leaving whats left at the source intact (at least, this is what windows does) instead of just carrying on and deleting the source files even though they werent moved to the destination successfully (at least, this is what appears to have happened). Im rather annoyed. At this stage, this NAS has cause me more headaches than conveniences and I'm thinking a cheap computer with HDD's would of worked out better.
Today I brought my 3TB Seagate externall hdd (NTFS) and plugged it into the USB port in the front and using the web interface / File Station - I 'moved' a bunch of videos from the 3TB to QNAP. I saw the process was moving along swimmingly - but after a while, I was only at 30% - so decided to just leave it.
When I come back to check hours later; I see:
1) A bunch of errors on QNAP (unfortunately I cant paste a copy of such an error because the NAS has restarted since and seems to have cleared the log since the restart).
2) Files not on the QNAP
3) Files not on the Seagate HDD
GONE! Terrabytes of data, just gone. Call me stupid/a noob for "moving" instead of copying. But I assumed in the 21st century, a simple 'move' operation wasnt rocket science. Surely if something fails in the move, it should abort, hence leaving whats left at the source intact (at least, this is what windows does) instead of just carrying on and deleting the source files even though they werent moved to the destination successfully (at least, this is what appears to have happened). Im rather annoyed. At this stage, this NAS has cause me more headaches than conveniences and I'm thinking a cheap computer with HDD's would of worked out better.
Re: Files Disappeared! Thanks QNAP!
Nothing in the $recycle ?SupaMonkey wrote:So I have a TS-431P for some time now working fine with 3 non-RAID disks just hosting a variety of videos / photos / etc.
Today I brought my 3TB Seagate externall hdd (NTFS) and plugged it into the USB port in the front and using the web interface / File Station - I 'moved' a bunch of videos from the 3TB to QNAP. I saw the process was moving along swimmingly - but after a while, I was only at 30% - so decided to just leave it.
When I come back to check hours later; I see:
1) A bunch of errors on QNAP (unfortunately I cant paste a copy of such an error because the NAS has restarted since and seems to have cleared the log since the restart).
2) Files not on the QNAP
3) Files not on the Seagate HDD
GONE! Terrabytes of data, just gone. Call me stupid/a noob for "moving" instead of copying. But I assumed in the 21st century, a simple 'move' operation wasnt rocket science. Surely if something fails in the move, it should abort, hence leaving whats left at the source intact (at least, this is what windows does) instead of just carrying on and deleting the source files even though they werent moved to the destination successfully (at least, this is what appears to have happened). Im rather annoyed. At this stage, this NAS has cause me more headaches than conveniences and I'm thinking a cheap computer with HDD's would of worked out better.
-
- Guru
- Posts: 13192
- Joined: Sat Dec 29, 2007 1:39 am
- Location: Stockholm, Sweden (UTC+01:00)
Re: Files Disappeared! Thanks QNAP!
Regarding the topic of the thread, Qnap and everyone else that know anything about data storage says that you should always keep backups of your data. So blaming Qnap for lost data is simply wrong. Look in a mirror and you will see the one person responsible.
2. You're using an non-recommended disk configuration in the NAS
3. In your other thread I notice that you're reading an incorrect documentation for the NAS model you have.
If you're having problems, I'm not very surprised about that.
You could try to use file recovery software on the external disk. Please use something well-known and not the malware-infected ones that spam forums to get coverage.
It's strongly recommended by all experienced administrators to use some kind of RAID (RAID 0 isn't really RAID) for at least the first, the system volume in the NAS. Unless you do that, then when (not if) the first disk fail you will lose access to the complete NAS and all data on all disks.SupaMonkey wrote:So I have a TS-431P for some time now working fine with 3 non-RAID disks just hosting a variety of videos / photos / etc.
Keeping data as a single instance is an accident waiting to happen. Using less safe methods (like move instead of copy+delete) of administering that data adds to the risk and it seems your luck finally run out.Call me stupid/a noob for "moving" instead of copying.
1. You're apparently not having backups of your dataAt this stage, this NAS has cause me more headaches than conveniences...
2. You're using an non-recommended disk configuration in the NAS
3. In your other thread I notice that you're reading an incorrect documentation for the NAS model you have.
If you're having problems, I'm not very surprised about that.
Maybe or maybe not but every computer regardless of operating system can fail and if you haven't got a backup you will eventually lose data. And when you do lose that data, it's not the fault of the computer or the OS but the user that didn't have his backups in order....I'm thinking a cheap computer with HDD's would of worked out better.
You could try to use file recovery software on the external disk. Please use something well-known and not the malware-infected ones that spam forums to get coverage.
RAID have never ever been a replacement for backups. Without backups on a different system (preferably placed at another site), you will eventually lose data!
A non-RAID configuration (including RAID 0, which isn't really RAID) with a backup on a separate media protects your data far better than any RAID-volume without backup.
All data storage consists of both the primary storage and the backups. It's your money and your data, spend the storage budget wisely or pay with your data!
A non-RAID configuration (including RAID 0, which isn't really RAID) with a backup on a separate media protects your data far better than any RAID-volume without backup.
All data storage consists of both the primary storage and the backups. It's your money and your data, spend the storage budget wisely or pay with your data!
- dolbyman
- Guru
- Posts: 35275
- Joined: Sat Feb 12, 2011 2:11 am
- Location: Vancouver BC , Canada
Re: Files Disappeared! Thanks QNAP!
sounds like the common move via file station bug...several people have lost data that way
a copy instead of a move would have resulted in no data loss
a copy instead of a move would have resulted in no data loss
- Moogle Stiltzkin
- Guru
- Posts: 11445
- Joined: Thu Dec 04, 2008 12:21 am
- Location: Around the world....
- Contact:
Re: Files Disappeared! Thanks QNAP!
i'd do 'move' most of the time rather than copy, but then again i don't really use filestation unless i'm going for max performance for internal transfers. though in his scenario where he plugged in an external usb direct to the qnap i'd probably use filestation or backup station.dolbyman wrote:sounds like the common move via file station bug...several people have lost data that way
a copy instead of a move would have resulted in no data loss
but what is this bug ? i would just normally expect the move function to just work ... o_O; what firmware were you using supa ?
what hdds are using for your qnap?
usually when i make an accident on delete on my desktop i use recuva
https://www.piriform.com/recuva
but your accident happened on the nas during a usb external transfer :/ did you create a support ticket? did that give you any suggestions for recovery method ?
maybe using recuva on your usb hdd for recovery MAY work, but i'm not sure.
[youtube=]KFwq8KKVvhw[/youtube]
anyway i do recommend for the future to strongly have a backup option. i opted for the more pricer 2 qnap units for a 1:1 ratio backup using a lan rtrr sync share folder method (1 way source to destination) manual not scheduled method.
Last edited by Moogle Stiltzkin on Sun Feb 05, 2017 3:38 pm, edited 2 times in total.
NAS
[Main Server] QNAP TS-877 (QTS) w. 4tb [ 3x HGST Deskstar NAS & 1x WD RED NAS ] EXT4 Raid5 & 2 x m.2 SATA Samsung 850 Evo raid1 +16gb ddr4 Crucial+ QWA-AC2600 wireless+QXP PCIE
[Backup] QNAP TS-653A (Truenas Core) w. 4x 2TB Samsung F3 (HD203WI) RaidZ1 ZFS + 8gb ddr3 Crucial
[^] QNAP TL-D400S 2x 4TB WD Red Nas (WD40EFRX) 2x 4TB Seagate Ironwolf, Raid5
[^] QNAP TS-509 Pro w. 4x 1TB WD RE3 (WD1002FBYS) EXT4 Raid5
[^] QNAP TS-253D (Truenas Scale)
[Mobile NAS] TBS-453DX w. 2x Crucial MX500 500gb EXT4 raid1
Network
Qotom Pfsense|100mbps FTTH | Win11, Ryzen 5600X Desktop (1x2tb Crucial P50 Plus M.2 SSD, 1x 8tb seagate Ironwolf,1x 4tb HGST Ultrastar 7K4000)
Resources
[Review] Moogle's QNAP experience
[Review] Moogle's TS-877 review
https://www.patreon.com/mooglestiltzkin
[Main Server] QNAP TS-877 (QTS) w. 4tb [ 3x HGST Deskstar NAS & 1x WD RED NAS ] EXT4 Raid5 & 2 x m.2 SATA Samsung 850 Evo raid1 +16gb ddr4 Crucial+ QWA-AC2600 wireless+QXP PCIE
[Backup] QNAP TS-653A (Truenas Core) w. 4x 2TB Samsung F3 (HD203WI) RaidZ1 ZFS + 8gb ddr3 Crucial
[^] QNAP TL-D400S 2x 4TB WD Red Nas (WD40EFRX) 2x 4TB Seagate Ironwolf, Raid5
[^] QNAP TS-509 Pro w. 4x 1TB WD RE3 (WD1002FBYS) EXT4 Raid5
[^] QNAP TS-253D (Truenas Scale)
[Mobile NAS] TBS-453DX w. 2x Crucial MX500 500gb EXT4 raid1
Network
Qotom Pfsense|100mbps FTTH | Win11, Ryzen 5600X Desktop (1x2tb Crucial P50 Plus M.2 SSD, 1x 8tb seagate Ironwolf,1x 4tb HGST Ultrastar 7K4000)
Resources
[Review] Moogle's QNAP experience
[Review] Moogle's TS-877 review
https://www.patreon.com/mooglestiltzkin
- OneCD
- Guru
- Posts: 12160
- Joined: Sun Aug 21, 2016 10:48 am
- Location: "... there, behind that sofa!"
Re: Files Disappeared! Thanks QNAP!
viewtopic.php?f=15&t=126824Moogle Stiltzkin wrote:but what is this bug ? i would just normally expect the move function to just work o_O; what firmware were you using supa ?
- Moogle Stiltzkin
- Guru
- Posts: 11445
- Joined: Thu Dec 04, 2008 12:21 am
- Location: Around the world....
- Contact:
Re: Files Disappeared! Thanks QNAP!
thx, wow i missed that important alertOneCD wrote:viewtopic.php?f=15&t=126824Moogle Stiltzkin wrote:but what is this bug ? i would just normally expect the move function to just work o_O; what firmware were you using supa ?
i'll keep this in mind
uh... yeah when i tested this option a while back, to see what happened with it not selected in rtrr, i was a bit worried about the result. so i redid it and kept this option enabled from then on.- File integrity is now checked when copying/moving files.
NAS
[Main Server] QNAP TS-877 (QTS) w. 4tb [ 3x HGST Deskstar NAS & 1x WD RED NAS ] EXT4 Raid5 & 2 x m.2 SATA Samsung 850 Evo raid1 +16gb ddr4 Crucial+ QWA-AC2600 wireless+QXP PCIE
[Backup] QNAP TS-653A (Truenas Core) w. 4x 2TB Samsung F3 (HD203WI) RaidZ1 ZFS + 8gb ddr3 Crucial
[^] QNAP TL-D400S 2x 4TB WD Red Nas (WD40EFRX) 2x 4TB Seagate Ironwolf, Raid5
[^] QNAP TS-509 Pro w. 4x 1TB WD RE3 (WD1002FBYS) EXT4 Raid5
[^] QNAP TS-253D (Truenas Scale)
[Mobile NAS] TBS-453DX w. 2x Crucial MX500 500gb EXT4 raid1
Network
Qotom Pfsense|100mbps FTTH | Win11, Ryzen 5600X Desktop (1x2tb Crucial P50 Plus M.2 SSD, 1x 8tb seagate Ironwolf,1x 4tb HGST Ultrastar 7K4000)
Resources
[Review] Moogle's QNAP experience
[Review] Moogle's TS-877 review
https://www.patreon.com/mooglestiltzkin
[Main Server] QNAP TS-877 (QTS) w. 4tb [ 3x HGST Deskstar NAS & 1x WD RED NAS ] EXT4 Raid5 & 2 x m.2 SATA Samsung 850 Evo raid1 +16gb ddr4 Crucial+ QWA-AC2600 wireless+QXP PCIE
[Backup] QNAP TS-653A (Truenas Core) w. 4x 2TB Samsung F3 (HD203WI) RaidZ1 ZFS + 8gb ddr3 Crucial
[^] QNAP TL-D400S 2x 4TB WD Red Nas (WD40EFRX) 2x 4TB Seagate Ironwolf, Raid5
[^] QNAP TS-509 Pro w. 4x 1TB WD RE3 (WD1002FBYS) EXT4 Raid5
[^] QNAP TS-253D (Truenas Scale)
[Mobile NAS] TBS-453DX w. 2x Crucial MX500 500gb EXT4 raid1
Network
Qotom Pfsense|100mbps FTTH | Win11, Ryzen 5600X Desktop (1x2tb Crucial P50 Plus M.2 SSD, 1x 8tb seagate Ironwolf,1x 4tb HGST Ultrastar 7K4000)
Resources
[Review] Moogle's QNAP experience
[Review] Moogle's TS-877 review
https://www.patreon.com/mooglestiltzkin
-
- New here
- Posts: 2
- Joined: Fri Apr 14, 2017 11:47 pm
Re: Files Disappeared! Thanks QNAP!
I was upgrading my hard drives, making some changes to the configuration, adding RAID capability, and used an external drive to temporarily copy the contents. After all this configuration I then started a move routine from the external to the new QNAP volume. Imagine my surprise when I realized that the save wasn't going where I intended, and the cancellation afterwards caused 2 terabytes of data to suddenly vanish. Now - you may chide us on on backup practices, or using something other than a "move" command, but the bottom line is is that's apparently a known issue within the OS that QNAP has not addressed. The data that I lost I'm sure can be recovered - the 5 seconds that it took me to realize my mistake could not have done that much damage. Besides, life goes on...
-
- Starting out
- Posts: 39
- Joined: Sat Apr 15, 2017 8:19 pm
Re: Files Disappeared! Thanks QNAP!
Ok. You made several mistakes which have caused data lost with any OS and you blame qnap for it? Cool. Sooo what should have qnap done to avoid your Problem? Allow the move command only when you have passed a test that you really know what you are doing? Just kidding.
Lessons learned: NEVER use the move command! NEVER!! Only copy the data and delete them from the source AFTER you have checked that everything is fine.
Gesendet von meinem HUAWEI GRA-L09 mit Tapatalk
Lessons learned: NEVER use the move command! NEVER!! Only copy the data and delete them from the source AFTER you have checked that everything is fine.
Gesendet von meinem HUAWEI GRA-L09 mit Tapatalk
-
- Guru
- Posts: 13192
- Joined: Sat Dec 29, 2007 1:39 am
- Location: Stockholm, Sweden (UTC+01:00)
Re: Files Disappeared! Thanks QNAP!
A more important lesson in my opinion is to always have backups of all data that have any importance. Data stored at only a single system will eventually be lost.eldor wrote:Lessons learned: NEVER use the move command! NEVER!!
RAID have never ever been a replacement for backups. Without backups on a different system (preferably placed at another site), you will eventually lose data!
A non-RAID configuration (including RAID 0, which isn't really RAID) with a backup on a separate media protects your data far better than any RAID-volume without backup.
All data storage consists of both the primary storage and the backups. It's your money and your data, spend the storage budget wisely or pay with your data!
A non-RAID configuration (including RAID 0, which isn't really RAID) with a backup on a separate media protects your data far better than any RAID-volume without backup.
All data storage consists of both the primary storage and the backups. It's your money and your data, spend the storage budget wisely or pay with your data!
-
- Starting out
- Posts: 39
- Joined: Sat Apr 15, 2017 8:19 pm
Re: Files Disappeared! Thanks QNAP!
Of course. But when he started, he had one Set of his data he could have copied to the new storage. Then there would be a Backup...
Gesendet von meinem HUAWEI GRA-L09 mit Tapatalk
Gesendet von meinem HUAWEI GRA-L09 mit Tapatalk
-
- Been there, done that
- Posts: 898
- Joined: Mon Jun 03, 2013 3:33 am
Re: Files Disappeared! Thanks QNAP!
i always thought the 'move' command was only for moving files within the same share. it doesn't actually 'move' the date, just alters the allocation file, or whatever you call it that points to the actual location on the disk.
Production :
TVS-673 4.3.4 0387
4 X 3TB WD RED : 1 X 4TB HGST DESKSTAR R5
32GB
LAN-10G1SR-D, FiberHal for Cisco SFP-10G-SR
NETGEAR ProSAFE SS3300-28X
Backup :
TS-469L 4.3.4 0387
4 X 3TB WD RED R5
3GB
Located detached garage .. cheap offsite solution ...
2nd TS-469L awaiting drives and reassignment for front-line duty .......
TVS-673 4.3.4 0387
4 X 3TB WD RED : 1 X 4TB HGST DESKSTAR R5
32GB
LAN-10G1SR-D, FiberHal for Cisco SFP-10G-SR
NETGEAR ProSAFE SS3300-28X
Backup :
TS-469L 4.3.4 0387
4 X 3TB WD RED R5
3GB
Located detached garage .. cheap offsite solution ...
2nd TS-469L awaiting drives and reassignment for front-line duty .......
-
- Guru
- Posts: 13192
- Joined: Sat Dec 29, 2007 1:39 am
- Location: Stockholm, Sweden (UTC+01:00)
Re: Files Disappeared! Thanks QNAP!
Yes that's how it works within a shared folder.kherr4377 wrote:i always thought the 'move' command was only for moving files within the same share. it doesn't actually 'move' the date, just alters the allocation file, or whatever you call it that points to the actual location on the disk.
Between shared folders/volumes/systems a move is really a copy and then a delete of the source data. Or at least that's the way a move is supposed to work.
RAID have never ever been a replacement for backups. Without backups on a different system (preferably placed at another site), you will eventually lose data!
A non-RAID configuration (including RAID 0, which isn't really RAID) with a backup on a separate media protects your data far better than any RAID-volume without backup.
All data storage consists of both the primary storage and the backups. It's your money and your data, spend the storage budget wisely or pay with your data!
A non-RAID configuration (including RAID 0, which isn't really RAID) with a backup on a separate media protects your data far better than any RAID-volume without backup.
All data storage consists of both the primary storage and the backups. It's your money and your data, spend the storage budget wisely or pay with your data!
- schumaku
- Guru
- Posts: 43578
- Joined: Mon Jan 21, 2008 4:41 pm
- Location: Kloten (Zurich), Switzerland -- Skype: schumaku
- Contact:
Re: Files Disappeared! Thanks QNAP!
This is true when it comes ie. to a SAMBA operation.P3R wrote:Yes that's how it works within a shared folder.kherr4377 wrote:i always thought the 'move' command was only for moving files within the same share. it doesn't actually 'move' the date, just alters the allocation file, or whatever you call it that points to the actual location on the disk.
The more generic U**x-like commands (assumingly used under the File Station hood) don't know anything about shared folders.
Yes. Last time I've tested this it must have been a plain U**x move: If you have Advanced Folder Permissions in place (ACLs), and move folders and files from one shared folder to another (with different ACLs), you see that the ACLs are not updated according to the destination share settings.P3R wrote:Between shared folders/volumes/systems a move is really a copy and then a delete of the source data. Or at least that's the way a move is supposed to work.
-
- First post
- Posts: 1
- Joined: Wed Jul 29, 2015 6:39 pm
Re: Files Disappeared! Thanks QNAP!
I completely understand SupaMonkey's anger. If he had to this on any computer, this would not happen. QNAP failed to COPY files, but the second step of MOVE is DELETE and it did that anyway. Data destruction should be more protected. There should be an option to compare if the files were copied successfully before delete on MOVE.
Don't lecture me about backup. There is just a limited amount of USB drives available (which are mostly full) and I don't believe any of you have spare empty TBs of drives laying around to make double backup before copying or moving data to/from QNAP. It's just too much hassle and not that important.
I had a similar problem with Sync. I thought I set the sync task to copy files to an external USB disk folder.
Instead, QNAP "SYNCED" selected share to USB root and DELETE ALL FILES FROM EXTERNAL USB.
4TB of movies gone, because I wanted to copy about 300GB of photos to external USB.
Recovery on NTFS USB disk was unsuccessful.
I'm still not sure what is the proper way to copy a bunch of folders to external USB disk and there is no proper protocol described anywhere. I don't want to copy files through the network (300GB takes 12 hours).
What could QNAP do? Definitely Sync Station SHOULD WARN that ALL DATA on destination drive will be deleted before finishing the configuration wizard.
Don't lecture me about backup. There is just a limited amount of USB drives available (which are mostly full) and I don't believe any of you have spare empty TBs of drives laying around to make double backup before copying or moving data to/from QNAP. It's just too much hassle and not that important.
I had a similar problem with Sync. I thought I set the sync task to copy files to an external USB disk folder.
Instead, QNAP "SYNCED" selected share to USB root and DELETE ALL FILES FROM EXTERNAL USB.
4TB of movies gone, because I wanted to copy about 300GB of photos to external USB.
Recovery on NTFS USB disk was unsuccessful.
I'm still not sure what is the proper way to copy a bunch of folders to external USB disk and there is no proper protocol described anywhere. I don't want to copy files through the network (300GB takes 12 hours).
What could QNAP do? Definitely Sync Station SHOULD WARN that ALL DATA on destination drive will be deleted before finishing the configuration wizard.