Page 1 of 1

every reboot - filesystem not clean

Posted: Sat Jan 13, 2018 10:14 pm
by frustin
Every reboot and my filesystem is not clean. using current 4.3.4 firmware but it's been like this for a while now.

I run filesystem check which fixes it but after a reboot i get the same message again.

Can someone help me to debug this please?

Re: every reboot - filesystem not clean

Posted: Mon Jul 15, 2019 4:40 am
by sbarbe13
I'm having the same problem on my TS-569 Pro, any help would be appreciated.
This behavior started after a failed firmware upgrade. I opened a case with support and apparently fixed that issue (booted the nas without disks, did a partial setup, reran the fw upgrade which completed successfully, reinstalled the drives and restored the storage config) and the nas ran for about 2 weeks without issue before this cycle started.
I did find one disk with a bad sector on a smart scan of all drives. Replaced that drive, rebuilt the raid and ran the file system check, which came back clean. Rebooted the nas and lost my thin volume metadata.
I did a full reinitialize and setup, created a new storage pool and volume, formatted all drives, and still the following behavior persists:
1. I boot the NAS and it tells me filesystem not clean
2. I run the filesystem check and it comes back to clean, ready and online
3. I reboot the system and it comes back not clean / read only again
running 4.3.4.0899 build 20190322 (latest)

Re: every reboot - filesystem not clean

Posted: Mon Jul 22, 2019 3:17 am
by sbarbe13
I believe I have resolved this on my nas. I wiped out my storage pool again, removed all drives and restored to factory default.
Then I added HDD1 back and created a raid0 pool. Created a volume on it and mounted it. This worked and I rebooted it. Volume came up clean.
I removed the pool again, added HDD2 to the NAS, and created a RAID1 pool. Rebooted and this one came up filesystem not clean.
Removed the pool again and removed HDD2. Added HDD3 and HDD4 to the NAS and created RAID5 pool. Rebooted filesystem clean.
Removed the pool again and added HDD5 to the NAS. Created RAID6 pool and added volume. Rebooted NAS and filesystem came up clean. Have rebooted it ~6 times and it comes up clean each time.
so it looks like my HDD2 had failed in a stealth manner, since SMART test did not find anything wrong with it.
This is a bit extreme if your environment is production, but I had already lost my data volume and was going to have to restore from backups anyway.
You may be able to test this by just popping out 1 drive at a time (if raid 2,5,6), running the filesystem check without the drive in, then reboot test to see if it comes back clean.
Good luck!

Re: every reboot - filesystem not clean

Posted: Mon Jul 22, 2019 5:23 pm
by AlastairStevenson
SMART test did not find anything wrong with it.
That's quite a broad-brush indication, with often an optimistic result.

Much better to make a manual assessment of the SMART detail counts against the various attributes.
That might have indicated some activity that could contribute to changed / corrupted data that could cause a file system inconsistency.

Re: every reboot - filesystem not clean

Posted: Tue Jul 23, 2019 5:31 am
by sbarbe13
Quite true. I do need to dive into the logs for my own curiosity.

Re: every reboot - filesystem not clean

Posted: Wed Sep 11, 2019 7:25 pm
by frustin
sbarbe13 wrote: Tue Jul 23, 2019 5:31 am Quite true. I do need to dive into the logs for my own curiosity.
did you run the complete disk test on each of the disks before you did that rebuild?

Re: every reboot - filesystem not clean

Posted: Wed Sep 11, 2019 7:26 pm
by frustin
AlastairStevenson wrote: Mon Jul 22, 2019 5:23 pm Much better to make a manual assessment of the SMART detail counts against the various attributes.
That might have indicated some activity that could contribute to changed / corrupted data that could cause a file system inconsistency.
How do you do that exactly please?

Re: every reboot - filesystem not clean

Posted: Wed Sep 11, 2019 7:52 pm
by Toxic17
frustin wrote: Wed Sep 11, 2019 7:26 pm
AlastairStevenson wrote: Mon Jul 22, 2019 5:23 pm Much better to make a manual assessment of the SMART detail counts against the various attributes.
That might have indicated some activity that could contribute to changed / corrupted data that could cause a file system inconsistency.
How do you do that exactly please?
are you still having the same issue over year later?

Please give some more information on your NAS.

What firmware and build number are you running now.
What Hard disk Model and make are you using with what Raid configuration.

Re: every reboot - filesystem not clean

Posted: Thu Sep 12, 2019 3:59 pm
by frustin
Toxic17 wrote: Wed Sep 11, 2019 7:52 pm
frustin wrote: Wed Sep 11, 2019 7:26 pm
AlastairStevenson wrote: Mon Jul 22, 2019 5:23 pm Much better to make a manual assessment of the SMART detail counts against the various attributes.
That might have indicated some activity that could contribute to changed / corrupted data that could cause a file system inconsistency.
How do you do that exactly please?
are you still having the same issue over year later?

Please give some more information on your NAS.

What firmware and build number are you running now.
What Hard disk Model and make are you using with what Raid configuration.
Hi, thanks for responding. Admittedly, i dont get this every reboot anymore, but i do get a lot of Qnap freezes whereby the OS becomes unresponsive, which means i can not get in by webUI, Qfinder, nor reboot on the front of the box. Which means I then have to hard reset the qnap, causing raid resyncs.

ALSO i can wake in the morning and see that the qnap has rebooted in the night for no reason, this is usually when it says that the filesystem is unclean. IF the qnap is responsive at all.

My qnap is a TS-670 Pro running latest firmware (always is): 4.3.6.1050 build 20190830
Disk set up is: 4x3TB WD RED (SMART shows no errors with them)
RAID 5 using Thin Volume

I thought i'd ask the question again because of all the reboots and freezes i was getting and i was wondering if it was a hidden HDD issue.

Re: every reboot - filesystem not clean

Posted: Thu Sep 12, 2019 4:15 pm
by Toxic17
Hard disk will usually report some sort of issue if its failing. you reboots will be caused "most likely" by ram failing, overheating, fluctuating power supplies.

1. Is the NAS plugged into a UPS?
2. What temps are the CPU, Board/system, hard disks etc? are they within normal guidlines?
3. Have you upgrade the ram from the QNAP supplied ram? If so is it the same spec as the QNAP supplied ram.

QNAP reports the Hard Disk system not clean since the NAS has had a sudden reboot (power off/on) and not had a controlled shutdown or restart.

Re: every reboot - filesystem not clean

Posted: Thu Sep 12, 2019 5:38 pm
by AlastairStevenson
How do you do that exactly please?
Storage and Snapshots | Storage | Disks | Disk Health button | SMART Information.
Then check the detail for each HDD in the dropdown.

Important will be any attributes (what's available varies with HDD brand / model) associated with errors.
Check the attribute meanings on Wikipedia.