how to handle .streams folders

Backup, Restore, Netbak Replicator, Cloud Storage Services
Post Reply
aristosv
Starting out
Posts: 17
Joined: Wed Apr 26, 2017 12:39 pm

how to handle .streams folders

Post by aristosv »

I've set up an external drive backup job, between a disk inside my TS-431P and an external USB disk.
Every time the backup runs I get messages in the logs saying that files were skipped because they have unsupported file names.
All these skipped files are located in the .streams folder. I have no idea what these files are, or how this .streams folder was created.
When I delete the .streams folder, the backup runs without any errors.

Anyone had this problem before? How do I handle this?
Thanks
User avatar
dolbyman
Guru
Posts: 35253
Joined: Sat Feb 12, 2011 2:11 am
Location: Vancouver BC , Canada

Re: how to handle .streams folders

Post by dolbyman »

is it a folder or a share ? .. any printout of such error logs ?
aristosv
Starting out
Posts: 17
Joined: Wed Apr 26, 2017 12:39 pm

Re: how to handle .streams folders

Post by aristosv »

its a shared folder.
this is a screenshot of the logs.
1.png
You do not have the required permissions to view the files attached to this post.
User avatar
dolbyman
Guru
Posts: 35253
Joined: Sat Feb 12, 2011 2:11 am
Location: Vancouver BC , Canada

Re: how to handle .streams folders

Post by dolbyman »

what is your external usb disk formatted as ?

EXT4
NTFS ?
albumman
Easy as a breeze
Posts: 298
Joined: Fri Apr 25, 2014 10:29 am

Re: how to handle .streams folders

Post by albumman »

aristosv wrote:I've set up an external drive backup job, between a disk inside my TS-431P and an external USB disk.
Every time the backup runs I get messages in the logs saying that files were skipped because they have unsupported file names.
All these skipped files are located in the .streams folder. I have no idea what these files are, or how this .streams folder was created.
When I delete the .streams folder, the backup runs without any errors.

Anyone had this problem before? How do I handle this?
Thanks
There are other threads regarding this and for me, it began after installing the officially released version of f/w 4.3.3. I opened a ticket and their answer was to "ignore the error" and claims it will be fixed in the next f/w build which did not happen either.
TS-212P QTS: 4.3.3.1864 build 20211212
2 x Seagate ST3000VN000 (RAID 1)
aristosv
Starting out
Posts: 17
Joined: Wed Apr 26, 2017 12:39 pm

Re: how to handle .streams folders

Post by aristosv »

@dolbyman all disks are NTFS
@albumman good to know I'm not the only one.
aristosv
Starting out
Posts: 17
Joined: Wed Apr 26, 2017 12:39 pm

Re: how to handle .streams folders

Post by aristosv »

I guess I could set up a cron job to delete the .streams folders before the backup. But that would be a workaround, not a solution.
User avatar
dolbyman
Guru
Posts: 35253
Joined: Sat Feb 12, 2011 2:11 am
Location: Vancouver BC , Canada

Re: how to handle .streams folders

Post by dolbyman »

well the internal disks can't be ntfs
aristosv
Starting out
Posts: 17
Joined: Wed Apr 26, 2017 12:39 pm

Re: how to handle .streams folders

Post by aristosv »

@dolbyman
Do you have a suggestion?
User avatar
dolbyman
Guru
Posts: 35253
Joined: Sat Feb 12, 2011 2:11 am
Location: Vancouver BC , Canada

Re: how to handle .streams folders

Post by dolbyman »

my guess was file name depth of internal ext4 vs external ntfs drives ...

but if it is a known issue wait for a qnap fix I guess
albumman
Easy as a breeze
Posts: 298
Joined: Fri Apr 25, 2014 10:29 am

Re: how to handle .streams folders

Post by albumman »

aristosv wrote:@dolbyman all disks are NTFS
@albumman good to know I'm not the only one.
Did you happen to open a ticket too? Mine got closed awhile back with no fix yet. If not, please open one. Thanks.
TS-212P QTS: 4.3.3.1864 build 20211212
2 x Seagate ST3000VN000 (RAID 1)
aristosv
Starting out
Posts: 17
Joined: Wed Apr 26, 2017 12:39 pm

Re: how to handle .streams folders

Post by aristosv »

Actually the .streams folder was being copied over to the qnap while backing up my laptop data. Even though I couldn't find this folder on my laptop, after running the backup, it would appear on qnap. So I just modified the backup job to delete the .streams folder on qnap, after running the backup job.
MikeLagit
Easy as a breeze
Posts: 332
Joined: Fri Mar 22, 2013 11:40 pm

Re: how to handle .streams folders

Post by MikeLagit »

Brilliant QNAP. I have this strewn over all my shares...
Model: TVS-872XT 16GB
Model: TS-877-1700 16GB
User avatar
Moogle Stiltzkin
Guru
Posts: 11448
Joined: Thu Dec 04, 2008 12:21 am
Location: Around the world....
Contact:

Re: how to handle .streams folders

Post by Moogle Stiltzkin »

the check mark "Filter system-generated temporary files" does not filter the .Streams folders!

only with DS_Store, / @ *, /. * entered in Other filters the .streams folders were skipped.

mfg
Olaf
Hello,

I'll try to shed some light on the subject.

The ".streams" folder is created by SAMBA - this is the software that can create Windows shares under Linux and controls CIFS / SMB access for the Windows systems.

In the ".streams" folder, the Alternate data streams are stored by the NTFS - here, for example, Windows determines whether a file has been downloaded from the Internet and displays corresponding warnings. Since Linux / EXT4 does not know Alternate data streams, SAMBA has to drop the ADS somewhere - and that happens in the .streams folders. The problem with deleting the folders is that SAMBA - and thus Windows - lose all information stored in the ADS.

So, I hope I was able to clear up a little bit - for more details I can recommend the Wikipedia to NTFS.

LHS
https://forum.qnapclub.de/thread/43995-ordner-streams/

Image
[youtube=]qBrFW3gpjpM[/youtube]



they ought to include this type of explanation into the FAQ imho
https://www.qnap.com/en/how-to/
NAS
[Main Server] QNAP TS-877 (QTS) w. 4tb [ 3x HGST Deskstar NAS & 1x WD RED NAS ] EXT4 Raid5 & 2 x m.2 SATA Samsung 850 Evo raid1 +16gb ddr4 Crucial+ QWA-AC2600 wireless+QXP PCIE
[Backup] QNAP TS-653A (Truenas Core) w. 4x 2TB Samsung F3 (HD203WI) RaidZ1 ZFS + 8gb ddr3 Crucial
[^] QNAP TL-D400S 2x 4TB WD Red Nas (WD40EFRX) 2x 4TB Seagate Ironwolf, Raid5
[^] QNAP TS-509 Pro w. 4x 1TB WD RE3 (WD1002FBYS) EXT4 Raid5
[^] QNAP TS-253D (Truenas Scale)
[Mobile NAS] TBS-453DX w. 2x Crucial MX500 500gb EXT4 raid1

Network
Qotom Pfsense|100mbps FTTH | Win11, Ryzen 5600X Desktop (1x2tb Crucial P50 Plus M.2 SSD, 1x 8tb seagate Ironwolf,1x 4tb HGST Ultrastar 7K4000)


Resources
[Review] Moogle's QNAP experience
[Review] Moogle's TS-877 review
https://www.patreon.com/mooglestiltzkin
MikeLagit
Easy as a breeze
Posts: 332
Joined: Fri Mar 22, 2013 11:40 pm

Re: how to handle .streams folders

Post by MikeLagit »

I suppose this isn't possible, but what would be really nice is if Samba didn't write any .streams at all when going to ext4. Anyone know if it's possible? I didn't find anything in the Samba configuration to disable writing .streams.

As far as I can tell the data is useless and I have setup a cron job to delete them each day.
Model: TVS-872XT 16GB
Model: TS-877-1700 16GB
Post Reply

Return to “Backup & Restore”