Windows Backup has lots of issues.
The way I described seems to be the most reliable.
No Consolidation: Disk images grow to insane sizes
-
- Starting out
- Posts: 40
- Joined: Tue Oct 27, 2015 12:20 am
-
- Starting out
- Posts: 27
- Joined: Tue Oct 04, 2016 3:02 am
Re: No Consolidation: Disk images grow to insane sizes
Thanks for your help - I appreciate the reply!Trexx wrote:Currently the option available is the manual process I laid out.
The best way to get enhancements/fixes made to QNAP is via a Helpdesk ticket as QNAP does not generally monitor these forums. QNAP has been enhancing VS as seen by the changes between VS 2.x & 3.x. so hopefully that will be added as some point down the road.
- Trexx
- Ask me anything
- Posts: 5388
- Joined: Sat Oct 01, 2011 7:50 am
- Location: Minnesota
Re: No Consolidation: Disk images grow to insane sizes
No problem. Generally things will get fixed most of the time, but it does take some patience at times.ChristopherLarkin wrote:Thanks for your help - I appreciate the reply!Trexx wrote:Currently the option available is the manual process I laid out.
The best way to get enhancements/fixes made to QNAP is via a Helpdesk ticket as QNAP does not generally monitor these forums. QNAP has been enhancing VS as seen by the changes between VS 2.x & 3.x. so hopefully that will be added as some point down the road.
Sent from my iPad using Tapatalk
Paul
Model: TS-877-1600 FW: 4.5.3.x
QTS (SSD): [RAID-1] 2 x 1TB WD Blue m.2's
Data (HDD): [RAID-5] 6 x 3TB HGST DeskStar
VMs (SSD): [RAID-1] 2 x1TB SK Hynix Gold
Ext. (HDD): TR-004 [Raid-5] 4 x 4TB HGST Ultastor
RAM: Kingston HyperX Fury 64GB DDR4-2666
UPS: CP AVR1350
Model:TVS-673 32GB & TS-228a Offline[/color]
-----------------------------------------------------------------------------------------------------------------------------------------
2018 Plex NAS Compatibility Guide | QNAP Plex FAQ | Moogle's QNAP Faq
Model: TS-877-1600 FW: 4.5.3.x
QTS (SSD): [RAID-1] 2 x 1TB WD Blue m.2's
Data (HDD): [RAID-5] 6 x 3TB HGST DeskStar
VMs (SSD): [RAID-1] 2 x1TB SK Hynix Gold
Ext. (HDD): TR-004 [Raid-5] 4 x 4TB HGST Ultastor
RAM: Kingston HyperX Fury 64GB DDR4-2666
UPS: CP AVR1350
Model:TVS-673 32GB & TS-228a Offline[/color]
-----------------------------------------------------------------------------------------------------------------------------------------
2018 Plex NAS Compatibility Guide | QNAP Plex FAQ | Moogle's QNAP Faq
-
- Starting out
- Posts: 27
- Joined: Tue Oct 04, 2016 3:02 am
Re: No Consolidation: Disk images grow to insane sizes
So true - they say patience is a virtue. One day there will be an app for that.
Thanks again for your contributions to the thread. I *love* the Virtualization Station and use it extensively, or at least enough to wish I had an i7 or two as the CPU(s) in this box!
Christopher
Thanks again for your contributions to the thread. I *love* the Virtualization Station and use it extensively, or at least enough to wish I had an i7 or two as the CPU(s) in this box!
Christopher
-
- First post
- Posts: 1
- Joined: Tue Nov 07, 2017 6:52 pm
Re: No Consolidation: Disk images grow to insane sizes
Trexx wrote:The max size for an .img file is whatever you set if for at time of VM creation. So if you tell Windows 10 that is can be 50GB, that is how big the .img file can grow to. It is 100% under your control how much space the files are going to take up.
There is a manual process you can use to shrink the file, which is outlined here:
https://pve.proxmox.com/wiki/Shrink_Qcow2_Disk_Files
Short Version (Replace .img file names where applicable):
Within Windows 10:Shutdown the VM!
- Defrag HDD using Win10 or 3rd party defrag utility
- Zero out free space using SDelete
SSH'd onto QNAP:
- Create symlink to qemu-img file to make it easier to work with files.
Code: Select all
ln -s /share/CACHEDEV1_DATA/.qpkg/QKVM/usr/bin/qemu-img /usr/sbin/qemu-img
- Navigate to VM folder and create backup of existing image file.
Code: Select all
mv Win10.img Win10.img_backup
- Create SHRUNK disk file.
Faster Compress / Larger File:ORCode: Select all
qemu-img convert -O qcow2 -Win10.img_backup Win10.img
Slower Compress / Smaller File:Code: Select all
qemu-img convert -O qcow2 -c Win10.img_backup Win10.img
- Boot your VM and verify everything is working properly.
- You can delete .img_backup files once you have validated the VM if you like.
I compressed my img and the size decrease from 50gb to 19gb.
What cons have the file shrunk compress? Time to load maybe?
Thanks for advance.
- Trexx
- Ask me anything
- Posts: 5388
- Joined: Sat Oct 01, 2011 7:50 am
- Location: Minnesota
Re: No Consolidation: Disk images grow to insane sizes
So assuming that your set your VM Disk max to 50GB, the biggest drawback is as the VM writes additional data (i.e downloads patches, etc.) that expand past your 19GB size it will have to grow the storage on the fly (i.e. similar to how a Thin Volume works). This incurrs a performance penalty for your VM.
So unless you are really tight on space, from a performance perspective you are better off leaving the file as the larger size.
So unless you are really tight on space, from a performance perspective you are better off leaving the file as the larger size.
Paul
Model: TS-877-1600 FW: 4.5.3.x
QTS (SSD): [RAID-1] 2 x 1TB WD Blue m.2's
Data (HDD): [RAID-5] 6 x 3TB HGST DeskStar
VMs (SSD): [RAID-1] 2 x1TB SK Hynix Gold
Ext. (HDD): TR-004 [Raid-5] 4 x 4TB HGST Ultastor
RAM: Kingston HyperX Fury 64GB DDR4-2666
UPS: CP AVR1350
Model:TVS-673 32GB & TS-228a Offline[/color]
-----------------------------------------------------------------------------------------------------------------------------------------
2018 Plex NAS Compatibility Guide | QNAP Plex FAQ | Moogle's QNAP Faq
Model: TS-877-1600 FW: 4.5.3.x
QTS (SSD): [RAID-1] 2 x 1TB WD Blue m.2's
Data (HDD): [RAID-5] 6 x 3TB HGST DeskStar
VMs (SSD): [RAID-1] 2 x1TB SK Hynix Gold
Ext. (HDD): TR-004 [Raid-5] 4 x 4TB HGST Ultastor
RAM: Kingston HyperX Fury 64GB DDR4-2666
UPS: CP AVR1350
Model:TVS-673 32GB & TS-228a Offline[/color]
-----------------------------------------------------------------------------------------------------------------------------------------
2018 Plex NAS Compatibility Guide | QNAP Plex FAQ | Moogle's QNAP Faq
-
- New here
- Posts: 5
- Joined: Wed Jun 17, 2020 5:57 am
Re: No Consolidation: Disk images grow to insane sizes
Hello, has there been any improvement on this subject? I also have .iso file constantly growing
Tvs-682
Intel Kaby Lake Core i7 7700 3.6GHz 8MB Cache
Gigabyte GV-N206SWF2OC-8GD RTX 2060S 8GB
24 GB Ram
Seasonic Focus SGX-500 500W 80Plus Gold Power supply
WD Blue WDS500G2B0B 500 GB M.2 SSD
Western Digital WD50EZRZ-00RWYB1 5tb
Western Digital 3.5" 3 TB Caviar Green WD30EZRX SATA 3.0 Intellipower
Intel Kaby Lake Core i7 7700 3.6GHz 8MB Cache
Gigabyte GV-N206SWF2OC-8GD RTX 2060S 8GB
24 GB Ram
Seasonic Focus SGX-500 500W 80Plus Gold Power supply
WD Blue WDS500G2B0B 500 GB M.2 SSD
Western Digital WD50EZRZ-00RWYB1 5tb
Western Digital 3.5" 3 TB Caviar Green WD30EZRX SATA 3.0 Intellipower
- drdope
- Getting the hang of things
- Posts: 84
- Joined: Tue May 24, 2016 8:02 pm
Re: No Consolidation: Disk images grow to insane sizes
The problem isn't as bad, as it was when this thread was started.
I'm running 8x Win10Pro vms and Ubuntu 18.04 vm on our companys TS-677 (R7-1700; 64GB; QM2-2P-384 with 2x 1TB Samsung EVO970/RAID1 as System/VM Drive and 3x 1TB Samsung 860EVO/RAID5 for local Backups).
The vms grow very moderately over time as would be expected (downloading/installing updates on them, occasionally adding a new app or just from the increasing amount of email synct to them via imap).
I recently set up an offsite-replication of our local backups via VPN and consolidated the image-space (using AcronisTI) for saving upload-time.
It free'd up about 80GB, about 9GB/vm. The VMs where initially set up in january 2019, so i wouldn't call the image growth "insane" anymore.
Back when we first used VS 2.x and Win7Pro vms, the images would rapidly expand to the specified maximum amount of disk space assigned.
I'm running 8x Win10Pro vms and Ubuntu 18.04 vm on our companys TS-677 (R7-1700; 64GB; QM2-2P-384 with 2x 1TB Samsung EVO970/RAID1 as System/VM Drive and 3x 1TB Samsung 860EVO/RAID5 for local Backups).
The vms grow very moderately over time as would be expected (downloading/installing updates on them, occasionally adding a new app or just from the increasing amount of email synct to them via imap).
I recently set up an offsite-replication of our local backups via VPN and consolidated the image-space (using AcronisTI) for saving upload-time.
It free'd up about 80GB, about 9GB/vm. The VMs where initially set up in january 2019, so i wouldn't call the image growth "insane" anymore.
Back when we first used VS 2.x and Win7Pro vms, the images would rapidly expand to the specified maximum amount of disk space assigned.
TS-877 https://geizhals.de/?cat=WL-1446616
TS-h973AX https://geizhals.de/?cat=WL-1721479
TS-669l, 3GB (2x 3TB WD30EFRX; Raid1; online-, offdevice-, onsite-backup)
TS-453A, 4GB (2x 3TB WD30EFRX; Raid1; online-, offdevice-, offsite-backup)
https://geizhals.de/?cat=WL-1577757
6x 2TB USB3.0 HDDs in daily rotation (offline, offdevice, offsite-backups)
"roughly 80% of storage related costs are generated by backups"
TS-h973AX https://geizhals.de/?cat=WL-1721479
TS-669l, 3GB (2x 3TB WD30EFRX; Raid1; online-, offdevice-, onsite-backup)
TS-453A, 4GB (2x 3TB WD30EFRX; Raid1; online-, offdevice-, offsite-backup)
https://geizhals.de/?cat=WL-1577757
6x 2TB USB3.0 HDDs in daily rotation (offline, offdevice, offsite-backups)
"roughly 80% of storage related costs are generated by backups"