No Consolidation: Disk images grow to insane sizes

RonanAccuser
Starting out
Posts: 39
Joined: Tue Oct 27, 2015 12:20 am

Re: No Consolidation: Disk images grow to insane sizes

Post by RonanAccuser » Sat Apr 29, 2017 8:11 pm

Windows Backup has lots of issues.
The way I described seems to be the most reliable.

ChristopherLarkin
Starting out
Posts: 25
Joined: Tue Oct 04, 2016 3:02 am

Re: No Consolidation: Disk images grow to insane sizes

Post by ChristopherLarkin » Mon May 22, 2017 7:52 pm

Trexx wrote:Currently the option available is the manual process I laid out.

The best way to get enhancements/fixes made to QNAP is via a Helpdesk ticket as QNAP does not generally monitor these forums. QNAP has been enhancing VS as seen by the changes between VS 2.x & 3.x. so hopefully that will be added as some point down the road.


Thanks for your help - I appreciate the reply!

User avatar
Trexx
Ask me anything
Posts: 5251
Joined: Sat Oct 01, 2011 7:50 am
Location: Minnesota

Re: No Consolidation: Disk images grow to insane sizes

Post by Trexx » Mon May 22, 2017 8:53 pm

ChristopherLarkin wrote:
Trexx wrote:Currently the option available is the manual process I laid out.

The best way to get enhancements/fixes made to QNAP is via a Helpdesk ticket as QNAP does not generally monitor these forums. QNAP has been enhancing VS as seen by the changes between VS 2.x & 3.x. so hopefully that will be added as some point down the road.


Thanks for your help - I appreciate the reply!


No problem. Generally things will get fixed most of the time, but it does take some patience at times.


Sent from my iPad using Tapatalk
Paul

Model: TS-877-1600 FW: 4.4.3.x
QTS (SSD): [RAID-1] 2 x 1TB WD Blue m.2's
Data (HDD): [RAID-5] 6 x 3TB HGST DeskStar
VMs (SSD): [RAID-1] 2 x 500GB Evo 860
Ext. (HDD): TR-004 [Raid-5] 4 x 4TB HGST Ultastor
RAM: Kingston HyperX Fury 64GB DDR4-2666
GPU: EVGA GTX 1060 6GB
UPS: CP AVR1350

Model:TVS-673 32GB FW: 4.4.3.x Test/Backup Box
Model:TS-228a FW: 4.4.3.x Test/Backup Box
-----------------------------------------------------------------------------------------------------------------------------------------
NAS RAID Rebuild Times | Live QTS Videos | | QNAP NAS Guide | Information needed when you ask for HELP | QNAP Links, Tutorials, etc.
2018 Plex NAS Compatibility Guide | QNAP Plex FAQ | Moogle's QNAP Faq

ChristopherLarkin
Starting out
Posts: 25
Joined: Tue Oct 04, 2016 3:02 am

Re: No Consolidation: Disk images grow to insane sizes

Post by ChristopherLarkin » Thu Jun 01, 2017 11:58 am

So true - they say patience is a virtue. One day there will be an app for that. :-)

Thanks again for your contributions to the thread. I *love* the Virtualization Station and use it extensively, or at least enough to wish I had an i7 or two as the CPU(s) in this box!

Christopher

alejandrom3m
First post
Posts: 1
Joined: Tue Nov 07, 2017 6:52 pm

Re: No Consolidation: Disk images grow to insane sizes

Post by alejandrom3m » Mon Nov 13, 2017 3:52 pm

Trexx wrote:The max size for an .img file is whatever you set if for at time of VM creation. So if you tell Windows 10 that is can be 50GB, that is how big the .img file can grow to. It is 100% under your control how much space the files are going to take up.

There is a manual process you can use to shrink the file, which is outlined here:
https://pve.proxmox.com/wiki/Shrink_Qcow2_Disk_Files

Short Version (Replace .img file names where applicable):

Within Windows 10:
  • Defrag HDD using Win10 or 3rd party defrag utility
  • Zero out free space using SDelete

Shutdown the VM!


SSH'd onto QNAP:
  1. Create symlink to qemu-img file to make it easier to work with files.

    Code: Select all

    ln -s /share/CACHEDEV1_DATA/.qpkg/QKVM/usr/bin/qemu-img /usr/sbin/qemu-img

  2. Navigate to VM folder and create backup of existing image file.

    Code: Select all

    mv Win10.img Win10.img_backup

  3. Create SHRUNK disk file.

    Faster Compress / Larger File:

    Code: Select all

    qemu-img convert -O qcow2 -Win10.img_backup Win10.img

    OR

    Slower Compress / Smaller File:

    Code: Select all

    qemu-img convert -O qcow2 -c Win10.img_backup Win10.img

  4. Boot your VM and verify everything is working properly.
  5. You can delete .img_backup files once you have validated the VM if you like.




I compressed my img and the size decrease from 50gb to 19gb.
What cons have the file shrunk compress? Time to load maybe?

Thanks for advance.

User avatar
Trexx
Ask me anything
Posts: 5251
Joined: Sat Oct 01, 2011 7:50 am
Location: Minnesota

Re: No Consolidation: Disk images grow to insane sizes

Post by Trexx » Tue Nov 14, 2017 12:28 am

So assuming that your set your VM Disk max to 50GB, the biggest drawback is as the VM writes additional data (i.e downloads patches, etc.) that expand past your 19GB size it will have to grow the storage on the fly (i.e. similar to how a Thin Volume works). This incurrs a performance penalty for your VM.

So unless you are really tight on space, from a performance perspective you are better off leaving the file as the larger size.
Paul

Model: TS-877-1600 FW: 4.4.3.x
QTS (SSD): [RAID-1] 2 x 1TB WD Blue m.2's
Data (HDD): [RAID-5] 6 x 3TB HGST DeskStar
VMs (SSD): [RAID-1] 2 x 500GB Evo 860
Ext. (HDD): TR-004 [Raid-5] 4 x 4TB HGST Ultastor
RAM: Kingston HyperX Fury 64GB DDR4-2666
GPU: EVGA GTX 1060 6GB
UPS: CP AVR1350

Model:TVS-673 32GB FW: 4.4.3.x Test/Backup Box
Model:TS-228a FW: 4.4.3.x Test/Backup Box
-----------------------------------------------------------------------------------------------------------------------------------------
NAS RAID Rebuild Times | Live QTS Videos | | QNAP NAS Guide | Information needed when you ask for HELP | QNAP Links, Tutorials, etc.
2018 Plex NAS Compatibility Guide | QNAP Plex FAQ | Moogle's QNAP Faq

signor_ali
New here
Posts: 5
Joined: Wed Jun 17, 2020 5:57 am

Re: No Consolidation: Disk images grow to insane sizes

Post by signor_ali » Tue Jun 23, 2020 1:46 am

Hello, has there been any improvement on this subject? I also have .iso file constantly growing
Tvs-682
Intel Kaby Lake Core i7 7700 3.6GHz 8MB Cache
Gigabyte GV-N206SWF2OC-8GD RTX 2060S 8GB
24 GB Ram
Seasonic Focus SGX-500 500W 80Plus Gold Power supply
WD Blue WDS500G2B0B 500 GB M.2 SSD
Western Digital WD50EZRZ-00RWYB1 5tb
Western Digital 3.5" 3 TB Caviar Green WD30EZRX SATA 3.0 Intellipower

drdope
Starting out
Posts: 20
Joined: Tue May 24, 2016 8:02 pm

Re: No Consolidation: Disk images grow to insane sizes

Post by drdope » Sat Jul 18, 2020 6:21 pm

The problem isn't as bad, as it was when this thread was started.
I'm running 8x Win10Pro vms and Ubuntu 18.04 vm on our companys TS-677 (R7-1700; 64GB; QM2-2P-384 with 2x 1TB Samsung EVO970/RAID1 as System/VM Drive and 3x 1TB Samsung 860EVO/RAID5 for local Backups).

The vms grow very moderately over time as would be expected (downloading/installing updates on them, occasionally adding a new app or just from the increasing amount of email synct to them via imap).
I recently set up an offsite-replication of our local backups via VPN and consolidated the image-space (using AcronisTI) for saving upload-time.
It free'd up about 80GB, about 9GB/vm. The VMs where initially set up in january 2019, so i wouldn't call the image growth "insane" anymore.

Back when we first used VS 2.x and Win7Pro vms, the images would rapidly expand to the specified maximum amount of disk space assigned.

Post Reply

Return to “Virtualization Station”