Local storage Question

gas85 · February 26, 2019, 4:15pm

Thats funny, because your partition has no space left (100% being used):

I believe that this user (dtorres) has used most of your space.

Also appdata looks a little bit big. I bet you have previews enabled and if you check inside of appdata folder preview will be the biggest one. Example of command under appdata folder:

du -ah --max-depth=1 . | sort -hr
27G	./preview
27G	.
2.9M	./js
1.4M	./appstore
704K	./css
664K	./avatar
228K	./theming
204K	./dav-photocache
124K	./identityproof
20K	./external
8.0K	./richdocuments

As you can see my previews folder is huge, but this does not disturbs me → Previews / data size

daku97 · March 1, 2019, 5:08pm

OK here is the before:

ncadmin@cloud:~$ sudo du -ah --max-depth=1  /mnt/ncdata | sort -hr
[sudo] password for ncadmin:
2.8G    /mnt/ncdata
2.7G    /mnt/ncdata/dtorres
129M    /mnt/ncdata/appdata_ocm2710gjvgh
11M     /mnt/ncdata/ncadmin
11M     /mnt/ncdata/jtorres
11M     /mnt/ncdata/datorres
213K    /mnt/ncdata/files_external
65K     /mnt/ncdata/nextcloud.log
4.5K    /mnt/ncdata/updater.log
4.5K    /mnt/ncdata/.htaccess
512     /mnt/ncdata/updater-ocm2710gjvgh
512     /mnt/ncdata/.ocdata
512     /mnt/ncdata/index.html

I am very new to NextCloud and Linux in general. I edited the config.php file, added:

  'enable_previews' => true,
    'enabledPreviewProviders' => 
    array (
      0 => 'OC\\Preview\\PNG',
      1 => 'OC\\Preview\\JPEG',
      2 => 'OC\\Preview\\GIF',
      3 => 'OC\\Preview\\BMP',
      4 => 'OC\\Preview\\XBitmap',
      5 => 'OC\\Preview\\Movie',
      6 => 'OC\\Preview\\PDF',
      7 => 'OC\\Preview\\MP3',
      8 => 'OC\\Preview\\TXT',
      9 => 'OC\\Preview\\MarkDown',
    ),
    'preview_max_x' => 1080,
    'preview_max_y' => 1920,
),
);

Then ran :
sudo -u www-data /var/www/nextcloud/occ config:app:set --value=“32 64 1024” previewgenerator squareSizes

Responce was:
Config value squareSizes for app previewgenerator set to 32 64 1024

sudo -u www-data /var/www/nextcloud/occ config:app:set --value=“64 128 1024” previewgenerator widthSizes

Responce was
Config value widthSizes for app previewgenerator set to 64 128 1024

sudo -u www-data /var/www/nextcloud/occ config:app:set --value=“64 256 1024” previewgenerator heightSizes

Responce was
Config value heightSizes for app previewgenerator set to 64 256 1024

Here is after deleting all my data and emptying the trash bin:

ncadmin@cloud:~$ sudo du -ah --max-depth=1  /mnt/ncdata | sort -hr
160M    /mnt/ncdata
129M    /mnt/ncdata/appdata_ocm2710gjvgh
11M     /mnt/ncdata/ncadmin
11M     /mnt/ncdata/jtorres
11M     /mnt/ncdata/datorres
213K    /mnt/ncdata/files_external
76K     /mnt/ncdata/dtorres
65K     /mnt/ncdata/nextcloud.log
4.5K    /mnt/ncdata/updater.log
4.5K    /mnt/ncdata/.htaccess
512     /mnt/ncdata/updater-ocm2710gjvgh
512     /mnt/ncdata/.ocdata
512     /mnt/ncdata/index.html

Another view is:

ncadmin@cloud:~$ df -Th
Filesystem                     Type      Size  Used Avail Use% Mounted on
udev                           devtmpfs  1.9G     0  1.9G   0% /dev
tmpfs                          tmpfs     393M  1.2M  391M   1% /run
/dev/mapper/nextcloud--vg-root ext4       39G  8.7G   28G  25% /
tmpfs                          tmpfs     2.0G  8.0K  2.0G   1% /dev/shm
tmpfs                          tmpfs     5.0M     0  5.0M   0% /run/lock
tmpfs                          tmpfs     2.0G     0  2.0G   0% /sys/fs/cgroup
ncdata                         zfs       641M  161M  481M  25% /mnt/ncdata
tmpfs                          tmpfs     393M     0  393M   0% /run/user/1000

Space seems to no longer be an issue. I still problems with my Cert but i’ll open a new thread on that.

Thanks for all the help!!

daku97 · March 13, 2019, 6:51pm

@ gas85

Sorry, seems like I spoke to soon. My disk usage is now:

ncadmin@cloud:~$ df -Th
Filesystem                     Type      Size  Used Avail Use% Mounted on
udev                           devtmpfs  1.9G     0  1.9G   0% /dev
tmpfs                          tmpfs     393M  1.3M  391M   1% /run
/dev/mapper/nextcloud--vg-root ext4       39G  9.4G   27G  26% /
tmpfs                          tmpfs     2.0G   72K  2.0G   1% /dev/shm
tmpfs                          tmpfs     5.0M     0  5.0M   0% /run/lock
tmpfs                          tmpfs     2.0G     0  2.0G   0% /sys/fs/cgroup
ncdata                         zfs        33M   33M     0 100% /mnt/ncdata
tmpfs                          tmpfs     393M     0  393M   0% /run/user/1000

ncadmin@cloud:~$ sudo du -ah --max-depth=1  /mnt/ncdata | sort -hr

33M     /mnt/ncdata
11M     /mnt/ncdata/ncadmin
11M     /mnt/ncdata/datorres
5.6M    /mnt/ncdata/appdata_ocm2710gjvgh
5.5M    /mnt/ncdata/jtorres
733K    /mnt/ncdata/nextcloud.log
177K    /mnt/ncdata/files_external
65K     /mnt/ncdata/dtorres
4.5K    /mnt/ncdata/updater.log
4.5K    /mnt/ncdata/.htaccess
512     /mnt/ncdata/updater-ocm2710gjvgh
512     /mnt/ncdata/.ocdata
512     /mnt/ncdata/index.html

Compare the df -Th with one from a few weeks ago:

ncadmin@cloud:~$ df -Th
Filesystem                     Type      Size  Used Avail Use% Mounted on
udev                           devtmpfs  1.9G     0  1.9G   0% /dev
tmpfs                          tmpfs     393M  1.3M  391M   1% /run
/dev/mapper/nextcloud--vg-root ext4       39G  8.9G   28G  25% /
tmpfs                          tmpfs     2.0G  8.0K  2.0G   1% /dev/shm
tmpfs                          tmpfs     5.0M     0  5.0M   0% /run/lock
tmpfs                          tmpfs     2.0G     0  2.0G   0% /sys/fs/cgroup
ncdata                         zfs        24G   24G  497M  98% /mnt/ncdata
tmpfs                          tmpfs     393M     0  393M   0% /run/user/1000

I can no longer login with out getting the, Internal Server Error, message. How is it possible the ncdata partition is shrinking?

Any guidance would be greatly appreciated. Thanks again!

enoch85 · March 18, 2019, 7:28pm

Using the preview generator app will fill your disk if not setup properly. Hence there is a script for it in the VM that can be found here.

daku97 · March 21, 2019, 6:55pm

@enoch85 Thanks for the script. I ran it till successful but this did not address my issue. As seen below the appdata folder is a good size. I can no longer login with out getting the, Internal Server Error, message. How is it possible the ncdata partition is shrinking?

ncadmin@cloud:~$ df -Th
Filesystem Type Size Used Avail Use% Mounted on
udev devtmpfs 1.9G 0 1.9G 0% /dev
tmpfs tmpfs 393M 1.3M 391M 1% /run
/dev/mapper/nextcloud–vg-root ext4 39G 9.4G 27G 26% /
tmpfs tmpfs 2.0G 72K 2.0G 1% /dev/shm
tmpfs tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs tmpfs 2.0G 0 2.0G 0% /sys/fs/cgroup
ncdata zfs 33M 33M 0 100% /mnt/ncdata
tmpfs tmpfs 393M 0 393M 0% /run/user/1000

ncadmin@cloud:~$ sudo du -ah --max-depth=1 /mnt/ncdata | sort -hr

33M /mnt/ncdata
11M /mnt/ncdata/ncadmin
11M /mnt/ncdata/datorres
5.6M /mnt/ncdata/appdata_ocm2710gjvgh
5.5M /mnt/ncdata/jtorres
733K /mnt/ncdata/nextcloud.log
177K /mnt/ncdata/files_external
65K /mnt/ncdata/dtorres
4.5K /mnt/ncdata/updater.log
4.5K /mnt/ncdata/.htaccess
512 /mnt/ncdata/updater-ocm2710gjvgh
512 /mnt/ncdata/.ocdata
512 /mnt/ncdata/index.html

Compare the df -Th with one from a few weeks ago:

ncadmin@cloud:~$ df -Th

Filesystem Type Size Used Avail Use% Mounted on
udev devtmpfs 1.9G 0 1.9G 0% /dev
tmpfs tmpfs 393M 1.3M 391M 1% /run
/dev/mapper/nextcloud–vg-root ext4 39G 8.9G 28G 25% /
tmpfs tmpfs 2.0G 8.0K 2.0G 1% /dev/shm
tmpfs tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs tmpfs 2.0G 0 2.0G 0% /sys/fs/cgroup
ncdata zfs 24G 24G 497M 98% /mnt/ncdata
tmpfs tmpfs 393M 0 393M 0% /run/user/1000

Any guidance would be greatly appreciated. Thanks again!

gas85 · March 26, 2019, 12:59pm

From 24 GB to 33 Mb? Do no know
Could be that you have Hardware issue? Did you lost all your data in NC?

daku97 · March 27, 2019, 1:32am

Hi Georgiy, I have become so frustrated with storage issues I have moved all my data to a Windows server. I am now using NC external disks and sync data directly. NC is now solely as a pass thru but now that is not working either. I’m shocked that so much work would be needed just to keep it stable. Admittedly I am not strong a Linux person.

This is a Hyper-V Virtual Machine, so no hardware issues are possible. The underlining host is 100%. I am now focused on the " Internal Server Error". I have reviewed many postings of the same error but can’t find a solution. Any logs to look that might help?

Thanks again!

gas85 · March 27, 2019, 7:58am

I have’t used Hyper-V, but NC is pretty simple - it is just an application with DB access and you can map DATA folder to whatever place via config or mount. Also you can added external storage as local folder if you need. Basically you need only to bother about DB access, local storage access and make server (with Apache2 or ngnix) that will serve your https connections, additionally added you Letsencrypt cert and it is done.
It seems that something wrong with you virtual machine, but as I did not used Hyper-V, I can’t help you ad-hoc
Try to open a ticket in GitHub with logs and all relevant data.

or for Docker: