Nextcloud using up to double the space of the files

[/details]

Nextcloud version ( 19.0.1):
Operating system and version (5.4.51-v7l+ armv7l):
Apache or nginx version (No idea):
PHP version (7.3.19):

The issue you are facing:

Insufficient space on server.

This is my first install of next cloud. I left everything transferring overnight via my main computer to nextcloud using the desktop client gui. I noticed this morning I had the above error. Now I only have 277gb of stuff to transfer and my ssd that is mounted for next cloud and set as where it should upload to is 500gb.

I ssh’d into the pi and noticed that nextcloud has doubled the actual size of some of files, so folders that are 80gb are now 160gb for some reason.

Is this the first time you’ve seen this error? (Y):

The output of your Nextcloud log in Admin > Logging:

[webdav] Fatal: Sabre\DAV\Exception\InsufficientStorage: Insufficient space in /Archive/d/FU/7GKUZT7QEDGY3K6HSAKLW6JERJDCD7, 3478567462 required, 440020992 available at <<closure>>

0. /var/www/nextcloud/apps/dav/lib/Connector/Sabre/QuotaPlugin.php line 137
   OCA\DAV\Connector\Sabre\QuotaPlugin->checkQuota("/Archive/d/FU/7 ... 7", 3478567462)
1. /var/www/nextcloud/3rdparty/sabre/event/lib/WildcardEmitterTrait.php line 89
   OCA\DAV\Connector\Sabre\QuotaPlugin->beforeMove("uploads/martin/1056476183/.file", "files/martin/Ar ... r")
2. /var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/CorePlugin.php line 632
   Sabre\DAV\Server->emit("beforeMove", ["uploads/martin ... "])
3. /var/www/nextcloud/3rdparty/sabre/event/lib/WildcardEmitterTrait.php line 89
   Sabre\DAV\CorePlugin->httpMove(Sabre\HTTP\Request {}, Sabre\HTTP\Response {})
4. /var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php line 474
   Sabre\DAV\Server->emit("method:MOVE", [Sabre\HTTP\Requ ... }])
5. /var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php line 251
   Sabre\DAV\Server->invokeMethod(Sabre\HTTP\Request {}, Sabre\HTTP\Response {})
6. /var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php line 319
   Sabre\DAV\Server->start()
7. /var/www/nextcloud/apps/dav/lib/Server.php line 320
   Sabre\DAV\Server->exec()
8. /var/www/nextcloud/apps/dav/appinfo/v2/remote.php line 35
   OCA\DAV\Server->exec()
9. /var/www/nextcloud/remote.php line 167
   require_once("/var/www/nextcl ... p")

Please install “ncdu” and find the biggest folders.
Perhaps there are backups of old nextcloud versions.

apt-get install ncdu

cd /path/of/nextcloud
ncdu

browse through folders

Hi @devnull

Just did, thanks for that.

Here is the issue, the files that issue is with is cryptomator encrypted files. So I don’t know what I can delete without causing an issue if I were to try and reopen them.

See below, there are duplicates, but unsure what I can delete.

                         /..
8.7 GiB [##########]  Nljh-D8OApulYKNCMenTxe9MIK3ATKS2bofdwS7H6CL_1a4RNBOx7TnqrlGo1YKNuQY8GJXt0Q==.c9r.ocTransferId852525167.part
8.7 GiB [##########]  Nljh-D8OApulYKNCMenTxe9MIK3ATKS2bofdwS7H6CL_1a4RNBOx7TnqrlGo1YKNuQY8GJXt0Q==.c9r.ocTransferId494273069.part
8.7 GiB [##########]  Nljh-D8OApulYKNCMenTxe9MIK3ATKS2bofdwS7H6CL_1a4RNBOx7TnqrlGo1YKNuQY8GJXt0Q==.c9r.ocTransferId473654533.part
4.6 GiB [#####     ]  DT0VXpy-xlAesFRdkXAY3mr6dCTyyKZobeRvl7mWxGbmJXxV_OLeopPmVFG5WIFHWsCVKMk=.c9r.ocTransferId1877012282.part
4.6 GiB [#####     ]  DT0VXpy-xlAesFRdkXAY3mr6dCTyyKZobeRvl7mWxGbmJXxV_OLeopPmVFG5WIFHWsCVKMk=.c9r.ocTransferId1332289284.part
4.6 GiB [#####     ]  DT0VXpy-xlAesFRdkXAY3mr6dCTyyKZobeRvl7mWxGbmJXxV_OLeopPmVFG5WIFHWsCVKMk=.c9r.ocTransferId1257508302.part
4.6 GiB [#####     ]  DT0VXpy-xlAesFRdkXAY3mr6dCTyyKZobeRvl7mWxGbmJXxV_OLeopPmVFG5WIFHWsCVKMk=.c9r.ocTransferId985905242.part
4.6 GiB [#####     ]  DT0VXpy-xlAesFRdkXAY3mr6dCTyyKZobeRvl7mWxGbmJXxV_OLeopPmVFG5WIFHWsCVKMk=.c9r.ocTransferId730239799.part
4.6 GiB [#####     ]  DT0VXpy-xlAesFRdkXAY3mr6dCTyyKZobeRvl7mWxGbmJXxV_OLeopPmVFG5WIFHWsCVKMk=.c9r.ocTransferId1947651447.part
4.6 GiB [#####     ]  DT0VXpy-xlAesFRdkXAY3mr6dCTyyKZobeRvl7mWxGbmJXxV_OLeopPmVFG5WIFHWsCVKMk=.c9r.ocTransferId1055516710.part
3.7 GiB [####      ]  Nljh-D8OApulYKNCMenTxe9MIK3ATKS2bofdwS7H6CL_1a4RNBOx7TnqrlGo1YKNuQY8GJXt0Q==.c9r.ocTransferId203736597.part
3.3 GiB [###       ]  DT0VXpy-xlAesFRdkXAY3mr6dCTyyKZobeRvl7mWxGbmJXxV_OLeopPmVFG5WIFHWsCVKMk=.c9r.ocTransferId756882393.part
3.1 GiB [###       ]  0PKZ5JlPd6n1Nb8qPzKQCfggFlhXmo1gsLe8CoIq_7qerduhsJZk4Wq2rMltvceIuMd2nqJ2xQ==.c9r.ocTransferId253999170.part
3.1 GiB [###       ]  0PKZ5JlPd6n1Nb8qPzKQCfggFlhXmo1gsLe8CoIq_7qerduhsJZk4Wq2rMltvceIuMd2nqJ2xQ==.c9r.ocTransferId624331244.part
3.1 GiB [###       ]  0PKZ5JlPd6n1Nb8qPzKQCfggFlhXmo1gsLe8CoIq_7qerduhsJZk4Wq2rMltvceIuMd2nqJ2xQ==.c9r.ocTransferId400146963.part
3.1 GiB [###       ]  0PKZ5JlPd6n1Nb8qPzKQCfggFlhXmo1gsLe8CoIq_7qerduhsJZk4Wq2rMltvceIuMd2nqJ2xQ==.c9r.ocTransferId38518956.part
3.1 GiB [###       ]  0PKZ5JlPd6n1Nb8qPzKQCfggFlhXmo1gsLe8CoIq_7qerduhsJZk4Wq2rMltvceIuMd2nqJ2xQ==.c9r.ocTransferId2004726297.part
3.1 GiB [###       ]  0PKZ5JlPd6n1Nb8qPzKQCfggFlhXmo1gsLe8CoIq_7qerduhsJZk4Wq2rMltvceIuMd2nqJ2xQ==.c9r.ocTransferId198649295.part
3.1 GiB [###       ]  0PKZ5JlPd6n1Nb8qPzKQCfggFlhXmo1gsLe8CoIq_7qerduhsJZk4Wq2rMltvceIuMd2nqJ2xQ==.c9r.ocTransferId1594765063.part
3.1 GiB [###       ]  0PKZ5JlPd6n1Nb8qPzKQCfggFlhXmo1gsLe8CoIq_7qerduhsJZk4Wq2rMltvceIuMd2nqJ2xQ==.c9r.ocTransferId1544383873.part
3.1 GiB [###       ]  0PKZ5JlPd6n1Nb8qPzKQCfggFlhXmo1gsLe8CoIq_7qerduhsJZk4Wq2rMltvceIuMd2nqJ2xQ==.c9r.ocTransferId1452022648.part
3.1 GiB [###       ]  0PKZ5JlPd6n1Nb8qPzKQCfggFlhXmo1gsLe8CoIq_7qerduhsJZk4Wq2rMltvceIuMd2nqJ2xQ==.c9r.ocTransferId1185462217.part
3.1 GiB [###       ]  0PKZ5JlPd6n1Nb8qPzKQCfggFlhXmo1gsLe8CoIq_7qerduhsJZk4Wq2rMltvceIuMd2nqJ2xQ==.c9r.ocTransferId1012692379.part
2.6 GiB [##        ]  DT0VXpy-xlAesFRdkXAY3mr6dCTyyKZobeRvl7mWxGbmJXxV_OLeopPmVFG5WIFHWsCVKMk=.c9r.ocTransferId565951207.part

681.3 MiB [ ] 0PKZ5JlPd6n1Nb8qPzKQCfggFlhXmo1gsLe8CoIq_7qerduhsJZk4Wq2rMltvceIuMd2nqJ2xQ==.c9r.ocTransferId1833993665.part
642.6 MiB [ ] DT0VXpy-xlAesFRdkXAY3mr6dCTyyKZobeRvl7mWxGbmJXxV_OLeopPmVFG5WIFHWsCVKMk=.c9r.ocTransferId1413555231.part
95.0 MiB [ ] gP7kQA700ZkWNQDx8TpZOJumKaljUaY8GQYFILgDIWnET4uSBiSb9r1Th4PazbaRmhUfkztbPQ==.c9r
61.5 MiB [ ] RC05-kvj2Yg6Dp1PapPm2mMmbQzEjHIuQOgDkGSYWj4V8Lb_ZoEqYEdrKBZ8Ix5qItnciIo=.c9r
16.0 KiB [ ] /nLX2U7hB7WEb5udXy5h9FxmipJ9ecmQME-NinT23Lxqq.c9r

Sorry. I do not use Cryptomator.
Please make checksums to test the files are really equal:

md5sum Nljh-D8OApulYKNCMenTxe9MIK3ATKS2bofdwS7H6CL_1a4RNBOx7TnqrlGo1YKNuQY8GJXt0Q==.c9r.ocTransferId852525167.part
md5sum Nljh-D8OApulYKNCMenTxe9MIK3ATKS2bofdwS7H6CL_1a4RNBOx7TnqrlGo1YKNuQY8GJXt0Q==.c9r.ocTransferId494273069.part
md5sum Nljh-D8OApulYKNCMenTxe9MIK3ATKS2bofdwS7H6CL_1a4RNBOx7TnqrlGo1YKNuQY8GJXt0Q==.c9r.ocTransferId473654533.part

Is the suffix “.part” normal for Cryptomator or is it only a part of the file?

Is the cryptomator suffix.

So I was assuming the .part was put there by nextcloud. As it may have been an issue with upload. If that’s the case I think I can comfortably delete any duplicates which has the same leading id.
E.G.

Delete these:

8.7 GiB [##########]  Nljh-D8OApulYKNCMenTxe9MIK3ATKS2bofdwS7H6CL_1a4RNBOx7TnqrlGo1YKNuQY8GJXt0Q==.c9r.ocTransferId852525167.part
8.7 GiB [##########]  Nljh-D8OApulYKNCMenTxe9MIK3ATKS2bofdwS7H6CL_1a4RNBOx7TnqrlGo1YKNuQY8GJXt0Q==.c9r.ocTransferId494273069.part

Keep this:

8.7 GiB [##########]  Nljh-D8OApulYKNCMenTxe9MIK3ATKS2bofdwS7H6CL_1a4RNBOx7TnqrlGo1YKNuQY8GJXt0Q==.c9r.ocTransferId473654533.part

Not sure how to display the checksum?

Change with the terminal in the corresponding directory and then

md5sum NLjh*

If the files are bitwise equal the md5sum is equal, too.

Please do not delete the files.
Move them to another directory on the same partition.
If it goes wrong, you can move them back :wink:

the suffix “.part” is normal used for divided files.
Perhaps the files are only divided in different parts.

Hmmm, it’s strange, I have a backup of everything I made offsite so if this doesn’t work I should be good to get the files again.

So I just used checksum and the output is different for each of them…

Ok. Can you post date and time of creation, modification, …
Only the three files. Perhaps it is the date of re-upload, modification …
8.7 GB is the really correct size on client side?

ls -l *

stat *

Paste updated.

You can see the date and time for creation and modification.
I think this are three different versions from different times.

You can then delete the old ones.
But where in your nextcloud are the files?

If you want delete them from the display in nextcloud you must re-scan your database.

files:scan rescan filesystem
(with option only your user)

https://docs.nextcloud.com/server/19/admin_manual/configuration_server/occ_command.html

I’ll give this a shot, thanks so much for your help.

It worked, thank you!

I think what had happened was nexcloud started to back up the cryptomator drive whilst I was still adding to it which ended up throwing out the errors also.