The community help forum is for home and non-enterprise users. Support is provided by other community members on a best effort / “as available” basis. All of those responding are volunteering their time to help you.
If you’re using Nextcloud in a business/critical setting, paid and SLA-based support services can be accessed via portal.nextcloud.com where Nextcloud engineers can help ensure your business keeps running smoothly.
Getting help
In order to help you as efficiently (and quickly!) as possible, please fill in as much of the below requested information as you can.
(Utilizing these existing resources is typically faster. It also helps reduce the load on our generous volunteers while elevating the signal to noise ratio of the forums otherwise arising from the same queries being posted repeatedly).
We are trying to transition to next cloud from sharefile. When we tried to move over we got deadlocked with the following error codes:
Load times are very slow and CPU keeps spiking. How can we transfer over smoothly?
To better assist you, could you please provide some additional basic information? Your question includes only a general description, so the following details would be very helpful:
Nextcloud Version – Which version of Nextcloud are you currently using?
Hardware Configuration – What type of device are you using to host Nextcloud? How much RAM and what CPU does it have?
Migration Method – What process or tools are you using to transfer data from ShareFile to Nextcloud?
Files and Data Volume – Approximately how much data are you transferring? Are you working with large files, or is it a high number of smaller files?
Error Details – Could you add clearer screenshots or specific error messages that appear during the migration?
These details will help us understand the potential causes of performance issues and high CPU usage, allowing us to offer more targeted solutions.
Hardware Configuration – AWS EC2 instance, Linux/UNIX, Instance type: t2.2xlarge. Number of vCPUs: 8
Migration Method – We are just dragging the files straight from Sharefile’s Windows Explorer app and into the corresponding folder we created in Nextcloud for that office and they start uploading. There are multiple people doing this process at the same time.
Files and Data Volume – A high number of small files.
Error Details – That picture I included Is the errors we are getting. When we drag them over they start to upload and then those are the errors in the logs.
Edit: I tried rebooting our AWS server and now it wont even load the site
Given the additional information, here are some suggested next steps:
Review Nextcloud Version:
Nextcloud 23 is outdated, and newer versions include significant improvements in performance, stability, and bug fixes. Consider updating to a more recent, supported version of Nextcloud (Nextcloud 25 or higher). Ensure that all necessary backups are made before upgrading, and follow the official upgrade guide.
Optimize AWS Instance Configuration:
The t2.2xlarge instance has 8 vCPUs but uses burstable CPU credits, which might be insufficient for sustained high-performance needs, especially if multiple users are uploading simultaneously. Consider upgrading to an m5 or c5 instance type, which offers consistent performance without reliance on burst credits, to handle the increased workload.
Use WebDAV for Bulk Uploads:
Direct dragging and dropping can lead to issues, particularly with a large number of small files and concurrent uploads. For better handling of bulk transfers, try using a dedicated tool compatible with Nextcloud, such as WebDAV clients (e.g., Cyberduck, WinSCP, or the Nextcloud desktop client). This may improve stability and reduce errors in the upload process.
Monitor and Analyze Logs:
Review the logs more closely for specific errors during the upload process. Detailed logs are usually available in Nextcloud’s data directory under /var/www/nextcloud/data/nextcloud.log. Check for recurring patterns or specific error codes related to file locking, database overload, or timeout issues, which can provide further insights.
Database Performance Tuning:
High volumes of small files can put a strain on Nextcloud’s database. If you are using MySQL/MariaDB, ensure the following:
Enable caching (e.g., InnoDB buffer pool size settings).
Use a dedicated RDS instance for the database if possible to separate it from Nextcloud’s web server and reduce the load on your EC2 instance.
Set up a cron job for regular background tasks to prevent database locks during high traffic periods.
Optimize Nextcloud for Concurrent Users:
Consider enabling Redis for file locking and caching to help manage concurrent access to files and reduce database load.
Review the Nextcloud configuration for multi-user environments to ensure settings like memory limits, timeout values, and locking mechanisms are properly tuned for heavy usage.
Address the Site Loading Issue:
If the site won’t load post-reboot, check AWS CloudWatch metrics for any obvious issues (e.g., CPU or memory exhaustion) and check the EC2 instance’s SSH access to review server logs. Verify that Apache/Nginx and PHP-FPM (or PHP if running as a standalone process) are correctly running.
Following these steps should help you stabilize and optimize your Nextcloud environment for better performance and smoother migration from ShareFile.
WebDAV is not a really great protocol for transferring a lot of data. It would be better if you copy the files to the data structure via ssh/sftp/rsync and then run the following command once so that Nextcloud recognises the files.
@devnull So we are going to be transitioning from sharefile to next cloud, can you give a little more specific instructions for how I would use your suggested protocol to do this from sharefile to next cloud?
