Slow load page with large files

Support intro

Sorry to hear you’re facing problems :slightly_frowning_face:

help.nextcloud.com is for home/non-enterprise users. If you’re running a business, paid support can be accessed via portal.nextcloud.com where we can ensure your business keeps running smoothly.

In order to help you as quickly as possible, before clicking Create Topic please provide as much of the below as you can. Feel free to use a pastebin service for logs, otherwise either indent short log examples with four spaces:

example

Or for longer, use three backticks above and below the code snippet:

longer
example
here

Some or all of the below information will be requested if it isn’t supplied; for fastest response please provide as much as you can :heart:

Nextcloud version (eg, 12.0.2): 17.0.2
Operating system and version (eg, Ubuntu 17.04): Ubuntu 18.04 TLS
Apache or nginx version (eg, Apache 2.4.25): Apache 2.4.41
PHP version (eg, 7.1): 7.3.13

The issue you are facing: If i to do any with file more than 200 Mb my interface and page responce very slow. On system I see when i try download large file, that my average load CPU more than 1.2(sometimes >2). For example:
file size 594,8Mb clicking to download, page response for starting download ~ 85sec,
file size 2,2Gb clicking to download, page response for starting download ~ 180sec.
My NC live on VMware, storage 500Gb, 2 core Intel® Xeon® CPU X5650 @ 2.67GHz, 4 RAM. I’m disable a lot apps, my tests after reboot server and with 1 active user have same results.

Is this the first time you’ve seen this error? (Y/N): Yes

The output of your Nextcloud log in Admin > Logging: null

The output of your config.php file in /path/to/nextcloud (make sure you remove any identifiable information!):

  'auth.bruteforce.protection.enabled' => true,
  'blacklisted_files' => 
  array (
    0 => '.htaccess',
    1 => 'Thumbs.db',
    2 => 'thumbs.db',
  ),
  'cron_log' => true,
  'enable_previews' => true,
  'enabledPreviewProviders' => 
  array (
    0 => 'OC\\Preview\\PNG',
    1 => 'OC\\Preview\\JPEG',
    2 => 'OC\\Preview\\GIF',
    3 => 'OC\\Preview\\BMP',
    4 => 'OC\\Preview\\XBitmap',
    5 => 'OC\\Preview\\Movie',
    6 => 'OC\\Preview\\PDF',
    7 => 'OC\\Preview\\MP3',
    8 => 'OC\\Preview\\TXT',
    9 => 'OC\\Preview\\MarkDown',
  ),
  'filesystem_check_changes' => 0,
  'filelocking.enabled' => 'true',
  'htaccess.RewriteBase' => '/',
  'integrity.check.disabled' => false,
  'knowledgebaseenabled' => false,
  'logfile' => '/var/nc_data/nextcloud.log',
  'loglevel' => 2,
  'logtimezone' => 'Europe/Berlin',
  'log_rotate_size' => 104857600,
  'maintenance' => false,
  'memcache.local' => '\\OC\\Memcache\\APCu',
'memcache.locking' => '\\OC\\Memcache\\Redis',
  'overwriteprotocol' => 'https',
  'preview_max_x' => 1024,
  'preview_max_y' => 768,
  'preview_max_scale_factor' => 1,
  'redis' => 
  array (
    'host' => '/var/run/redis/redis-server.sock',
    'port' => 0,
    'timeout' => 0.0,
  ),
  'quota_include_external_storage' => false,
  'share_folder' => '/Shares',
  'skeletondirectory' => '',
  'theme' => '',
  'trashbin_retention_obligation' => 'auto, 7',
  'updater.release.channel' => 'stable',
  'ldapIgnoreNamingRules' => false,
  'ldapProviderFactory' => 'OCA\\User_LDAP\\LDAPProviderFactory',
  'app_install_overwrite' => 
  array (
    0 => 'nextant',
  ),
  'updater.secret' => '$2y$10$J6vFIo814u9ybYyPqnhQleVw7U541fUWx00THjIJXPGlv/ma',
);

The output of your Apache/nginx/system log in /var/log/____: this part of access.log apache2, when I’m press download file 2.2Gb in 21:31.

x.x.x.x - - [27/Dec/2019:21:31:14 +0000] "GET /ocs/v2.php/apps/notifications/api/v2/notifications HTTP/2.0" 200 593 "https://site.name/apps/files/?dir=/&fileid=709" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:31:14 +0000] "GET /csrftoken HTTP/2.0" 200 143 "https://site.name/apps/files/?dir=/&fileid=709" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:31:15 +0000] "GET /ocs/v2.php/apps/notifications/api/v2/notifications HTTP/2.0" 200 163 "https://site.name/apps/files/?dir=/&fileid=709" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:31:16 +0000] "GET /apps/files/?dir=/&fileid=709 HTTP/2.0" 303 102 "-" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:31:16 +0000] "GET /apps/files/?dir=/ HTTP/2.0" 200 8379 "-" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:31:16 +0000] "GET /apps/accessibility/js/accessibility?v=0 HTTP/2.0" 200 207 "https://site.name/apps/files/?dir=/" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:31:16 +0000] "GET /css/icons/icons-vars.css?v=1577477979 HTTP/2.0" 200 27805 "https://site.name/apps/files/?dir=/" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:31:16 +0000] "GET /apps/theming/js/theming?v=2 HTTP/2.0" 200 431 "https://site.name/apps/files/?dir=/" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:31:16 +0000] "GET /avatar/94812DDD-A769-411D-A56C-49B1534AE412/64?v=1 HTTP/2.0" 304 98 "https://site.name/apps/files/?dir=/" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:31:16 +0000] "GET /ocs/v2.php/apps/notifications/api/v2/notifications HTTP/2.0" 200 140 "https://site.name/apps/files/?dir=/" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:31:17 +0000] "GET /ocs/v2.php/core/whatsnew?format=json HTTP/2.0" 204 57 "https://site.name/apps/files/?dir=/" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:31:17 +0000] "GET /apps/encryption/ajax/getStatus HTTP/2.0" 200 340 "https://site.name/apps/files/?dir=/" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:31:17 +0000] "GET /avatar/94812DDD-A769-411D-A56C-49B1534AE412/88?v=1 HTTP/2.0" 304 76 "https://site.name/apps/files/?dir=/" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:31:17 +0000] "PROPFIND /remote.php/dav/files/94812DDD-A769-411D-A56C-49B1534AE412/ HTTP/2.0" 207 5532 "https://site.name/apps/files/?dir=/" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:31:17 +0000] "GET /index.php/apps/files/ajax/getstoragestats.php?dir=%2F HTTP/2.0" 200 393 "https://site.name/apps/files/?dir=/" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:31:18 +0000] "GET /apps/theming/manifest?v=2 HTTP/2.0" 200 1112 "https://site.name/apps/files/?dir=/" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:31:46 +0000] "GET /ocs/v2.php/apps/notifications/api/v2/notifications HTTP/2.0" 200 163 "https://site.name/apps/files/?dir=/&fileid=709" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:32:16 +0000] "GET /ocs/v2.php/apps/notifications/api/v2/notifications HTTP/2.0" 200 163 "https://site.name/apps/files/?dir=/&fileid=709" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:32:47 +0000] "GET /ocs/v2.php/apps/notifications/api/v2/notifications HTTP/2.0" 200 163 "https://site.name/apps/files/?dir=/&fileid=709" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:33:17 +0000] "GET /ocs/v2.php/apps/notifications/api/v2/notifications HTTP/2.0" 200 163 "https://site.name/apps/files/?dir=/&fileid=709" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:33:47 +0000] "GET /ocs/v2.php/apps/notifications/api/v2/notifications HTTP/2.0" 200 163 "https://site.name/apps/files/?dir=/&fileid=709" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:34:17 +0000] "GET /ocs/v2.php/apps/notifications/api/v2/notifications HTTP/2.0" 200 163 "https://site.name/apps/files/?dir=/&fileid=709" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:34:46 +0000] "GET /ocs/v2.php/apps/notifications/api/v2/notifications HTTP/2.0" 200 559 "https://site.name/apps/files/?dir=/&fileid=709" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:31:22 +0000] "GET /remote.php/webdav/VMware-VIM-all-6.5.0-7312210.iso HTTP/2.0" 200 1109234376 "https://site.name/apps/files/?dir=/&fileid=709" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:35:17 +0000] "GET /ocs/v2.php/apps/notifications/api/v2/notifications HTTP/2.0" 200 593 "https://site.name/apps/files/?dir=/&fileid=709" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:35:47 +0000] "GET /ocs/v2.php/apps/notifications/api/v2/notifications HTTP/2.0" 200 593 "https://site.name/apps/files/?dir=/&fileid=709" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"
x.x.x.x - - [27/Dec/2019:21:36:30 +0000] "GET /ocs/v2.php/apps/notifications/api/v2/notifications HTTP/2.0" 200 593 "https://site.name/apps/files/?dir=/&fileid=709" "Mozilla/5.0 (Linux; Android 10.0; Redmi K20 Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36"

Any ideas?

Today I try to download 6,9Gb file size from nextcloud, after 2-3 min waiting I see 404 on my browser page and can not open Web UI my nextcloud more than 3 hours. I’m not restarted server and just wait. In journals isee a lot errors:
Error while sending QUERY packet. PID=16646 at /var/www/html/nextcloud/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Driver/PDOConnection.php#88

Updated to latest 17.0.3 stable. The problem still remains.