NC28: Activity and Logging apps broken

Nextcloud version : 28.0.1
Operating system: CentOS 7
Nginx: 1.20.1 with php-fpm handling PHP
PHP: 8.3
Browsers: Chrome 120, Safari 16.6.1 on macOS 11, NextCloud app on iOS 17

When I click on the lightning bolt icon for the activity app, I get a blank page. In the Safari web inspector, I see that there is a 404 error returned for the URI /apps/activity/js/activity-app.mjs?v=ff933d74-9 and a series of subsequent JavaScript files. The page shows no indication of trouble.

This system has just been through a rapid series of updates starting from v21. That included a substantial cleanup of obsolete users and moving the few remaining users off LDAP (which was not worth the hassle.)

The Logging app is also broken, so I cannot see any logs through the web UI.

The nextcloud.log and audit.log from NC have no entries for the times of the web hits on Activity.

The nginx access.log for one attempt at using the Activity app follows. I did not find it illuminating:

67.149.19.2 - - [03/Jan/2024:20:28:37 +0000] "PUT /ocs/v2.php/apps/user_status/api/v1/heartbeat?format=json HTTP/2.0" 200 149 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:45 +0000] "GET /apps/activity/ HTTP/2.0" 200 13618 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:45 +0000] "GET /apps/theming/theme/light.css?plain=1&v=370b9845 HTTP/2.0" 200 3316 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:45 +0000] "GET /apps/theming/theme/default.css?plain=1&v=370b9845 HTTP/2.0" 200 3316 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:45 +0000] "GET /apps/theming/theme/light-highcontrast.css?plain=1&v=370b9845 HTTP/2.0" 200 3389 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:45 +0000] "GET /apps/theming/manifest/activity?v=370b9845 HTTP/2.0" 200 321 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:45 +0000] "GET /js/core/merged-template-prepend.js?v=ff933d74-9 HTTP/2.0" 200 3119 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:45 +0000] "GET /apps/theming/theme/dark-highcontrast.css?plain=0&v=370b9845 HTTP/2.0" 200 3808 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:45 +0000] "GET /apps/theming/theme/light-highcontrast.css?plain=0&v=370b9845 HTTP/2.0" 200 3748 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:45 +0000] "GET /apps/theming/theme/dark.css?plain=0&v=370b9845 HTTP/2.0" 200 3442 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:45 +0000] "GET /apps/theming/theme/light.css?plain=0&v=370b9845 HTTP/2.0" 200 3498 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:45 +0000] "GET /apps/theming/theme/opendyslexic.css?plain=0&v=370b9845 HTTP/2.0" 200 890 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "GET /apps/activity/js/activity-app.mjs?v=ff933d74-9 HTTP/2.0" 404 153 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "GET /dist/core-common.js.map?v=f87ac2bbc532cb1b600c HTTP/2.0" 404 153 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "GET /core/css/server.css.map HTTP/2.0" 404 153 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "GET /apps/user_status/css/user-status-menu.css.map HTTP/2.0" 404 153 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "GET /apps/terms_of_service/terms HTTP/2.0" 200 1649 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "GET /dist/core-files_fileinfo.js.map?v=d5860a22750b08465c62 HTTP/2.0" 404 153 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "GET /ocs/v2.php/search/providers?from=%2Fapps%2Factivity%2F HTTP/2.0" 200 586 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "POST /contactsmenu/contacts HTTP/2.0" 200 674 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "GET /dist/core-main.js.map?v=92d270bdbf4adbcb7df5 HTTP/2.0" 404 153 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "GET /dist/core-files_client.js.map?v=b3b3cb55670bd3d7f7f4 HTTP/2.0" 404 153 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "GET /ocs/v2.php/apps/user_status/api/v1/user_status HTTP/2.0" 200 149 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "GET /apps/theming/image/logo?v=9 HTTP/2.0" 200 143235 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "GET /apps/files_pdfviewer/js/files_pdfviewer-main.js.map?v=bea510332097b3f42f45 HTTP/2.0" 404 153 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "PUT /ocs/v2.php/apps/user_status/api/v1/heartbeat?format=json HTTP/2.0" 200 149 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "GET /apps/viewer/js/viewer-main.js.map?v=b5e63aa1b743efe538fd HTTP/2.0" 404 153 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "GET /dist/files-reference-files.js.map?v=d602d5e54c19a86c30be HTTP/2.0" 404 153 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "GET /ocs/v2.php/apps/notifications/api/v2/notifications HTTP/2.0" 200 81 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "GET /apps/text/js/text-editors.js.map?v=29e4ca498f2482910796 HTTP/2.0" 404 153 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "GET /dist/core-unsupported-browser-redirect.js.map?v=2b0e3c1ba4874f506bf1 HTTP/2.0" 404 153 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "GET /apps/text/js/text-viewer.js.map?v=dc556b9eb9a968a36c58 HTTP/2.0" 404 153 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "GET /apps/deck/js/deck-reference.js.map?v=138927f875c68a7aae82 HTTP/2.0" 404 153 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "GET /index.php/apps/files/preview-service-worker.js HTTP/2.0" 200 14649 "" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "GET /dist/core-global-search.js.map?v=d0c01f43edd4587c6206 HTTP/2.0" 404 153 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "GET /apps/notifications/js/notifications-main.js.map?v=20c8da00b4a44818b764 HTTP/2.0" 404 153 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "GET /dist/files_sharing-main.js.map?v=1bbf90b4b4aba9ea0150 HTTP/2.0" 404 153 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:46 +0000] "GET /apps/notifications/js/notifications-vendors-node_modules_nextcloud_moment_dist_index_js-node_modules_nextcloud_notify_push_dist_i-4dbea9.js.map?v=b141ed2d7528012cbb78 HTTP/2.0" 404 153 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:47 +0000] "GET /avatar/admin/512?v=2 HTTP/2.0" 200 3391 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:47 +0000] "GET /dist/user_status-menu.js.map?v=26a845c4f16beda58020 HTTP/2.0" 404 153 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:47 +0000] "GET /apps/notifications/js/notifications-node_modules_moment_locale_sync_recursive_-src_NotificationsApp_vue-data_image_svg_xml_base64-ab95a3.js.map?v=6f802546411c010925f2 HTTP/2.0" 404 153 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:47 +0000] "GET /apps/terms_of_service/js/terms_of_service-user.js.map?v=0ca1b09ede6c7cbdfbd1 HTTP/2.0" 404 153 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:47 +0000] "GET /apps/notifications/js/notifications-vendors-node_modules_core-js_internals_array-iteration_js-node_modules_core-js_internals_arra-46f851.js.map?v=c626665dd1b77f5b29ca HTTP/2.0" 404 153 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:47 +0000] "GET /apps/theming/theme/dark.css?plain=1&v=370b9845 HTTP/2.0" 200 3261 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:47 +0000] "GET /apps/theming/theme/dark-highcontrast.css?plain=1&v=370b9845 HTTP/2.0" 200 3432 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:47 +0000] "GET /dist/7816-7816.js.map?v=a61178997c93b13df85e HTTP/2.0" 404 153 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:28:47 +0000] "GET /avatar/admin/64?v=2 HTTP/2.0" 200 611 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6.1 Safari/605.1.15"
67.149.19.2 - - [03/Jan/2024:20:29:16 +0000] "GET /ocs/v2.php/apps/notifications/api/v2/notifications HTTP/2.0" 304 0 "https://REDACTHOST/apps/activity/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7

The php-fpm log(s) show nothing.

I am at a loss for where else to look or how to make NC more verbose about what it isn’t doing.

My config.php:

<?php
$CONFIG = array (
  'instanceid' => 'REDACT',
  'passwordsalt' => 'REDACT',
  'secret' => 'REDACT',
  'trusted_domains' => 
  array (
    0 => 'REDACT',
  ),
  'datadirectory' => '/store/data',
  'overwrite.cli.url' => 'https://share.REDACT',
  'dbtype' => 'mysql',
  'version' => '28.0.1.1',
  'dbname' => 'nextcloud',
  'dbhost' => 'localhost',
  'dbport' => '',
  'dbtableprefix' => 'oc_',
  'dbuser' => 'nextcloud',
  'dbpassword' => 'REDACT',
  'default_phone_region' => 'us',
  'logtimezone' => 'UTC',
  'installed' => true,
  'filelocking.enabled' => true,
  'memcache.locking' => '\\OC\\Memcache\\Redis',
  'redis' => 
  array (
    'host' => '127.0.0.1',
    'port' => 6379,
    'timeout' => 0.0,
    'password' => '',
  ),
  'updater.release.channel' => 'stable',
  'singleuser' => false,
  'mail_smtpmode' => 'smtp',
  'mail_from_address' => 'do-not-reply',
  'mail_domain' => 'REDACT',
  'mail_smtphost' => 'REDACT',
  'mail_smtpport' => '587',
  'mail_smtpsecure' => 'tls',
  'mail_smtpauthtype' => 'PLAIN',
  'mail_smtpauth' => 1,
  'mail_smtpname' => 'REDACT',
  'mail_smtppassword' => 'REDACT',
  'maintenance' => false,
  'loglevel' => '1',
  'theme' => '',
  'mysql.utf8mb4' => true,
  'encryption.key_storage_migrated' => false,
  'mail_sendmailmode' => 'smtp',
);

Please review the latest Admin Manual (https://docs.nextcloud.com)

It appears you may have overlooked the web server configuration changes required to support .mjs files starting with NC27.