Hi guys
My server frozed last Thursday night and i have to reboot it manually.
All is up and running except Nextcloud (admin interface is ok) !
I’m running unRAID with the NCP’s docker (already made a post there but no response )
unRAID log :
Starting Redis
Starting Cron
Starting Postfix
ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (111)
/run-parts.sh: line 47: /etc/services-enabled.d/services-enabled.d: Is a directory
e
/run-parts.sh: line 6: /etc/services-enabled.d/services-enabled.d: Is a directory
stopping Cron...
stopping Redis...
stopping Postfix...
stopping HPB...
notify_push: no process found
Stopping apache
Stopping PHP-fpm
Stopping mariaDB
stopping Cron...
stopping Redis...
stopping Postfix...
stopping HPB...
notify_push: no process found
Stopping apache
Stopping PHP-fpm
Stopping mariaDB
mysqladmin: connect to server at 'localhost' failed
error: 'Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (111)'
Check that mysqld is running and that the socket: '/var/run/mysqld/mysqld.sock' exists!
This file do exist :
MySQL error log :
[Warning] The parameter innodb_file_format is deprecated and has no effect. It may be removed in future releases. See https://mariadb.com/kb/en/library/xtradbinnodb-file-format/
2021-10-16 10:23:28 0 [Note] InnoDB: Using Linux native AIO
2021-10-16 10:23:28 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
2021-10-16 10:23:28 0 [Note] InnoDB: Uses event mutexes
2021-10-16 10:23:28 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2021-10-16 10:23:28 0 [Note] InnoDB: Number of pools: 1
2021-10-16 10:23:28 0 [Note] InnoDB: Using SSE2 crc32 instructions
2021-10-16 10:23:28 0 [Note] InnoDB: Initializing buffer pool, total size = 256M, instances = 1, chunk size = 128M
2021-10-16 10:23:28 0 [Note] InnoDB: Completed initialization of buffer pool
2021-10-16 10:23:28 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
2021-10-16 10:23:28 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=14054915147
2021-10-16 10:23:28 0 [Note] InnoDB: 128 out of 128 rollback segments are active.
2021-10-16 10:23:28 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
2021-10-16 10:23:28 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2021-10-16 10:23:28 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
2021-10-16 10:23:28 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
2021-10-16 10:23:28 0x1525cac94700 InnoDB: Assertion failure in file /build/mariadb-10.3-XTU5dn/mariadb-10.3-10.3.29/storage/innobase/include/fut0lst.ic line 85
InnoDB: Failing assertion: addr.page == FIL_NULL || addr.boffset >= FIL_PAGE_DATA
InnoDB: We intentionally generate a memory trap.
InnoDB: Submit a detailed bug report to https://jira.mariadb.org/
InnoDB: If you get repeated assertion failures or crashes, even
InnoDB: immediately after the mysqld startup, there may be
InnoDB: corruption in the InnoDB tablespace. Please refer to
InnoDB: https://mariadb.com/kb/en/library/innodb-recovery-modes/
InnoDB: about forcing recovery.
211016 10:23:28 [ERROR] mysqld got signal 6 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
2021-10-16 10:23:28 0 [Note] InnoDB: 10.3.29 started; log sequence number 14054915200; transaction id 26904017
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
We will try our best to scrape up some info that will hopefully help
diagnose the problem, but since we have already crashed,
something is definitely wrong and this may fail.
Server version: 10.3.29-MariaDB-0+deb10u1
key_buffer_size=134217728
read_buffer_size=131072
max_used_connections=0
max_threads=153
thread_count=1
It is possible that mysqld could use up to
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 467429 K bytes of memory
Hope that's ok; if not, decrease some variables in the equation.
Thread pointer: 0x1525b4000c08
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 0x1525cac93d58 thread_stack 0x49000
2021-10-16 10:23:28 0 [Note] Plugin 'FEEDBACK' is disabled.
2021-10-16 10:23:28 0 [Note] Recovering after a crash using tc.log
2021-10-16 10:23:28 0 [Note] InnoDB: Loading buffer pool(s) from /data/database/ib_buffer_pool
2021-10-16 10:23:28 0 [Note] Starting crash recovery...
2021-10-16 10:23:28 0 [Note] Crash recovery finished.
mysqld(my_print_stacktrace+0x2e)[0x559fc83ad31e]
mysqld(handle_fatal_signal+0x54d)[0x559fc7ed857d]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x12730)[0x1525fa84e730]
/lib/x86_64-linux-gnu/libc.so.6(gsignal+0x10b)[0x1525fa6b27bb]
/lib/x86_64-linux-gnu/libc.so.6(abort+0x121)[0x1525fa69d535]
2021-10-16 10:23:28 0 [Note] Server socket created on IP: '127.0.0.1'.
mysqld(+0x4e92f9)[0x559fc7c1a2f9]
mysqld(+0x4e5ffa)[0x559fc7c16ffa]
mysqld(+0xa15865)[0x559fc8146865]
mysqld(+0xa162f4)[0x559fc81472f4]
mysqld(+0xa022d8)[0x559fc81332d8]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x7fa3)[0x1525fa843fa3]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x3f)[0x1525fa7744cf]
Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (0x0): (null)
Connection ID (thread ID): 1
Status: NOT_KILLED
Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on
The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains
information that should help you find out what is causing the crash.
We think the query pointer is invalid, but we will try to print it anyway.
Query:
Writing a core file...
Working directory at /data/database
Resource Limits:
Limit Soft Limit Hard Limit Units
Max cpu time unlimited unlimited seconds
Max file size unlimited unlimited bytes
Max data size unlimited unlimited bytes
Max stack size unlimited unlimited bytes
Max core file size 0 0 bytes
Max resident set unlimited unlimited bytes
Max processes 256163 256163 processes
Max open files 40960 40960 files
Max locked memory unlimited unlimited bytes
Max address space unlimited unlimited bytes
Max file locks unlimited unlimited locks
Max pending signals 256163 256163 signals
Max msgqueue size 819200 819200 bytes
Max nice priority 0 0
Max realtime priority 0 0
Max realtime timeout unlimited unlimited us
Core pattern: core
#
Already tried :
- Delete and rebuild the container as well as the docker’s image - No success
- Copy the nextcloud dir to a new docker - Successfully recovered Nextcloud settings (with littles exceptions, like MFA), but no DB~~
MySQL won’t start, so cannot use mysqldump
Is there a kind soul to help me pretty please ?
Do no hesitate to ask if you need more details