Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SIGABRT malloc(): unaligned tcache chunk detected and corrupted double-linked list #798

Open
magnetik opened this issue May 17, 2024 · 13 comments
Labels
bug Something isn't working

Comments

@magnetik
Copy link

magnetik commented May 17, 2024

What happened?

Hi,

I'm deploying a PHP 8.3 symfony (7.0) app on AWS ECS (with Fargate).

I'm running it in worker mode with the base image dunglas/frankenphp:1.1-php8.3.7.

Every few hours I have error malloc(): unaligned tcache chunk detected and more rarely corrupted double-linked list.
No other error logs, but it seems that the app becomes unresponsive and the ECS Task is shutdown and restarted.

When opening an issue I've just seen Before submitting a bug, please double-check that your problem is not a known issue (especially if you use XDebug or Tideways

Tideways extension is not listed anymore in the known issues (https://frankenphp.dev/docs/known-issues/). I'm loading this extension. Can this be a problem? (I'm currently running another test without it)
[edit] I've removed tideways and still have errors

Thanks.

Build Type

Docker (Debian Bookworm)

Worker Mode

Yes

Operating System

GNU/Linux

CPU Architecture

x86_64

PHP configuration

phpinfo()
PHP Version => 8.3.7

System => Linux 8008d65bb95f 5.15.0-58-generic #64-Ubuntu SMP Thu Jan 5 11:43:13 UTC 2023 x86_64
Build Date => May 10 2024 21:41:15
Build System => Linux - Docker
Build Provider => https://github.com/docker-library/php
Configure Command =>  './configure'  '--build=x86_64-linux-gnu' '--with-config-file-path=/usr/local/etc/php' '--with-config-file-scan-dir=/usr/local/etc/php/conf.d' '--enable-option-checking=fatal' '--with-mhash' '--with-pic' '--enable-mbstring' '--enable-mysqlnd' '--with-password-argon2' '--with-sodium=shared' '--with-pdo-sqlite=/usr' '--with-sqlite3=/usr' '--with-curl' '--with-iconv' '--with-openssl' '--with-readline' '--with-zlib' '--enable-phpdbg' '--enable-phpdbg-readline' '--with-pear' '--with-libdir=lib/x86_64-linux-gnu' '--enable-embed' '--enable-zts' '--disable-zend-signals' 'build_alias=x86_64-linux-gnu'
Server API => Command Line Interface
Virtual Directory Support => enabled
Configuration File (php.ini) Path => /usr/local/etc/php
Loaded Configuration File => /usr/local/etc/php/php.ini
Scan this dir for additional .ini files => /usr/local/etc/php/conf.d
Additional .ini files parsed => /usr/local/etc/php/conf.d/docker-php-ext-apcu.ini,
/usr/local/etc/php/conf.d/docker-php-ext-gd.ini,
/usr/local/etc/php/conf.d/docker-php-ext-igbinary.ini,
/usr/local/etc/php/conf.d/docker-php-ext-intl.ini,
/usr/local/etc/php/conf.d/docker-php-ext-opcache.ini,
/usr/local/etc/php/conf.d/docker-php-ext-pcntl.ini,
/usr/local/etc/php/conf.d/docker-php-ext-pdo_mysql.ini,
/usr/local/etc/php/conf.d/docker-php-ext-redis.ini,
/usr/local/etc/php/conf.d/docker-php-ext-sockets.ini,
/usr/local/etc/php/conf.d/docker-php-ext-sodium.ini,
/usr/local/etc/php/conf.d/docker-php-ext-zip.ini,
/usr/local/etc/php/conf.d/nadeo-live.ini,
/usr/local/etc/php/conf.d/xx-php-ext-memcached.ini

PHP API => 20230831
PHP Extension => 20230831
Zend Extension => 420230831
Zend Extension Build => API420230831,TS
PHP Extension Build => API20230831,TS
Debug Build => no
Thread Safety => enabled
Thread API => POSIX Threads
Zend Signal Handling => disabled
Zend Memory Manager => enabled
Zend Multibyte Support => provided by mbstring
Zend Max Execution Timers => enabled
IPv6 Support => enabled
DTrace Support => disabled

Registered PHP Streams => https, ftps, compress.zlib, php, file, glob, data, http, ftp, phar, zip
Registered Stream Socket Transports => tcp, udp, unix, udg, ssl, tls, tlsv1.0, tlsv1.1, tlsv1.2, tlsv1.3
Registered Stream Filters => zlib.*, convert.iconv.*, string.rot13, string.toupper, string.tolower, convert.*, consumed, dechunk

This program makes use of the Zend Scripting Language Engine:
Zend Engine v4.3.7, Copyright (c) Zend Technologies
    with Zend OPcache v8.3.7, Copyright (c), by Zend Technologies


 _______________________________________________________________________


Configuration

apcu

APCu Support => Enabled
Version => 5.1.23
APCu Debugging => Disabled
MMAP Support => Enabled
MMAP File Mask =>
Serialization Support => php, igbinary
Build Date => May 17 2024 08:18:39

Directive => Local Value => Master Value
apc.coredump_unmap => Off => Off
apc.enable_cli => On => On
apc.enabled => On => On
apc.entries_hint => 4096 => 4096
apc.gc_ttl => 3600 => 3600
apc.mmap_file_mask => no value => no value
apc.preload_path => no value => no value
apc.serializer => php => php
apc.shm_segments => 1 => 1
apc.shm_size => 32M => 32M
apc.slam_defense => Off => Off
apc.smart => 0 => 0
apc.ttl => 0 => 0
apc.use_request_time => Off => Off

Core

PHP Version => 8.3.7

Directive => Local Value => Master Value
allow_url_fopen => On => On
allow_url_include => Off => Off
arg_separator.input => & => &
arg_separator.output => & => &
auto_append_file => no value => no value
auto_globals_jit => On => On
auto_prepend_file => no value => no value
browscap => no value => no value
default_charset => UTF-8 => UTF-8
default_mimetype => text/html => text/html
disable_classes => no value => no value
disable_functions => no value => no value
display_errors => Off => Off
display_startup_errors => Off => Off
doc_root => no value => no value
docref_ext => no value => no value
docref_root => no value => no value
enable_dl => Off => Off
enable_post_data_reading => On => On
error_append_string => no value => no value
error_log => no value => no value
error_log_mode => 0644 => 0644
error_prepend_string => no value => no value
error_reporting => 22527 => 22527
expose_php => Off => Off
extension_dir => /usr/local/lib/php/extensions/no-debug-zts-20230831 => /usr/local/lib/php/extensions/no-debug-zts-20230831
fiber.stack_size => no value => no value
file_uploads => On => On
hard_timeout => 2 => 2
highlight.comment => <font style="color: #FF8000">#FF8000</font> => <font style="color: #FF8000">#FF8000</font>
highlight.default => <font style="color: #0000BB">#0000BB</font> => <font style="color: #0000BB">#0000BB</font>
highlight.html => <font style="color: #000000">#000000</font> => <font style="color: #000000">#000000</font>
highlight.keyword => <font style="color: #007700">#007700</font> => <font style="color: #007700">#007700</font>
highlight.string => <font style="color: #DD0000">#DD0000</font> => <font style="color: #DD0000">#DD0000</font>
html_errors => Off => Off
ignore_repeated_errors => Off => Off
ignore_repeated_source => Off => Off
ignore_user_abort => Off => Off
implicit_flush => On => On
include_path => .:/usr/local/lib/php => .:/usr/local/lib/php
input_encoding => no value => no value
internal_encoding => no value => no value
log_errors => On => On
mail.add_x_header => Off => Off
mail.force_extra_parameters => no value => no value
mail.log => no value => no value
mail.mixed_lf_and_crlf => Off => Off
max_execution_time => 0 => 0
max_file_uploads => 20 => 20
max_input_nesting_level => 64 => 64
max_input_time => -1 => -1
max_input_vars => 1000 => 1000
max_multipart_body_parts => -1 => -1
memory_limit => -1 => -1
open_basedir => no value => no value
output_buffering => 0 => 0
output_encoding => no value => no value
output_handler => no value => no value
post_max_size => 25M => 25M
precision => 14 => 14
realpath_cache_size => 4096K => 4096K
realpath_cache_ttl => 600 => 600
register_argc_argv => On => On
report_memleaks => On => On
report_zend_debug => Off => Off
request_order => GP => GP
sendmail_from => no value => no value
sendmail_path => /usr/sbin/sendmail -t -i => /usr/sbin/sendmail -t -i
serialize_precision => -1 => -1
short_open_tag => Off => Off
SMTP => localhost => localhost
smtp_port => 25 => 25
sys_temp_dir => no value => no value
syslog.facility => LOG_USER => LOG_USER
syslog.filter => no-ctrl => no-ctrl
syslog.ident => php => php
unserialize_callback_func => no value => no value
upload_max_filesize => 25M => 25M
upload_tmp_dir => no value => no value
user_dir => no value => no value
user_ini.cache_ttl => 300 => 300
user_ini.filename => .user.ini => .user.ini
variables_order => GPCS => GPCS
xmlrpc_error_number => 0 => 0
xmlrpc_errors => Off => Off
zend.assertions => -1 => -1
zend.detect_unicode => On => On
zend.enable_gc => On => On
zend.exception_ignore_args => On => On
zend.exception_string_param_max_len => 0 => 0
zend.max_allowed_stack_size => 0 => 0
zend.multibyte => Off => Off
zend.reserved_stack_size => 0 => 0
zend.script_encoding => no value => no value

ctype

ctype functions => enabled

curl

cURL support => enabled
cURL Information => 7.88.1
Age => 10
Features
AsynchDNS => Yes
CharConv => No
Debug => No
GSS-Negotiate => No
IDN => Yes
IPv6 => Yes
krb4 => No
Largefile => Yes
libz => Yes
NTLM => Yes
NTLMWB => Yes
SPNEGO => Yes
SSL => Yes
SSPI => No
TLS-SRP => Yes
HTTP2 => Yes
GSSAPI => Yes
KERBEROS5 => Yes
UNIX_SOCKETS => Yes
PSL => Yes
HTTPS_PROXY => Yes
MULTI_SSL => No
BROTLI => Yes
ALTSVC => Yes
HTTP3 => No
UNICODE => No
ZSTD => Yes
HSTS => Yes
GSASL => No
Protocols => dict, file, ftp, ftps, gopher, gophers, http, https, imap, imaps, ldap, ldaps, mqtt, pop3, pop3s, rtmp, rtmpe, rtmps, rtmpt, rtmpte, rtmpts, rtsp, scp, sftp, smb, smbs, smtp, smtps, telnet, tftp
Host => x86_64-pc-linux-gnu
SSL Version => OpenSSL/3.0.11
ZLib Version => 1.2.13
libSSH Version => libssh2/1.10.0

Directive => Local Value => Master Value
curl.cainfo => no value => no value

date

date/time support => enabled
timelib version => 2022.10
"Olson" Timezone Database Version => 2024.1
Timezone Database => internal
Default timezone => UTC

Directive => Local Value => Master Value
date.default_latitude => 31.7667 => 31.7667
date.default_longitude => 35.2333 => 35.2333
date.sunrise_zenith => 90.833333 => 90.833333
date.sunset_zenith => 90.833333 => 90.833333
date.timezone => UTC => UTC

dom

DOM/XML => enabled
DOM/XML API Version => 20031129
libxml Version => 2.9.14
HTML Support => enabled
XPath Support => enabled
XPointer Support => enabled
Schema Support => enabled
RelaxNG Support => enabled

fileinfo

fileinfo support => enabled
libmagic => 543

filter

Input Validation and Filtering => enabled

Directive => Local Value => Master Value
filter.default => unsafe_raw => unsafe_raw
filter.default_flags => no value => no value

gd

GD Support => enabled
GD Version => bundled (2.1.0 compatible)
FreeType Support => enabled
FreeType Linkage => with freetype
FreeType Version => 2.12.1
GIF Read Support => enabled
GIF Create Support => enabled
JPEG Support => enabled
libJPEG Version => 6b
PNG Support => enabled
libPNG Version => 1.6.39
WBMP Support => enabled
XPM Support => enabled
libXpm Version => 30411
XBM Support => enabled
WebP Support => enabled
BMP Support => enabled
AVIF Support => enabled
TGA Read Support => enabled

Directive => Local Value => Master Value
gd.jpeg_ignore_warning => On => On

hash

hash support => enabled
Hashing Engines => md2 md4 md5 sha1 sha224 sha256 sha384 sha512/224 sha512/256 sha512 sha3-224 sha3-256 sha3-384 sha3-512 ripemd128 ripemd160 ripemd256 ripemd320 whirlpool tiger128,3 tiger160,3 tiger192,3 tiger128,4 tiger160,4 tiger192,4 snefru snefru256 gost gost-crypto adler32 crc32 crc32b crc32c fnv132 fnv1a32 fnv164 fnv1a64 joaat murmur3a murmur3c murmur3f xxh32 xxh64 xxh3 xxh128 haval128,3 haval160,3 haval192,3 haval224,3 haval256,3 haval128,4 haval160,4 haval192,4 haval224,4 haval256,4 haval128,5 haval160,5 haval192,5 haval224,5 haval256,5

MHASH support => Enabled
MHASH API Version => Emulated Support

iconv

iconv support => enabled
iconv implementation => glibc
iconv library version => 2.36

Directive => Local Value => Master Value
iconv.input_encoding => no value => no value
iconv.internal_encoding => no value => no value
iconv.output_encoding => no value => no value

igbinary

igbinary support => enabled
igbinary version => 3.2.15
igbinary APCu serializer ABI => 0
igbinary session support => yes

Directive => Local Value => Master Value
igbinary.compact_strings => On => On

intl

Internationalization support => enabled
ICU version => 72.1
ICU Data version => 72.1
ICU TZData version => 2022e
ICU Unicode version => 15.0

Directive => Local Value => Master Value
intl.default_locale => no value => no value
intl.error_level => 0 => 0
intl.use_exceptions => Off => Off

json

json support => enabled

libxml

libXML support => active
libXML Compiled Version => 2.9.14
libXML Loaded Version => 20914
libXML streams => enabled

mbstring

Multibyte Support => enabled
Multibyte string engine => libmbfl
HTTP input encoding translation => disabled
libmbfl version => 1.3.2

mbstring extension makes use of "streamable kanji code filter and converter", which is distributed under the GNU Lesser General Public License version 2.1.

Multibyte (japanese) regex support => enabled
Multibyte regex (oniguruma) version => 6.9.8

Directive => Local Value => Master Value
mbstring.detect_order => no value => no value
mbstring.encoding_translation => Off => Off
mbstring.http_input => no value => no value
mbstring.http_output => no value => no value
mbstring.http_output_conv_mimetypes => ^(text/|application/xhtml\+xml) => ^(text/|application/xhtml\+xml)
mbstring.internal_encoding => no value => no value
mbstring.language => neutral => neutral
mbstring.regex_retry_limit => 1000000 => 1000000
mbstring.regex_stack_limit => 100000 => 100000
mbstring.strict_detection => Off => Off
mbstring.substitute_character => no value => no value

memcached

memcached support => enabled
Version => 3.2.0
libmemcached-awesome version => 1.1.4
SASL support => yes
Session support => yes
igbinary support => yes
json support => yes
msgpack support => no

Directive => Local Value => Master Value
memcached.compression_factor => 1.3 => 1.3
memcached.compression_threshold => 2000 => 2000
memcached.compression_type => fastlz => fastlz
memcached.default_binary_protocol => Off => Off
memcached.default_connect_timeout => 0 => 0
memcached.default_consistent_hash => Off => Off
memcached.serializer => igbinary => igbinary
memcached.sess_binary_protocol => On => On
memcached.sess_connect_timeout => 0 => 0
memcached.sess_consistent_hash => On => On
memcached.sess_consistent_hash_type => ketama => ketama
memcached.sess_lock_expire => 0 => 0
memcached.sess_lock_max_wait => not set => not set
memcached.sess_lock_retries => 5 => 5
memcached.sess_lock_wait => not set => not set
memcached.sess_lock_wait_max => 150 => 150
memcached.sess_lock_wait_min => 150 => 150
memcached.sess_locking => On => On
memcached.sess_number_of_replicas => 0 => 0
memcached.sess_persistent => Off => Off
memcached.sess_prefix => memc.sess.key. => memc.sess.key.
memcached.sess_randomize_replica_read => Off => Off
memcached.sess_remove_failed_servers => Off => Off
memcached.sess_sasl_password => no value => no value
memcached.sess_sasl_username => no value => no value
memcached.sess_server_failure_limit => 0 => 0
memcached.store_retry_count => 0 => 0

mysqlnd

mysqlnd => enabled
Version => mysqlnd 8.3.7
Compression => supported
core SSL => supported
extended SSL => supported
Command buffer size => 4096
Read buffer size => 32768
Read timeout => 86400
Collecting statistics => Yes
Collecting memory statistics => No
Tracing => n/a
Loaded plugins => mysqlnd,debug_trace,auth_plugin_mysql_native_password,auth_plugin_mysql_clear_password,auth_plugin_caching_sha2_password,auth_plugin_sha256_password
API Extensions => pdo_mysql

openssl

OpenSSL support => enabled
OpenSSL Library Version => OpenSSL 3.0.11 19 Sep 2023
OpenSSL Header Version => OpenSSL 3.0.11 19 Sep 2023
Openssl default config => /usr/lib/ssl/openssl.cnf

Directive => Local Value => Master Value
openssl.cafile => no value => no value
openssl.capath => no value => no value

pcntl

pcntl support => enabled

pcre

PCRE (Perl Compatible Regular Expressions) Support => enabled
PCRE Library Version => 10.42 2022-12-12
PCRE Unicode Version => 14.0.0
PCRE JIT Support => enabled
PCRE JIT Target => x86 64bit (little endian + unaligned)

Directive => Local Value => Master Value
pcre.backtrack_limit => 1000000 => 1000000
pcre.jit => On => On
pcre.recursion_limit => 100000 => 100000

PDO

PDO support => enabled
PDO drivers => sqlite, mysql

pdo_mysql

PDO Driver for MySQL => enabled
Client API version => mysqlnd 8.3.7

Directive => Local Value => Master Value
pdo_mysql.default_socket => no value => no value

pdo_sqlite

PDO Driver for SQLite 3.x => enabled
SQLite Library => 3.40.1

Phar

Phar: PHP Archive support => enabled
Phar API version => 1.1.1
Phar-based phar archives => enabled
Tar-based phar archives => enabled
ZIP-based phar archives => enabled
gzip compression => enabled
bzip2 compression => disabled (install ext/bz2)
Native OpenSSL support => enabled


Phar based on pear/PHP_Archive, original concept by Davey Shafik.
Phar fully realized by Gregory Beaver and Marcus Boerger.
Portions of tar implementation Copyright (c) 2003-2009 Tim Kientzle.
Directive => Local Value => Master Value
phar.cache_list => no value => no value
phar.readonly => On => On
phar.require_hash => On => On

posix

POSIX support => enabled

random

Version => 8.3.7

readline

Readline Support => enabled
Readline library => 8.2

Directive => Local Value => Master Value
cli.pager => no value => no value
cli.prompt => \b \>  => \b \>

redis

Redis Support => enabled
Redis Version => 6.0.2
Redis Sentinel Version => 1.0
Available serializers => php, json, igbinary
Available compression => lzf, zstd, lz4

Directive => Local Value => Master Value
redis.arrays.algorithm => no value => no value
redis.arrays.auth => no value => no value
redis.arrays.autorehash => 0 => 0
redis.arrays.connecttimeout => 0 => 0
redis.arrays.consistent => 0 => 0
redis.arrays.distributor => no value => no value
redis.arrays.functions => no value => no value
redis.arrays.hosts => no value => no value
redis.arrays.index => 0 => 0
redis.arrays.lazyconnect => 0 => 0
redis.arrays.names => no value => no value
redis.arrays.pconnect => 0 => 0
redis.arrays.previous => no value => no value
redis.arrays.readtimeout => 0 => 0
redis.arrays.retryinterval => 0 => 0
redis.clusters.auth => no value => no value
redis.clusters.cache_slots => 0 => 0
redis.clusters.persistent => 0 => 0
redis.clusters.read_timeout => 0 => 0
redis.clusters.seeds => no value => no value
redis.clusters.timeout => 0 => 0
redis.pconnect.connection_limit => 0 => 0
redis.pconnect.echo_check_liveness => 1 => 1
redis.pconnect.pool_detect_dirty => 0 => 0
redis.pconnect.pool_pattern => no value => no value
redis.pconnect.pool_poll_timeout => 0 => 0
redis.pconnect.pooling_enabled => 1 => 1
redis.session.early_refresh => 0 => 0
redis.session.lock_expire => 0 => 0
redis.session.lock_retries => 100 => 100
redis.session.lock_wait_time => 20000 => 20000
redis.session.locking_enabled => 0 => 0

Reflection

Reflection => enabled

session

Session Support => enabled
Registered save handlers => files user redis rediscluster memcached
Registered serializer handlers => php_serialize php php_binary igbinary

Directive => Local Value => Master Value
session.auto_start => Off => Off
session.cache_expire => 180 => 180
session.cache_limiter => nocache => nocache
session.cookie_domain => no value => no value
session.cookie_httponly => Off => Off
session.cookie_lifetime => 0 => 0
session.cookie_path => / => /
session.cookie_samesite => no value => no value
session.cookie_secure => Off => Off
session.gc_divisor => 1000 => 1000
session.gc_maxlifetime => 1440 => 1440
session.gc_probability => 1 => 1
session.lazy_write => On => On
session.name => PHPSESSID => PHPSESSID
session.referer_check => no value => no value
session.save_handler => files => files
session.save_path => no value => no value
session.serialize_handler => php => php
session.sid_bits_per_character => 5 => 5
session.sid_length => 26 => 26
session.upload_progress.cleanup => On => On
session.upload_progress.enabled => On => On
session.upload_progress.freq => 1% => 1%
session.upload_progress.min_freq => 1 => 1
session.upload_progress.name => PHP_SESSION_UPLOAD_PROGRESS => PHP_SESSION_UPLOAD_PROGRESS
session.upload_progress.prefix => upload_progress_ => upload_progress_
session.use_cookies => On => On
session.use_only_cookies => On => On
session.use_strict_mode => Off => Off
session.use_trans_sid => Off => Off

SimpleXML

SimpleXML support => enabled
Schema support => enabled

sockets

Sockets Support => enabled

sodium

sodium support => enabled
libsodium headers version => 1.0.18
libsodium library version => 1.0.18

SPL

SPL support => enabled
Interfaces => OuterIterator, RecursiveIterator, SeekableIterator, SplObserver, SplSubject
Classes => AppendIterator, ArrayIterator, ArrayObject, BadFunctionCallException, BadMethodCallException, CachingIterator, CallbackFilterIterator, DirectoryIterator, DomainException, EmptyIterator, FilesystemIterator, FilterIterator, GlobIterator, InfiniteIterator, InvalidArgumentException, IteratorIterator, LengthException, LimitIterator, LogicException, MultipleIterator, NoRewindIterator, OutOfBoundsException, OutOfRangeException, OverflowException, ParentIterator, RangeException, RecursiveArrayIterator, RecursiveCachingIterator, RecursiveCallbackFilterIterator, RecursiveDirectoryIterator, RecursiveFilterIterator, RecursiveIteratorIterator, RecursiveRegexIterator, RecursiveTreeIterator, RegexIterator, RuntimeException, SplDoublyLinkedList, SplFileInfo, SplFileObject, SplFixedArray, SplHeap, SplMinHeap, SplMaxHeap, SplObjectStorage, SplPriorityQueue, SplQueue, SplStack, SplTempFileObject, UnderflowException, UnexpectedValueException

sqlite3

SQLite3 support => enabled
SQLite Library => 3.40.1

Directive => Local Value => Master Value
sqlite3.defensive => On => On
sqlite3.extension_dir => no value => no value

standard

Dynamic Library Support => enabled
Path to sendmail => /usr/sbin/sendmail -t -i

Directive => Local Value => Master Value
assert.active => On => On
assert.bail => Off => Off
assert.callback => no value => no value
assert.exception => On => On
assert.warning => On => On
auto_detect_line_endings => Off => Off
default_socket_timeout => 60 => 60
from => no value => no value
session.trans_sid_hosts => no value => no value
session.trans_sid_tags => a=href,area=href,frame=src,form= => a=href,area=href,frame=src,form=
unserialize_max_depth => 4096 => 4096
url_rewriter.hosts => no value => no value
url_rewriter.tags => form= => form=
user_agent => no value => no value

tokenizer

Tokenizer Support => enabled

xml

XML Support => active
XML Namespace Support => active
libxml2 Version => 2.9.14

xmlreader

XMLReader => enabled

xmlwriter

XMLWriter => enabled

Zend OPcache

Opcode Caching => Disabled
Optimization => Disabled
SHM Cache => Enabled
File Cache => Disabled
JIT => On
Startup Failed => Opcode Caching is disabled for CLI

Directive => Local Value => Master Value
opcache.blacklist_filename => no value => no value
opcache.dups_fix => Off => Off
opcache.enable => On => On
opcache.enable_cli => Off => Off
opcache.enable_file_override => Off => Off
opcache.error_log => no value => no value
opcache.file_cache => no value => no value
opcache.file_cache_consistency_checks => On => On
opcache.file_cache_only => Off => Off
opcache.file_update_protection => 2 => 2
opcache.force_restart_timeout => 180 => 180
opcache.huge_code_pages => Off => Off
opcache.interned_strings_buffer => 16 => 16
opcache.jit => tracing => tracing
opcache.jit_bisect_limit => 0 => 0
opcache.jit_blacklist_root_trace => 16 => 16
opcache.jit_blacklist_side_trace => 8 => 8
opcache.jit_buffer_size => 0 => 0
opcache.jit_debug => 0 => 0
opcache.jit_hot_func => 127 => 127
opcache.jit_hot_loop => 64 => 64
opcache.jit_hot_return => 8 => 8
opcache.jit_hot_side_exit => 8 => 8
opcache.jit_max_exit_counters => 8192 => 8192
opcache.jit_max_loop_unrolls => 8 => 8
opcache.jit_max_polymorphic_calls => 2 => 2
opcache.jit_max_recursive_calls => 2 => 2
opcache.jit_max_recursive_returns => 2 => 2
opcache.jit_max_root_traces => 1024 => 1024
opcache.jit_max_side_traces => 128 => 128
opcache.jit_max_trace_length => 1024 => 1024
opcache.jit_prof_threshold => 0.005 => 0.005
opcache.lockfile_path => /tmp => /tmp
opcache.log_verbosity_level => 1 => 1
opcache.max_accelerated_files => 20000 => 20000
opcache.max_file_size => 0 => 0
opcache.max_wasted_percentage => 5 => 5
opcache.memory_consumption => 256 => 256
opcache.opt_debug_level => 0 => 0
opcache.optimization_level => 0x7FFEBFFF => 0x7FFEBFFF
opcache.preferred_memory_model => no value => no value
opcache.preload => no value => no value
opcache.preload_user => no value => no value
opcache.protect_memory => Off => Off
opcache.record_warnings => Off => Off
opcache.restrict_api => no value => no value
opcache.revalidate_freq => 2 => 2
opcache.revalidate_path => Off => Off
opcache.save_comments => On => On
opcache.use_cwd => On => On
opcache.validate_permission => Off => Off
opcache.validate_root => Off => Off
opcache.validate_timestamps => Off => Off

zip

Zip => enabled
Zip version => 1.22.3
Libzip version => 1.7.3
BZIP2 compression => Yes
XZ compression => No
ZSTD compression => No
AES-128 encryption => Yes
AES-192 encryption => Yes
AES-256 encryption => Yes

zlib

ZLib Support => enabled
Stream Wrapper => compress.zlib://
Stream Filter => zlib.inflate, zlib.deflate
Compiled Version => 1.2.13
Linked Version => 1.2.13

Directive => Local Value => Master Value
zlib.output_compression => Off => Off
zlib.output_compression_level => -1 => -1
zlib.output_handler => no value => no value

Additional Modules

Module Name

Environment

Variable => Value
HOSTNAME => 8008d65bb95f
PHP_INI_DIR => /usr/local/etc/php
HOME => /root
GODEBUG => cgocheck=0
PHP_LDFLAGS => -Wl,-O1 -pie
PHP_CFLAGS => -fstack-protector-strong -fpic -fpie -O2 -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64
PHP_VERSION => 8.3.7
GPG_KEYS => 1198C0117593497A5EC5C199286AF1F9897469DC C28D937575603EB4ABB725861C0779DC5C0A9DE4 AFD8691FDAEDF03BDF6E460563F15A9B715376CA
PHP_CPPFLAGS => -fstack-protector-strong -fpic -fpie -O2 -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64
PHP_ASC_URL => https://www.php.net/distributions/php-8.3.7.tar.xz.asc
PHP_URL => https://www.php.net/distributions/php-8.3.7.tar.xz
TERM => xterm
PATH => /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
XDG_CONFIG_HOME => /config
XDG_DATA_HOME => /data
PHPIZE_DEPS => autoconf                 dpkg-dev                file            g++             gcc             libc-dev    make             pkg-config              re2c
APP_ENV => prod
PWD => /app
PHP_SHA256 => d53433c1ca6b2c8741afa7c524272e6806c1e895e5912a058494fea89988570a
INFRASTRUCTURE => prod
SERVER_NAME => :80

PHP Variables

Variable => Value
$_SERVER['HOSTNAME'] => 8008d65bb95f
$_SERVER['PHP_INI_DIR'] => /usr/local/etc/php
$_SERVER['HOME'] => /root
$_SERVER['GODEBUG'] => cgocheck=0
$_SERVER['PHP_LDFLAGS'] => -Wl,-O1 -pie
$_SERVER['PHP_CFLAGS'] => -fstack-protector-strong -fpic -fpie -O2 -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64
$_SERVER['PHP_VERSION'] => 8.3.7
$_SERVER['GPG_KEYS'] => 1198C0117593497A5EC5C199286AF1F9897469DC C28D937575603EB4ABB725861C0779DC5C0A9DE4 AFD8691FDAEDF03BDF6E460563F15A9B715376CA
$_SERVER['PHP_CPPFLAGS'] => -fstack-protector-strong -fpic -fpie -O2 -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64
$_SERVER['PHP_ASC_URL'] => https://www.php.net/distributions/php-8.3.7.tar.xz.asc
$_SERVER['PHP_URL'] => https://www.php.net/distributions/php-8.3.7.tar.xz
$_SERVER['TERM'] => xterm
$_SERVER['PATH'] => /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
$_SERVER['XDG_CONFIG_HOME'] => /config
$_SERVER['XDG_DATA_HOME'] => /data
$_SERVER['PHPIZE_DEPS'] => autoconf             dpkg-dev                file            g++             gcc             libc-dev             make            pkg-config              re2c
$_SERVER['APP_ENV'] => prod
$_SERVER['PWD'] => /app
$_SERVER['PHP_SHA256'] => d53433c1ca6b2c8741afa7c524272e6806c1e895e5912a058494fea89988570a
$_SERVER['INFRASTRUCTURE'] => prod
$_SERVER['SERVER_NAME'] => :80
$_SERVER['PHP_SELF'] =>
$_SERVER['SCRIPT_NAME'] =>
$_SERVER['SCRIPT_FILENAME'] =>
$_SERVER['PATH_TRANSLATED'] =>
$_SERVER['DOCUMENT_ROOT'] =>
$_SERVER['REQUEST_TIME_FLOAT'] => 1715955444.9171
$_SERVER['REQUEST_TIME'] => 1715955444
$_SERVER['argv'] => Array
(
)

$_SERVER['argc'] => 0

PHP License
This program is free software; you can redistribute it and/or modify
it under the terms of the PHP License as published by the PHP Group
and included in the distribution in the file:  LICENSE

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

If you did not receive a copy of the PHP license, or have any
questions about PHP licensing, please contact license@php.net

Relevant log output

timestamp,message
1715921977670,"{""level"":""info"",""ts"":1715921977.6703837,""msg"":""using provided configuration"",""config_file"":""/etc/caddy/Caddyfile"",""config_adapter"":""caddyfile""}"
1715921977672,"{""level"":""warn"",""ts"":1715921977.6721144,""msg"":""Caddyfile input is not formatted; run 'caddy fmt --overwrite' to fix inconsistencies"",""adapter"":""caddyfile"",""file"":""/etc/caddy/Caddyfile"",""line"":16}"
1715921977673,"{""level"":""info"",""ts"":1715921977.6736767,""logger"":""admin"",""msg"":""admin endpoint started"",""address"":""localhost:2019"",""enforce_origin"":false,""origins"":[""//localhost:2019"",""//[::1]:2019"",""//127.0.0.1:2019""]}"
1715921977674,"{""level"":""info"",""ts"":1715921977.6742072,""logger"":""tls.cache.maintenance"",""msg"":""started background certificate maintenance"",""cache"":""0xc0004aab80""}"
1715921977674,"{""level"":""warn"",""ts"":1715921977.6744258,""logger"":""http.auto_https"",""msg"":""server is listening only on the HTTP port, so no automatic HTTPS will be applied to this server"",""server_name"":""srv0"",""http_port"":80}"
1715921977674,"{""level"":""info"",""ts"":1715921977.6749153,""logger"":""http.log"",""msg"":""server running"",""name"":""srv0"",""protocols"":[""h1"",""h2"",""h3""]}"
1715921977953,"{""level"":""info"",""ts"":1715921977.953456,""msg"":""FrankenPHP started 🐘"",""php_version"":""8.3.7""}"
1715921977953,"{""level"":""info"",""ts"":1715921977.9538844,""msg"":""autosaved config (load with --resume flag)"",""file"":""/config/caddy/autosave.json""}"
1715921977954,"{""level"":""info"",""ts"":1715921977.9540505,""msg"":""serving initial configuration""}"
1715921977957,"{""level"":""info"",""ts"":1715921977.957654,""logger"":""tls"",""msg"":""cleaning storage unit"",""storage"":""FileStorage:/data/caddy""}"
1715921977957,"{""level"":""info"",""ts"":1715921977.9578545,""logger"":""tls"",""msg"":""finished cleaning storage units""}"
1715925274823,"{""level"":""info"",""ts"":1715925274.8238564,""msg"":""restarting"",""worker"":""/app/public/index.php""}"
1715925278179,"{""level"":""info"",""ts"":1715925278.1789064,""msg"":""restarting"",""worker"":""/app/public/index.php""}"
1715925278207,"{""level"":""info"",""ts"":1715925278.2071204,""msg"":""restarting"",""worker"":""/app/public/index.php""}"
1715925279561,"{""level"":""info"",""ts"":1715925279.5615323,""msg"":""restarting"",""worker"":""/app/public/index.php""}"
1715925280337,malloc(): unaligned tcache chunk detected
1715927995297,"{""level"":""info"",""ts"":1715927995.2975757,""msg"":""shutting down apps, then terminating"",""signal"":""SIGTERM""}"
1715927995297,"{""level"":""warn"",""ts"":1715927995.2976706,""msg"":""exiting; byeee!! 👋"",""signal"":""SIGTERM""}"
1715927995297,"{""level"":""info"",""ts"":1715927995.2977443,""msg"":""FrankenPHP stopped 🐘""}"
1715927995297,"{""level"":""info"",""ts"":1715927995.2978258,""logger"":""http"",""msg"":""servers shutting down with eternal grace period""}"
@magnetik magnetik added the bug Something isn't working label May 17, 2024
@withinboredom
Copy link
Collaborator

Are your servers running ECC ram? This smells like memory corruption of some kind, either by the hardware or some extension doing invalid pointer arithmetic.

@magnetik
Copy link
Author

magnetik commented May 17, 2024

I'm running docker images on virtual machines handled by AWS. It was reproduced multiple times with different VM that probably landed on different hardware.

@magnetik
Copy link
Author

With latest image the error seems to be more verbose :

1715937455636,"{""level"":""info"",""ts"":1715937455.6365173,""msg"":""using provided configuration"",""config_file"":""/etc/caddy/Caddyfile"",""config_adapter"":""caddyfile""}"
1715937455638,"{""level"":""warn"",""ts"":1715937455.6380684,""msg"":""Caddyfile input is not formatted; run 'caddy fmt --overwrite' to fix inconsistencies"",""adapter"":""caddyfile"",""file"":""/etc/caddy/Caddyfile"",""line"":16}"
1715937455640,"{""level"":""info"",""ts"":1715937455.6405027,""logger"":""admin"",""msg"":""admin endpoint started"",""address"":""localhost:2019"",""enforce_origin"":false,""origins"":[""//localhost:2019"",""//[::1]:2019"",""//127.0.0.1:2019""]}"
1715937455640,"{""level"":""warn"",""ts"":1715937455.6407764,""logger"":""http.auto_https"",""msg"":""server is listening only on the HTTP port, so no automatic HTTPS will be applied to this server"",""server_name"":""srv0"",""http_port"":80}"
1715937455641,"{""level"":""info"",""ts"":1715937455.641356,""logger"":""http.log"",""msg"":""server running"",""name"":""srv0"",""protocols"":[""h1"",""h2"",""h3""]}"
1715937455642,"{""level"":""info"",""ts"":1715937455.642187,""logger"":""tls.cache.maintenance"",""msg"":""started background certificate maintenance"",""cache"":""0xc00041d500""}"
1715937455727,"{""level"":""info"",""ts"":1715937455.727415,""logger"":""tls"",""msg"":""cleaning storage unit"",""storage"":""FileStorage:/data/caddy""}"
1715937455727,"{""level"":""info"",""ts"":1715937455.7277355,""logger"":""tls"",""msg"":""finished cleaning storage units""}"
1715937456029,"{""level"":""info"",""ts"":1715937456.0291157,""msg"":""FrankenPHP started 🐘"",""php_version"":""8.3.7""}"
1715937456029,"{""level"":""info"",""ts"":1715937456.0295246,""msg"":""autosaved config (load with --resume flag)"",""file"":""/config/caddy/autosave.json""}"
1715937456029,"{""level"":""info"",""ts"":1715937456.0295386,""msg"":""serving initial configuration""}"
1715940331198,"{""level"":""info"",""ts"":1715940331.1981857,""msg"":""restarting"",""worker"":""/app/public/index.php""}"
1715940338314,"{""level"":""info"",""ts"":1715940338.3140976,""msg"":""restarting"",""worker"":""/app/public/index.php""}"
1715940344801,"{""level"":""info"",""ts"":1715940344.8009102,""msg"":""restarting"",""worker"":""/app/public/index.php""}"
1715940344801,malloc(): unaligned tcache chunk detected
1715940344803,SIGABRT: abort
1715940344803,PC=0x7f7759f6ce2c m=9 sigcode=18446744073709551610
1715940344803,signal arrived during cgo execution
1715940344803,"goroutine 50 gp=0xc000103dc0 m=9 mp=0xc000101008 [syscall, locked to thread]:"
1715940344803,"runtime.cgocall(0x17e8b20, 0xc0002d0ce0)"
1715940344803,	/usr/local/go/src/runtime/cgocall.go:157 +0x4b fp=0xc0002d0cb8 sp=0xc0002d0c80 pc=0x40cc8b
1715940344803,"github.com/dunglas/frankenphp._Cfunc_frankenphp_update_server_context(0x1, 0x0, 0xfb6, 0x7f76cc024270, 0x7f76cc0a9d40, 0x0, 0x0, 0x7f76cc0a9c50, 0x0, 0x0, ...)"
1715940344803,	_cgo_gotypes.go:882 +0x4e fp=0xc0002d0ce0 sp=0xc0002d0cb8 pc=0x165f94e
1715940344803,"github.com/dunglas/frankenphp.updateServerContext(0xc0002d4900, 0x1, 0x0)"
1715940344803,	/go/src/app/frankenphp.go:419 +0x4e5 fp=0xc0002d0dd8 sp=0xc0002d0ce0 pc=0x1661e65
1715940344803,github.com/dunglas/frankenphp.go_execute_script(0x47ca01?)
1715940344803,	/go/src/app/frankenphp.go:506 +0x10f fp=0xc0002d0e40 sp=0xc0002d0dd8 pc=0x166256f
1715940344803,_cgoexp_b7d6fd74a0c8_go_execute_script(0x44f711?)
1715940344803,	_cgo_gotypes.go:933 +0x16 fp=0xc0002d0e58 sp=0xc0002d0e40 pc=0x1667a36
1715940344803,"runtime.cgocallbackg1(0x1667a20, 0x7f76d37faa40, 0x0)"
1715940344803,	/usr/local/go/src/runtime/cgocall.go:403 +0x2a5 fp=0xc0002d0f18 sp=0xc0002d0e58 pc=0x40d3c5
1715940344803,"runtime.cgocallbackg(0x1667a20, 0x7f76d37faa40, 0x0)"
1715940344804,	/usr/local/go/src/runtime/cgocall.go:322 +0x136 fp=0xc0002d0f90 sp=0xc0002d0f18 pc=0x40d076
1715940344804,"runtime.cgocallbackg(0x1667a20, 0x7f76d37faa40, 0x0)"
1715940344804,	<autogenerated>:1 +0x29 fp=0xc0002d0fb8 sp=0xc0002d0f90 pc=0x481189
1715940344804,"runtime.cgocallback(0x0, 0x0, 0x0)"
1715940344804,	/usr/local/go/src/runtime/asm_amd64.s:1079 +0xcc fp=0xc0002d0fe0 sp=0xc0002d0fb8 pc=0x47e7cc
1715940344804,runtime.goexit({})
1715940344804,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc0002d0fe8 sp=0xc0002d0fe0 pc=0x47ea21
1715940344804,"goroutine 1 gp=0xc0000081c0 m=nil [select (no cases), 48 minutes]:"
1715940344804,"runtime.gopark(0xc0006ef840?, 0x53d32c?, 0xd0?, 0xa2?, 0x4?)"
1715940344804,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc00071b820 sp=0xc00071b800 pc=0x4466ae
1715940344804,runtime.block()
1715940344804,	/usr/local/go/src/runtime/select.go:103 +0x26 fp=0xc00071b850 sp=0xc00071b820 pc=0x457de6
1715940344804,github.com/caddyserver/caddy/v2/cmd.cmdRun({0x0?})
1715940344804,	/root/go/pkg/mod/github.com/caddyserver/caddy/v2@v2.7.6/cmd/commandfuncs.go:283 +0xbfc fp=0xc00071bb60 sp=0xc00071b850 pc=0xb3d93c
1715940344804,"github.com/caddyserver/caddy/v2/cmd.init.1.func2.WrapCommandFuncForCobra.1(0xc000447508, {0x1c1a4e8?, 0x4?, 0x1c1a2f0?})"
1715940344804,	/root/go/pkg/mod/github.com/caddyserver/caddy/v2@v2.7.6/cmd/cobra.go:137 +0x2f fp=0xc00071bba0 sp=0xc00071bb60 pc=0xb4a14f
1715940344804,"github.com/spf13/cobra.(*Command).execute(0xc000447508, {0xc000173b80, 0x4, 0x4})"
1715940344804,	/root/go/pkg/mod/github.com/spf13/cobra@v1.8.0/command.go:983 +0xaca fp=0xc00071bd28 sp=0xc00071bba0 pc=0xabfa4a
1715940344804,github.com/spf13/cobra.(*Command).ExecuteC(0x2ec5520)
1715940344804,	/root/go/pkg/mod/github.com/spf13/cobra@v1.8.0/command.go:1115 +0x3ff fp=0xc00071be00 sp=0xc00071bd28 pc=0xac031f
1715940344804,github.com/spf13/cobra.(*Command).Execute(...)
1715940344804,	/root/go/pkg/mod/github.com/spf13/cobra@v1.8.0/command.go:1039
1715940344804,github.com/caddyserver/caddy/v2/cmd.Main()
1715940344804,	/root/go/pkg/mod/github.com/caddyserver/caddy/v2@v2.7.6/cmd/main.go:66 +0x5b fp=0xc00071be60 sp=0xc00071be00 pc=0xb421bb
1715940344804,main.main()
1715940344804,	/go/src/app/caddy/frankenphp/main.go:24 +0x18d fp=0xc00071bf50 sp=0xc00071be60 pc=0x17e7bad
1715940344804,runtime.main()
1715940344804,	/usr/local/go/src/runtime/proc.go:271 +0x29d fp=0xc00071bfe0 sp=0xc00071bf50 pc=0x44625d
1715940344804,runtime.goexit({})
1715940344804,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00071bfe8 sp=0xc00071bfe0 pc=0x47ea21
1715940344804,"goroutine 17 gp=0xc000008700 m=nil [select, locked to thread]:"
1715940344804,"runtime.gopark(0xc000096e10?, 0x2?, 0x8?, 0x0?, 0xc000096df4?)"
1715940344804,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc000096c90 sp=0xc000096c70 pc=0x4466ae
1715940344804,"runtime.selectgo(0xc000096e10, 0xc000096df0, 0x2fcf2a0?, 0x0, 0x0?, 0x1)"
1715940344804,	/usr/local/go/src/runtime/select.go:327 +0x725 fp=0xc000096db0 sp=0xc000096c90 pc=0x458525
1715940344804,github.com/dunglas/frankenphp.go_fetch_request()
1715940344804,	/go/src/app/frankenphp.go:473 +0x75 fp=0xc000096e48 sp=0xc000096db0 pc=0x16622b5
1715940344804,_cgoexp_b7d6fd74a0c8_go_fetch_request(0x7f76f6bfca80)
1715940344804,	_cgo_gotypes.go:925 +0x14 fp=0xc000096e58 sp=0xc000096e48 pc=0x16679f4
1715940344804,"runtime.cgocallbackg1(0x16679e0, 0x7f76f6bfca80, 0x0)"
1715940344804,	/usr/local/go/src/runtime/cgocall.go:403 +0x2a5 fp=0xc000096f18 sp=0xc000096e58 pc=0x40d3c5
1715940344804,"runtime.cgocallbackg(0x16679e0, 0x7f76f6bfca80, 0x0)"
1715940344804,	/usr/local/go/src/runtime/cgocall.go:322 +0x136 fp=0xc000096f90 sp=0xc000096f18 pc=0x40d076
1715940344804,"runtime.cgocallbackg(0x16679e0, 0x7f76f6bfca80, 0x0)"
1715940344804,	<autogenerated>:1 +0x29 fp=0xc000096fb8 sp=0xc000096f90 pc=0x481189
1715940344804,"runtime.cgocallback(0x0, 0x0, 0x0)"
1715940344804,	/usr/local/go/src/runtime/asm_amd64.s:1079 +0xcc fp=0xc000096fe0 sp=0xc000096fb8 pc=0x47e7cc
1715940344804,runtime.goexit({})
1715940344804,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000096fe8 sp=0xc000096fe0 pc=0x47ea21
1715940344804,"goroutine 2 gp=0xc000008c40 m=nil [force gc (idle), 2 minutes]:"
1715940344804,"runtime.gopark(0x2c939eacecf?, 0x0?, 0x0?, 0x0?, 0x0?)"
1715940344804,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc000084fa8 sp=0xc000084f88 pc=0x4466ae
1715940344804,runtime.goparkunlock(...)
1715940344804,	/usr/local/go/src/runtime/proc.go:408
1715940344804,runtime.forcegchelper()
1715940344804,	/usr/local/go/src/runtime/proc.go:326 +0xb3 fp=0xc000084fe0 sp=0xc000084fa8 pc=0x446513
1715940344804,runtime.goexit({})
1715940344804,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000084fe8 sp=0xc000084fe0 pc=0x47ea21
1715940344804,created by runtime.init.6 in goroutine 1
1715940344804,	/usr/local/go/src/runtime/proc.go:314 +0x1a
1715940344804,goroutine 3 gp=0xc000009180 m=nil [GC sweep wait]:
1715940344804,"runtime.gopark(0x2f6a101?, 0x0?, 0x0?, 0x0?, 0x0?)"
1715940344804,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc000085780 sp=0xc000085760 pc=0x4466ae
1715940344805,runtime.goparkunlock(...)
1715940344805,	/usr/local/go/src/runtime/proc.go:408
1715940344805,runtime.bgsweep(0xc000064070)
1715940344805,	/usr/local/go/src/runtime/mgcsweep.go:318 +0xdf fp=0xc0000857c8 sp=0xc000085780 pc=0x42f2df
1715940344805,runtime.gcenable.gowrap1()
1715940344805,	/usr/local/go/src/runtime/mgc.go:203 +0x25 fp=0xc0000857e0 sp=0xc0000857c8 pc=0x423bc5
1715940344805,runtime.goexit({})
1715940344805,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc0000857e8 sp=0xc0000857e0 pc=0x47ea21
1715940344805,created by runtime.gcenable in goroutine 1
1715940344805,	/usr/local/go/src/runtime/mgc.go:203 +0x66
1715940344805,goroutine 4 gp=0xc000009340 m=nil [GC scavenge wait]:
1715940344805,"runtime.gopark(0x1078fe?, 0xd3da1?, 0x0?, 0x0?, 0x0?)"
1715940344805,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc000085f78 sp=0xc000085f58 pc=0x4466ae
1715940344805,runtime.goparkunlock(...)
1715940344805,	/usr/local/go/src/runtime/proc.go:408
1715940344805,runtime.(*scavengerState).park(0x2f6c280)
1715940344805,	/usr/local/go/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc000085fa8 sp=0xc000085f78 pc=0x42cc69
1715940344805,runtime.bgscavenge(0xc000064070)
1715940344805,	/usr/local/go/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc000085fc8 sp=0xc000085fa8 pc=0x42d219
1715940344805,runtime.gcenable.gowrap2()
1715940344805,	/usr/local/go/src/runtime/mgc.go:204 +0x25 fp=0xc000085fe0 sp=0xc000085fc8 pc=0x423b65
1715940344805,runtime.goexit({})
1715940344805,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000085fe8 sp=0xc000085fe0 pc=0x47ea21
1715940344805,created by runtime.gcenable in goroutine 1
1715940344805,	/usr/local/go/src/runtime/mgc.go:204 +0xa5
1715940344805,goroutine 5 gp=0xc000009c00 m=nil [finalizer wait]:
1715940344805,"runtime.gopark(0x0?, 0x1eb5ad0?, 0x0?, 0x20?, 0x1000000010?)"
1715940344805,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc000084620 sp=0xc000084600 pc=0x4466ae
1715940344805,runtime.runfinq()
1715940344805,	/usr/local/go/src/runtime/mfinal.go:194 +0x107 fp=0xc0000847e0 sp=0xc000084620 pc=0x422c07
1715940344805,runtime.goexit({})
1715940344805,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc0000847e8 sp=0xc0000847e0 pc=0x47ea21
1715940344805,created by runtime.createfing in goroutine 1
1715940344805,	/usr/local/go/src/runtime/mfinal.go:164 +0x3d
1715940344805,goroutine 18 gp=0xc000102380 m=nil [GC worker (idle)]:
1715940344805,"runtime.gopark(0x2c93a14b9bf?, 0x2?, 0x4b?, 0x1?, 0x0?)"
1715940344805,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc000080750 sp=0xc000080730 pc=0x4466ae
1715940344805,runtime.gcBgMarkWorker()
1715940344805,	/usr/local/go/src/runtime/mgc.go:1310 +0xe5 fp=0xc0000807e0 sp=0xc000080750 pc=0x425ca5
1715940344805,runtime.goexit({})
1715940344805,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc0000807e8 sp=0xc0000807e0 pc=0x47ea21
1715940344805,created by runtime.gcBgMarkStartWorkers in goroutine 1
1715940344806,	/usr/local/go/src/runtime/mgc.go:1234 +0x1c
1715940344806,goroutine 19 gp=0xc000102540 m=nil [GC worker (idle)]:
1715940344806,"runtime.gopark(0x2c93a14ccba?, 0x0?, 0x0?, 0x0?, 0x0?)"
1715940344806,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc000080f50 sp=0xc000080f30 pc=0x4466ae
1715940344806,runtime.gcBgMarkWorker()
1715940344806,	/usr/local/go/src/runtime/mgc.go:1310 +0xe5 fp=0xc000080fe0 sp=0xc000080f50 pc=0x425ca5
1715940344806,runtime.goexit({})
1715940344806,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000080fe8 sp=0xc000080fe0 pc=0x47ea21
1715940344806,created by runtime.gcBgMarkStartWorkers in goroutine 1
1715940344806,	/usr/local/go/src/runtime/mgc.go:1234 +0x1c
1715940344806,goroutine 20 gp=0xc00026b6c0 m=nil [select]:
1715940344806,"runtime.gopark(0xc000087780?, 0x2?, 0x91?, 0x73?, 0xc000087774?)"
1715940344806,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc000087618 sp=0xc0000875f8 pc=0x4466ae
1715940344806,"runtime.selectgo(0xc000087780, 0xc000087770, 0x0?, 0x0, 0x0?, 0x1)"
1715940344806,	/usr/local/go/src/runtime/select.go:327 +0x725 fp=0xc000087738 sp=0xc000087618 pc=0x458525
1715940344806,github.com/golang/glog.(*fileSink).flushDaemon(0x2f6bcd8)
1715940344806,	/root/go/pkg/mod/github.com/golang/glog@v1.2.1/glog_file.go:351 +0xb9 fp=0xc0000877c8 sp=0xc000087738 pc=0xdfb339
1715940344806,github.com/golang/glog.init.1.gowrap1()
1715940344806,	/root/go/pkg/mod/github.com/golang/glog@v1.2.1/glog_file.go:166 +0x25 fp=0xc0000877e0 sp=0xc0000877c8 pc=0xdfa3c5
1715940344806,runtime.goexit({})
1715940344806,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc0000877e8 sp=0xc0000877e0 pc=0x47ea21
1715940344806,created by github.com/golang/glog.init.1 in goroutine 1
1715940344806,	/root/go/pkg/mod/github.com/golang/glog@v1.2.1/glog_file.go:166 +0x126
1715940344806,"goroutine 23 gp=0xc00026bc00 m=nil [sync.Cond.Wait, 48 minutes]:"
1715940344806,"runtime.gopark(0x2173760?, 0xc000305f00?, 0x0?, 0x0?, 0x0?)"
1715940344806,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc000747c70 sp=0xc000747c50 pc=0x4466ae
1715940344806,runtime.goparkunlock(...)
1715940344806,	/usr/local/go/src/runtime/proc.go:408
1715940344806,"sync.runtime_notifyListWait(0xc000002858, 0x3)"
1715940344806,	/usr/local/go/src/runtime/sema.go:569 +0x159 fp=0xc000747cc0 sp=0xc000747c70 pc=0x47a959
1715940344806,sync.(*Cond).Wait(0x0?)
1715940344806,	/usr/local/go/src/sync/cond.go:70 +0x85 fp=0xc000747d00 sp=0xc000747cc0 pc=0x4886e5
1715940344806,github.com/maypok86/otter/internal/queue.(*Growable[...]).Pop(0x216c640)
1715940344806,	/root/go/pkg/mod/github.com/maypok86/otter@v1.2.1/internal/queue/growable.go:71 +0x74 fp=0xc000747d98 sp=0xc000747d00 pc=0x1671d14
1715940344806,github.com/maypok86/otter/internal/core.(*Cache[...]).process(0x218e360)
1715940344806,	/root/go/pkg/mod/github.com/maypok86/otter@v1.2.1/internal/core/cache.go:386 +0xe8 fp=0xc000747fc0 sp=0xc000747d98 pc=0x166fba8
1715940344806,github.com/maypok86/otter/internal/core.NewCache[...].gowrap2()
1715940344806,	/root/go/pkg/mod/github.com/maypok86/otter@v1.2.1/internal/core/cache.go:167 +0x25 fp=0xc000747fe0 sp=0xc000747fc0 pc=0x1666da5
1715940344806,runtime.goexit({})
1715940344806,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000747fe8 sp=0xc000747fe0 pc=0x47ea21
1715940344806,created by github.com/maypok86/otter/internal/core.NewCache[...] in goroutine 1
1715940344806,	/root/go/pkg/mod/github.com/maypok86/otter@v1.2.1/internal/core/cache.go:167 +0x6b3
1715940344806,"goroutine 27 gp=0xc000103a40 m=nil [select, 48 minutes]:"
1715940344806,"runtime.gopark(0xc000583ee8?, 0x3?, 0x0?, 0x0?, 0xc000583eda?)"
1715940344806,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc0002cdd80 sp=0xc0002cdd60 pc=0x4466ae
1715940344806,"runtime.selectgo(0xc0002cdee8, 0xc000583ed4, 0xc000583ed0?, 0x2, 0xc000113dc0?, 0x1)"
1715940344806,	/usr/local/go/src/runtime/select.go:327 +0x725 fp=0xc0002cdea0 sp=0xc0002cdd80 pc=0x458525
1715940344806,github.com/caddyserver/certmagic.(*RingBufferRateLimiter).permit(0xc00046f900)
1715940344806,	/root/go/pkg/mod/github.com/caddyserver/certmagic@v0.20.0/ratelimiter.go:217 +0x86 fp=0xc0002cdf28 sp=0xc0002cdea0 pc=0x8d2d66
1715940344806,github.com/caddyserver/certmagic.(*RingBufferRateLimiter).loop(0xc00046f900)
1715940344806,	/root/go/pkg/mod/github.com/caddyserver/certmagic@v0.20.0/ratelimiter.go:89 +0x8b fp=0xc0002cdfc8 sp=0xc0002cdf28 pc=0x8d272b
1715940344806,github.com/caddyserver/certmagic.NewRateLimiter.gowrap1()
1715940344806,	/root/go/pkg/mod/github.com/caddyserver/certmagic@v0.20.0/ratelimiter.go:45 +0x25 fp=0xc0002cdfe0 sp=0xc0002cdfc8 pc=0x8d2665
1715940344806,runtime.goexit({})
1715940344806,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc0002cdfe8 sp=0xc0002cdfe0 pc=0x47ea21
1715940344806,created by github.com/caddyserver/certmagic.NewRateLimiter in goroutine 1
1715940344806,	/root/go/pkg/mod/github.com/caddyserver/certmagic@v0.20.0/ratelimiter.go:45 +0x13c
1715940344806,"goroutine 31 gp=0xc00044c000 m=nil [chan receive, 48 minutes]:"
1715940344806,"runtime.gopark(0xa4f6c5?, 0x19e8740?, 0x1?, 0xc0?, 0xc000599ed8?)"
1715940344806,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc000742e48 sp=0xc000742e28 pc=0x4466ae
1715940344806,"runtime.chanrecv(0xc000486120, 0x0, 0x1)"
1715940344806,	/usr/local/go/src/runtime/chan.go:583 +0x3bf fp=0xc000742ec0 sp=0xc000742e48 pc=0x40f31f
1715940344806,"runtime.chanrecv1(0xc000486120?, 0xc000599fa8?)"
1715940344806,	/usr/local/go/src/runtime/chan.go:442 +0x12 fp=0xc000742ee8 sp=0xc000742ec0 pc=0x40ef32
1715940344806,github.com/caddyserver/caddy/v2.trapSignalsCrossPlatform.func1()
1715940344806,	/root/go/pkg/mod/github.com/caddyserver/caddy/v2@v2.7.6/sigtrap.go:43 +0xe5 fp=0xc000742fe0 sp=0xc000742ee8 pc=0xa70be5
1715940344806,runtime.goexit({})
1715940344806,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000742fe8 sp=0xc000742fe0 pc=0x47ea21
1715940344806,created by github.com/caddyserver/caddy/v2.trapSignalsCrossPlatform in goroutine 1
1715940344806,	/root/go/pkg/mod/github.com/caddyserver/caddy/v2@v2.7.6/sigtrap.go:38 +0x1a
1715940344807,"goroutine 32 gp=0xc00044c1c0 m=nil [chan receive, 48 minutes]:"
1715940344807,"runtime.gopark(0xa4f6a5?, 0xc0000345b0?, 0x0?, 0x0?, 0xc000097da8?)"
1715940344807,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc000097d18 sp=0xc000097cf8 pc=0x4466ae
1715940344807,"runtime.chanrecv(0xc000129800, 0xc000097f70, 0x1)"
1715940344807,	/usr/local/go/src/runtime/chan.go:583 +0x3bf fp=0xc000097d90 sp=0xc000097d18 pc=0x40f31f
1715940344807,"runtime.chanrecv2(0xc000129800?, 0xc000087f80?)"
1715940344807,	/usr/local/go/src/runtime/chan.go:447 +0x12 fp=0xc000097db8 sp=0xc000097d90 pc=0x40ef52
1715940344807,github.com/caddyserver/caddy/v2.trapSignalsPosix.func1()
1715940344807,	/root/go/pkg/mod/github.com/caddyserver/caddy/v2@v2.7.6/sigtrap_posix.go:35 +0x105 fp=0xc000097fe0 sp=0xc000097db8 pc=0xa70485
1715940344807,runtime.goexit({})
1715940344807,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000097fe8 sp=0xc000097fe0 pc=0x47ea21
1715940344807,created by github.com/caddyserver/caddy/v2.trapSignalsPosix in goroutine 1
1715940344807,	/root/go/pkg/mod/github.com/caddyserver/caddy/v2@v2.7.6/sigtrap_posix.go:31 +0x1a
1715940344807,"goroutine 6 gp=0xc0002b8000 m=nil [select, 48 minutes, locked to thread]:"
1715940344807,"runtime.gopark(0xc0002bf7a8?, 0x2?, 0x9c?, 0x67?, 0xc0002bf794?)"
1715940344807,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc0002bf638 sp=0xc0002bf618 pc=0x4466ae
1715940344807,"runtime.selectgo(0xc0002bf7a8, 0xc0002bf790, 0x0?, 0x0, 0x0?, 0x1)"
1715940344807,	/usr/local/go/src/runtime/select.go:327 +0x725 fp=0xc0002bf758 sp=0xc0002bf638 pc=0x458525
1715940344807,runtime.ensureSigM.func1()
1715940344807,	/usr/local/go/src/runtime/signal_unix.go:1034 +0x19f fp=0xc0002bf7e0 sp=0xc0002bf758 pc=0x47543f
1715940344807,runtime.goexit({})
1715940344807,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc0002bf7e8 sp=0xc0002bf7e0 pc=0x47ea21
1715940344807,created by runtime.ensureSigM in goroutine 31
1715940344807,	/usr/local/go/src/runtime/signal_unix.go:1017 +0xc8
1715940344807,"goroutine 7 gp=0xc0002b81c0 m=3 mp=0xc000089008 [syscall, 48 minutes]:"
1715940344807,"runtime.notetsleepg(0x2fd0a60, 0xffffffffffffffff)"
1715940344807,	/usr/local/go/src/runtime/lock_futex.go:246 +0x29 fp=0xc0002bffa0 sp=0xc0002bff78 pc=0x415389
1715940344807,os/signal.signal_recv()
1715940344807,	/usr/local/go/src/runtime/sigqueue.go:152 +0x29 fp=0xc0002bffc0 sp=0xc0002bffa0 pc=0x47ad49
1715940344807,os/signal.loop()
1715940344807,	/usr/local/go/src/os/signal/signal_unix.go:23 +0x13 fp=0xc0002bffe0 sp=0xc0002bffc0 pc=0xa4fe53
1715940344807,runtime.goexit({})
1715940344807,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc0002bffe8 sp=0xc0002bffe0 pc=0x47ea21
1715940344807,created by os/signal.Notify.func1.1 in goroutine 31
1715940344807,	/usr/local/go/src/os/signal/signal.go:151 +0x1f
1715940344807,"goroutine 37 gp=0xc00044c380 m=nil [IO wait, 48 minutes]:"
1715940344807,"runtime.gopark(0xc000667ba8?, 0x41f038?, 0xe8?, 0x7b?, 0x4169e5?)"
1715940344807,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc0005bab50 sp=0xc0005bab30 pc=0x4466ae
1715940344807,"runtime.netpollblock(0x4169e5?, 0x40c426?, 0x0?)"
1715940344807,	/usr/local/go/src/runtime/netpoll.go:573 +0xf7 fp=0xc0005bab88 sp=0xc0005bab50 pc=0x43e7d7
1715940344807,"internal/poll.runtime_pollWait(0x7f770d46e6d0, 0x72)"
1715940344807,	/usr/local/go/src/runtime/netpoll.go:345 +0x85 fp=0xc0005baba8 sp=0xc0005bab88 pc=0x478b05
1715940344807,"internal/poll.(*pollDesc).wait(0x3?, 0xc000713f80?, 0x0)"
1715940344807,	/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc0005babd0 sp=0xc0005baba8 pc=0x531cc7
1715940344807,internal/poll.(*pollDesc).waitRead(...)
1715940344807,	/usr/local/go/src/internal/poll/fd_poll_runtime.go:89
1715940344807,internal/poll.(*FD).Accept(0xc00041d180)
1715940344807,	/usr/local/go/src/internal/poll/fd_unix.go:611 +0x2ac fp=0xc0005bac78 sp=0xc0005babd0 pc=0x53706c
1715940344807,net.(*netFD).accept(0xc00041d180)
1715940344807,	/usr/local/go/src/net/fd_unix.go:172 +0x29 fp=0xc0005bad30 sp=0xc0005bac78 pc=0x5eb0a9
1715940344807,net.(*TCPListener).accept(0xc000475c20)
1715940344807,	/usr/local/go/src/net/tcpsock_posix.go:159 +0x1e fp=0xc0005bad58 sp=0xc0005bad30 pc=0x60559e
1715940344807,net.(*TCPListener).Accept(0xc000475c20)
1715940344807,	/usr/local/go/src/net/tcpsock.go:327 +0x30 fp=0xc0005bad88 sp=0xc0005bad58 pc=0x604790
1715940344807,github.com/caddyserver/caddy/v2.(*deleteListener).Accept(0x2e8d590?)
1715940344807,	<autogenerated>:1 +0x24 fp=0xc0005bada0 sp=0xc0005bad88 pc=0xa75544
1715940344807,net/http.(*onceCloseListener).Accept(0x2154c80?)
1715940344807,	<autogenerated>:1 +0x24 fp=0xc0005badb8 sp=0xc0005bada0 pc=0x76f0e4
1715940344807,"net/http.(*Server).Serve(0xc0004e3860, {0x7f770c7d6ac8, 0xc000475c40})"
1715940344807,	/usr/local/go/src/net/http/server.go:3255 +0x33e fp=0xc0005baee8 sp=0xc0005badb8 pc=0x74b4fe
1715940344807,github.com/caddyserver/caddy/v2.replaceLocalAdminServer.func2()
1715940344807,	/root/go/pkg/mod/github.com/caddyserver/caddy/v2@v2.7.6/admin.go:449 +0x133 fp=0xc0005bafe0 sp=0xc0005baee8 pc=0xa527d3
1715940344807,runtime.goexit({})
1715940344807,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc0005bafe8 sp=0xc0005bafe0 pc=0x47ea21
1715940344807,created by github.com/caddyserver/caddy/v2.replaceLocalAdminServer in goroutine 1
1715940344807,	/root/go/pkg/mod/github.com/caddyserver/caddy/v2@v2.7.6/admin.go:445 +0x4b2
1715940344807,"goroutine 38 gp=0xc00044cc40 m=nil [select, 8 minutes]:"
1715940344807,"runtime.gopark(0xc000757f40?, 0x3?, 0x0?, 0x0?, 0xc000757e3a?)"
1715940344807,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc000676ce0 sp=0xc000676cc0 pc=0x4466ae
1715940344807,"runtime.selectgo(0xc000676f40, 0xc000757e34, 0xc0005a7360?, 0x0, 0x0?, 0x1)"
1715940344808,	/usr/local/go/src/runtime/select.go:327 +0x725 fp=0xc000676e00 sp=0xc000676ce0 pc=0x458525
1715940344808,"github.com/caddyserver/certmagic.(*Cache).maintainAssets(0xc00041d500, 0x0)"
1715940344808,	/root/go/pkg/mod/github.com/caddyserver/certmagic@v0.20.0/maintain.go:69 +0x31f fp=0xc000676fc0 sp=0xc000676e00 pc=0x8c825f
1715940344808,github.com/caddyserver/certmagic.NewCache.gowrap1()
1715940344808,	/root/go/pkg/mod/github.com/caddyserver/certmagic@v0.20.0/cache.go:127 +0x25 fp=0xc000676fe0 sp=0xc000676fc0 pc=0x8a5cc5
1715940344808,runtime.goexit({})
1715940344808,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000676fe8 sp=0xc000676fe0 pc=0x47ea21
1715940344808,created by github.com/caddyserver/certmagic.NewCache in goroutine 1
1715940344808,	/root/go/pkg/mod/github.com/caddyserver/certmagic@v0.20.0/cache.go:127 +0x1f6
1715940344808,"goroutine 39 gp=0xc00044d500 m=nil [select, 48 minutes]:"
1715940344808,"runtime.gopark(0xc000719fa8?, 0x2?, 0x0?, 0x0?, 0xc000719f9c?)"
1715940344808,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc000744e40 sp=0xc000744e20 pc=0x4466ae
1715940344808,"runtime.selectgo(0xc000744fa8, 0xc000719f98, 0x0?, 0x0, 0x0?, 0x1)"
1715940344808,	/usr/local/go/src/runtime/select.go:327 +0x725 fp=0xc000744f60 sp=0xc000744e40 pc=0x458525
1715940344808,github.com/caddyserver/caddy/v2/modules/caddytls.(*TLS).keepStorageClean.func1()
1715940344808,	/root/go/pkg/mod/github.com/caddyserver/caddy/v2@v2.7.6/modules/caddytls/tls.go:540 +0x93 fp=0xc000744fe0 sp=0xc000744f60 pc=0x10aa553
1715940344808,runtime.goexit({})
1715940344808,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000744fe8 sp=0xc000744fe0 pc=0x47ea21
1715940344808,created by github.com/caddyserver/caddy/v2/modules/caddytls.(*TLS).keepStorageClean in goroutine 1
1715940344808,	/root/go/pkg/mod/github.com/caddyserver/caddy/v2@v2.7.6/modules/caddytls/tls.go:532 +0xe5
1715940344808,goroutine 40 gp=0xc00044d6c0 m=nil [IO wait]:
1715940344808,"runtime.gopark(0xc000072508?, 0x0?, 0xc0?, 0xd6?, 0xc000099c58?)"
1715940344808,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc000099c20 sp=0xc000099c00 pc=0x4466ae
1715940344808,"runtime.netpollblock(0xc000099cb8?, 0x40c426?, 0x0?)"
1715940344808,	/usr/local/go/src/runtime/netpoll.go:573 +0xf7 fp=0xc000099c58 sp=0xc000099c20 pc=0x43e7d7
1715940344808,"internal/poll.runtime_pollWait(0x7f770d46e5d8, 0x72)"
1715940344808,	/usr/local/go/src/runtime/netpoll.go:345 +0x85 fp=0xc000099c78 sp=0xc000099c58 pc=0x478b05
1715940344808,"internal/poll.(*pollDesc).wait(0x7?, 0x1?, 0x0)"
1715940344808,	/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000099ca0 sp=0xc000099c78 pc=0x531cc7
1715940344808,internal/poll.(*pollDesc).waitRead(...)
1715940344808,	/usr/local/go/src/internal/poll/fd_poll_runtime.go:89
1715940344808,internal/poll.(*FD).Accept(0xc000708c00)
1715940344808,	/usr/local/go/src/internal/poll/fd_unix.go:611 +0x2ac fp=0xc000099d48 sp=0xc000099ca0 pc=0x53706c
1715940344808,net.(*netFD).accept(0xc000708c00)
1715940344808,	/usr/local/go/src/net/fd_unix.go:172 +0x29 fp=0xc000099e00 sp=0xc000099d48 pc=0x5eb0a9
1715940344808,net.(*TCPListener).accept(0xc000134600)
1715940344808,	/usr/local/go/src/net/tcpsock_posix.go:159 +0x1e fp=0xc000099e28 sp=0xc000099e00 pc=0x60559e
1715940344808,net.(*TCPListener).Accept(0xc000134600)
1715940344808,	/usr/local/go/src/net/tcpsock.go:327 +0x30 fp=0xc000099e58 sp=0xc000099e28 pc=0x604790
1715940344808,github.com/caddyserver/caddy/v2.(*deleteListener).Accept(0x74b674?)
1715940344808,	<autogenerated>:1 +0x24 fp=0xc000099e70 sp=0xc000099e58 pc=0xa75544
1715940344808,net/http.(*onceCloseListener).Accept(0xc0002b47e0?)
1715940344808,	<autogenerated>:1 +0x24 fp=0xc000099e88 sp=0xc000099e70 pc=0x76f0e4
1715940344808,"net/http.(*Server).Serve(0xc0004e3b30, {0x7f770c7d6ac8, 0xc000134620})"
1715940344808,	/usr/local/go/src/net/http/server.go:3255 +0x33e fp=0xc000099fb8 sp=0xc000099e88 pc=0x74b4fe
1715940344808,github.com/caddyserver/caddy/v2/modules/caddyhttp.(*App).Start.gowrap1()
1715940344808,	/root/go/pkg/mod/github.com/caddyserver/caddy/v2@v2.7.6/modules/caddyhttp/app.go:509 +0x28 fp=0xc000099fe0 sp=0xc000099fb8 pc=0x126e308
1715940344808,runtime.goexit({})
1715940344808,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000099fe8 sp=0xc000099fe0 pc=0x47ea21
1715940344808,created by github.com/caddyserver/caddy/v2/modules/caddyhttp.(*App).Start in goroutine 1
1715940344808,	/root/go/pkg/mod/github.com/caddyserver/caddy/v2@v2.7.6/modules/caddyhttp/app.go:509 +0x1b95
1715940344808,"goroutine 41 gp=0xc00044d880 m=nil [chan receive, 48 minutes]:"
1715940344808,"runtime.gopark(0x2?, 0x0?, 0x60?, 0x2c?, 0xc0004863a0?)"
1715940344808,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc000092c18 sp=0xc000092bf8 pc=0x4466ae
1715940344808,"runtime.chanrecv(0xc0002b6180, 0x0, 0x1)"
1715940344808,	/usr/local/go/src/runtime/chan.go:583 +0x3bf fp=0xc000092c90 sp=0xc000092c18 pc=0x40f31f
1715940344808,"runtime.chanrecv1(0xc000092d18?, 0xc000092cf0?)"
1715940344808,	/usr/local/go/src/runtime/chan.go:442 +0x12 fp=0xc000092cb8 sp=0xc000092c90 pc=0x40ef32
1715940344808,"github.com/dunglas/frankenphp.ServeHTTP({0x0, 0x0}, 0xc0002d4360)"
1715940344808,	/go/src/app/frankenphp.go:465 +0x20e fp=0xc000092d78 sp=0xc000092cb8 pc=0x166210e
1715940344808,github.com/dunglas/frankenphp.startWorkers.func1()
1715940344808,	/go/src/app/worker.go:78 +0x2c5 fp=0xc000092fe0 sp=0xc000092d78 pc=0x16656c5
1715940344808,runtime.goexit({})
1715940344808,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000092fe8 sp=0xc000092fe0 pc=0x47ea21
1715940344808,created by github.com/dunglas/frankenphp.startWorkers in goroutine 1
1715940344808,	/go/src/app/worker.go:60 +0x32b
1715940344808,goroutine 42 gp=0xc00044da40 m=nil [chan receive]:
1715940344808,"runtime.gopark(0x2?, 0x10?, 0x60?, 0x3c?, 0xc0002d3c78?)"
1715940344808,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc0002d3c18 sp=0xc0002d3bf8 pc=0x4466ae
1715940344808,"runtime.chanrecv(0xc000404840, 0x0, 0x1)"
1715940344808,	/usr/local/go/src/runtime/chan.go:583 +0x3bf fp=0xc0002d3c90 sp=0xc0002d3c18 pc=0x40f31f
1715940344808,"runtime.chanrecv1(0xc0002d3d18?, 0xc0002d3cf0?)"
1715940344808,	/usr/local/go/src/runtime/chan.go:442 +0x12 fp=0xc0002d3cb8 sp=0xc0002d3c90 pc=0x40ef32
1715940344808,"github.com/dunglas/frankenphp.ServeHTTP({0x0, 0x0}, 0xc000657b00)"
1715940344808,	/go/src/app/frankenphp.go:465 +0x20e fp=0xc0002d3d78 sp=0xc0002d3cb8 pc=0x166210e
1715940344809,github.com/dunglas/frankenphp.startWorkers.func1()
1715940344809,	/go/src/app/worker.go:78 +0x2c5 fp=0xc0002d3fe0 sp=0xc0002d3d78 pc=0x16656c5
1715940344809,runtime.goexit({})
1715940344809,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc0002d3fe8 sp=0xc0002d3fe0 pc=0x47ea21
1715940344809,created by github.com/dunglas/frankenphp.startWorkers in goroutine 1
1715940344809,	/go/src/app/worker.go:60 +0x32b
1715940344809,goroutine 43 gp=0xc00044dc00 m=nil [chan receive]:
1715940344809,"runtime.gopark(0x2?, 0x10?, 0x60?, 0x3c?, 0xc000093c78?)"
1715940344809,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc000093c18 sp=0xc000093bf8 pc=0x4466ae
1715940344809,"runtime.chanrecv(0xc00059e5a0, 0x0, 0x1)"
1715940344809,	/usr/local/go/src/runtime/chan.go:583 +0x3bf fp=0xc000093c90 sp=0xc000093c18 pc=0x40f31f
1715940344809,"runtime.chanrecv1(0xc000093d18?, 0xc000093cf0?)"
1715940344809,	/usr/local/go/src/runtime/chan.go:442 +0x12 fp=0xc000093cb8 sp=0xc000093c90 pc=0x40ef32
1715940344809,"github.com/dunglas/frankenphp.ServeHTTP({0x0, 0x0}, 0xc0002d4900)"
1715940344809,	/go/src/app/frankenphp.go:465 +0x20e fp=0xc000093d78 sp=0xc000093cb8 pc=0x166210e
1715940344809,github.com/dunglas/frankenphp.startWorkers.func1()
1715940344809,	/go/src/app/worker.go:78 +0x2c5 fp=0xc000093fe0 sp=0xc000093d78 pc=0x16656c5
1715940344809,runtime.goexit({})
1715940344809,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000093fe8 sp=0xc000093fe0 pc=0x47ea21
1715940344809,created by github.com/dunglas/frankenphp.startWorkers in goroutine 1
1715940344809,	/go/src/app/worker.go:60 +0x32b
1715940344809,goroutine 44 gp=0xc00044ddc0 m=nil [chan receive]:
1715940344809,"runtime.gopark(0x2?, 0x10?, 0x60?, 0x5c?, 0xc000095c78?)"
1715940344809,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc000095c18 sp=0xc000095bf8 pc=0x4466ae
1715940344809,"runtime.chanrecv(0xc000404a80, 0x0, 0x1)"
1715940344809,	/usr/local/go/src/runtime/chan.go:583 +0x3bf fp=0xc000095c90 sp=0xc000095c18 pc=0x40f31f
1715940344809,"runtime.chanrecv1(0xc000095d18?, 0xc000095cf0?)"
1715940344809,	/usr/local/go/src/runtime/chan.go:442 +0x12 fp=0xc000095cb8 sp=0xc000095c90 pc=0x40ef32
1715940344809,"github.com/dunglas/frankenphp.ServeHTTP({0x0, 0x0}, 0xc0004f9200)"
1715940344809,	/go/src/app/frankenphp.go:465 +0x20e fp=0xc000095d78 sp=0xc000095cb8 pc=0x166210e
1715940344809,github.com/dunglas/frankenphp.startWorkers.func1()
1715940344809,	/go/src/app/worker.go:78 +0x2c5 fp=0xc000095fe0 sp=0xc000095d78 pc=0x16656c5
1715940344809,runtime.goexit({})
1715940344809,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000095fe8 sp=0xc000095fe0 pc=0x47ea21
1715940344809,created by github.com/dunglas/frankenphp.startWorkers in goroutine 1
1715940344809,	/go/src/app/worker.go:60 +0x32b
1715940344809,"goroutine 51 gp=0xc000724380 m=nil [select, locked to thread]:"
1715940344809,"runtime.gopark(0xc0002d1b50?, 0x2?, 0x38?, 0xf0?, 0xc0002d1924?)"
1715940344809,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc0002d17c0 sp=0xc0002d17a0 pc=0x4466ae
1715940344809,"runtime.selectgo(0xc0002d1b50, 0xc0002d1920, 0xc0002d1b70?, 0x0, 0x1?, 0x1)"
1715940344809,	/usr/local/go/src/runtime/select.go:327 +0x725 fp=0xc0002d18e0 sp=0xc0002d17c0 pc=0x458525
1715940344809,github.com/dunglas/frankenphp.go_frankenphp_worker_handle_request_start(0x6)
1715940344809,	/go/src/app/worker.go:150 +0x276 fp=0xc0002d1bc8 sp=0xc0002d18e0 pc=0x16660d6
1715940344809,_cgoexp_b7d6fd74a0c8_go_frankenphp_worker_handle_request_start(0x7f76d5ffc2c0)
1715940344809,	_cgo_gotypes.go:1040 +0x1e fp=0xc0002d1be0 sp=0xc0002d1bc8 pc=0x1667dbe
1715940344809,"runtime.cgocallbackg1(0x1667da0, 0x7f76d5ffc2c0, 0x0)"
1715940344809,	/usr/local/go/src/runtime/cgocall.go:403 +0x2a5 fp=0xc0002d1ca0 sp=0xc0002d1be0 pc=0x40d3c5
1715940344809,"runtime.cgocallbackg(0x1667da0, 0x7f76d5ffc2c0, 0x0)"
1715940344809,	/usr/local/go/src/runtime/cgocall.go:322 +0x136 fp=0xc0002d1d18 sp=0xc0002d1ca0 pc=0x40d076
1715940344809,"runtime.cgocallbackg(0x1667da0, 0x7f76d5ffc2c0, 0x0)"
1715940344809,	<autogenerated>:1 +0x29 fp=0xc0002d1d40 sp=0xc0002d1d18 pc=0x481189
1715940344809,"runtime.cgocallback(0xc0002d1da0, 0x40ccb5, 0x17e8980)"
1715940344809,	/usr/local/go/src/runtime/asm_amd64.s:1079 +0xcc fp=0xc0002d1d68 sp=0xc0002d1d40 pc=0x47e7cc
1715940344809,runtime.systemstack_switch()
1715940344809,	/usr/local/go/src/runtime/asm_amd64.s:474 +0x8 fp=0xc0002d1d78 sp=0xc0002d1d68 pc=0x47ca08
1715940344809,"runtime.cgocall(0x17e8980, 0xc0002d1dd8)"
1715940344809,	/usr/local/go/src/runtime/cgocall.go:175 +0x75 fp=0xc0002d1db0 sp=0xc0002d1d78 pc=0x40ccb5
1715940344809,github.com/dunglas/frankenphp._Cfunc_frankenphp_execute_script(0x7f76c4096690)
1715940344809,	_cgo_gotypes.go:801 +0x47 fp=0xc0002d1dd8 sp=0xc0002d1db0 pc=0x165f547
1715940344809,github.com/dunglas/frankenphp.go_execute_script(0x47ca01?)
1715940344809,	/go/src/app/frankenphp.go:511 +0x133 fp=0xc0002d1e40 sp=0xc0002d1dd8 pc=0x1662593
1715940344809,_cgoexp_b7d6fd74a0c8_go_execute_script(0x1eb5e48?)
1715940344809,	_cgo_gotypes.go:933 +0x16 fp=0xc0002d1e58 sp=0xc0002d1e40 pc=0x1667a36
1715940344809,"runtime.cgocallbackg1(0x1667a20, 0x7f76d5ffea40, 0x0)"
1715940344809,	/usr/local/go/src/runtime/cgocall.go:403 +0x2a5 fp=0xc0002d1f18 sp=0xc0002d1e58 pc=0x40d3c5
1715940344809,"runtime.cgocallbackg(0x1667a20, 0x7f76d5ffea40, 0x0)"
1715940344809,	/usr/local/go/src/runtime/cgocall.go:322 +0x136 fp=0xc0002d1f90 sp=0xc0002d1f18 pc=0x40d076
1715940344809,"runtime.cgocallbackg(0x1667a20, 0x7f76d5ffea40, 0x0)"
1715940344809,	<autogenerated>:1 +0x29 fp=0xc0002d1fb8 sp=0xc0002d1f90 pc=0x481189
1715940344809,"runtime.cgocallback(0x0, 0x0, 0x0)"
1715940344810,	/usr/local/go/src/runtime/asm_amd64.s:1079 +0xcc fp=0xc0002d1fe0 sp=0xc0002d1fb8 pc=0x47e7cc
1715940344810,runtime.goexit({})
1715940344810,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc0002d1fe8 sp=0xc0002d1fe0 pc=0x47ea21
1715940344810,"goroutine 52 gp=0xc0007248c0 m=nil [select, locked to thread]:"
1715940344810,"runtime.gopark(0xc00092fb50?, 0x2?, 0x38?, 0xf0?, 0xc00092f924?)"
1715940344810,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc00092f7c0 sp=0xc00092f7a0 pc=0x4466ae
1715940344810,"runtime.selectgo(0xc00092fb50, 0xc00092f920, 0xc00092fb70?, 0x0, 0x1?, 0x1)"
1715940344810,	/usr/local/go/src/runtime/select.go:327 +0x725 fp=0xc00092f8e0 sp=0xc00092f7c0 pc=0x458525
1715940344810,github.com/dunglas/frankenphp.go_frankenphp_worker_handle_request_start(0xfb0)
1715940344810,	/go/src/app/worker.go:150 +0x276 fp=0xc00092fbc8 sp=0xc00092f8e0 pc=0x16660d6
1715940344810,_cgoexp_b7d6fd74a0c8_go_frankenphp_worker_handle_request_start(0x7f76d41f92c0)
1715940344810,	_cgo_gotypes.go:1040 +0x1e fp=0xc00092fbe0 sp=0xc00092fbc8 pc=0x1667dbe
1715940344810,"runtime.cgocallbackg1(0x1667da0, 0x7f76d41f92c0, 0x0)"
1715940344810,	/usr/local/go/src/runtime/cgocall.go:403 +0x2a5 fp=0xc00092fca0 sp=0xc00092fbe0 pc=0x40d3c5
1715940344810,"runtime.cgocallbackg(0x1667da0, 0x7f76d41f92c0, 0x0)"
1715940344810,	/usr/local/go/src/runtime/cgocall.go:322 +0x136 fp=0xc00092fd18 sp=0xc00092fca0 pc=0x40d076
1715940344810,"runtime.cgocallbackg(0x1667da0, 0x7f76d41f92c0, 0x0)"
1715940344810,	<autogenerated>:1 +0x29 fp=0xc00092fd40 sp=0xc00092fd18 pc=0x481189
1715940344810,"runtime.cgocallback(0xc00092fda0, 0x40ccb5, 0x17e8980)"
1715940344810,	/usr/local/go/src/runtime/asm_amd64.s:1079 +0xcc fp=0xc00092fd68 sp=0xc00092fd40 pc=0x47e7cc
1715940344810,runtime.systemstack_switch()
1715940344810,	/usr/local/go/src/runtime/asm_amd64.s:474 +0x8 fp=0xc00092fd78 sp=0xc00092fd68 pc=0x47ca08
1715940344810,"runtime.cgocall(0x17e8980, 0xc00092fdd8)"
1715940344810,	/usr/local/go/src/runtime/cgocall.go:175 +0x75 fp=0xc00092fdb0 sp=0xc00092fd78 pc=0x40ccb5
1715940344810,github.com/dunglas/frankenphp._Cfunc_frankenphp_execute_script(0x7f76c81d9bf0)
1715940344810,	_cgo_gotypes.go:801 +0x47 fp=0xc00092fdd8 sp=0xc00092fdb0 pc=0x165f547
1715940344810,github.com/dunglas/frankenphp.go_execute_script(0x47ca01?)
1715940344810,	/go/src/app/frankenphp.go:511 +0x133 fp=0xc00092fe40 sp=0xc00092fdd8 pc=0x1662593
1715940344810,_cgoexp_b7d6fd74a0c8_go_execute_script(0x44f759?)
1715940344810,	_cgo_gotypes.go:933 +0x16 fp=0xc00092fe58 sp=0xc00092fe40 pc=0x1667a36
1715940344810,"runtime.cgocallbackg1(0x1667a20, 0x7f76d41fba40, 0x0)"
1715940344810,	/usr/local/go/src/runtime/cgocall.go:403 +0x2a5 fp=0xc00092ff18 sp=0xc00092fe58 pc=0x40d3c5
1715940344810,"runtime.cgocallbackg(0x1667a20, 0x7f76d41fba40, 0x0)"
1715940344810,	/usr/local/go/src/runtime/cgocall.go:322 +0x136 fp=0xc00092ff90 sp=0xc00092ff18 pc=0x40d076
1715940344810,"runtime.cgocallbackg(0x1667a20, 0x7f76d41fba40, 0x0)"
1715940344810,	<autogenerated>:1 +0x29 fp=0xc00092ffb8 sp=0xc00092ff90 pc=0x481189
1715940344810,"runtime.cgocallback(0x0, 0x0, 0x0)"
1715940344810,	/usr/local/go/src/runtime/asm_amd64.s:1079 +0xcc fp=0xc00092ffe0 sp=0xc00092ffb8 pc=0x47e7cc
1715940344810,runtime.goexit({})
1715940344810,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00092ffe8 sp=0xc00092ffe0 pc=0x47ea21
1715940344810,"goroutine 53 gp=0xc0002b8c40 m=12 mp=0xc0002e2008 [syscall, locked to thread]:"
1715940344810,runtime.goexit({})
1715940344810,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc0002ccfe8 sp=0xc0002ccfe0 pc=0x47ea21
1715940344810,"goroutine 54 gp=0xc000724e00 m=nil [select, locked to thread]:"
1715940344810,"runtime.gopark(0xc000094b50?, 0x2?, 0x38?, 0xf0?, 0xc000094924?)"
1715940344810,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc0000947c0 sp=0xc0000947a0 pc=0x4466ae
1715940344810,"runtime.selectgo(0xc000094b50, 0xc000094920, 0xc000094b70?, 0x0, 0x1?, 0x1)"
1715940344810,	/usr/local/go/src/runtime/select.go:327 +0x725 fp=0xc0000948e0 sp=0xc0000947c0 pc=0x458525
1715940344810,github.com/dunglas/frankenphp.go_frankenphp_worker_handle_request_start(0xfa8)
1715940344810,	/go/src/app/worker.go:150 +0x276 fp=0xc000094bc8 sp=0xc0000948e0 pc=0x16660d6
1715940344810,_cgoexp_b7d6fd74a0c8_go_frankenphp_worker_handle_request_start(0x7f76d4bfa2c0)
1715940344810,	_cgo_gotypes.go:1040 +0x1e fp=0xc000094be0 sp=0xc000094bc8 pc=0x1667dbe
1715940344810,"runtime.cgocallbackg1(0x1667da0, 0x7f76d4bfa2c0, 0x0)"
1715940344810,	/usr/local/go/src/runtime/cgocall.go:403 +0x2a5 fp=0xc000094ca0 sp=0xc000094be0 pc=0x40d3c5
1715940344810,"runtime.cgocallbackg(0x1667da0, 0x7f76d4bfa2c0, 0x0)"
1715940344810,	/usr/local/go/src/runtime/cgocall.go:322 +0x136 fp=0xc000094d18 sp=0xc000094ca0 pc=0x40d076
1715940344810,"runtime.cgocallbackg(0x1667da0, 0x7f76d4bfa2c0, 0x0)"
1715940344810,	<autogenerated>:1 +0x29 fp=0xc000094d40 sp=0xc000094d18 pc=0x481189
1715940344810,"runtime.cgocallback(0xc000094da0, 0x40ccb5, 0x17e8980)"
1715940344810,	/usr/local/go/src/runtime/asm_amd64.s:1079 +0xcc fp=0xc000094d68 sp=0xc000094d40 pc=0x47e7cc
1715940344810,runtime.systemstack_switch()
1715940344810,	/usr/local/go/src/runtime/asm_amd64.s:474 +0x8 fp=0xc000094d78 sp=0xc000094d68 pc=0x47ca08
1715940344810,"runtime.cgocall(0x17e8980, 0xc000094dd8)"
1715940344810,	/usr/local/go/src/runtime/cgocall.go:175 +0x75 fp=0xc000094db0 sp=0xc000094d78 pc=0x40ccb5
1715940344810,github.com/dunglas/frankenphp._Cfunc_frankenphp_execute_script(0x7f76b8096e90)
1715940344810,	_cgo_gotypes.go:801 +0x47 fp=0xc000094dd8 sp=0xc000094db0 pc=0x165f547
1715940344810,github.com/dunglas/frankenphp.go_execute_script(0x47ca01?)
1715940344810,	/go/src/app/frankenphp.go:511 +0x133 fp=0xc000094e40 sp=0xc000094dd8 pc=0x1662593
1715940344811,_cgoexp_b7d6fd74a0c8_go_execute_script(0x1eb5e48?)
1715940344811,	_cgo_gotypes.go:933 +0x16 fp=0xc000094e58 sp=0xc000094e40 pc=0x1667a36
1715940344811,"runtime.cgocallbackg1(0x1667a20, 0x7f76d4bfca40, 0x0)"
1715940344811,	/usr/local/go/src/runtime/cgocall.go:403 +0x2a5 fp=0xc000094f18 sp=0xc000094e58 pc=0x40d3c5
1715940344811,"runtime.cgocallbackg(0x1667a20, 0x7f76d4bfca40, 0x0)"
1715940344811,	/usr/local/go/src/runtime/cgocall.go:322 +0x136 fp=0xc000094f90 sp=0xc000094f18 pc=0x40d076
1715940344811,"runtime.cgocallbackg(0x1667a20, 0x7f76d4bfca40, 0x0)"
1715940344811,	<autogenerated>:1 +0x29 fp=0xc000094fb8 sp=0xc000094f90 pc=0x481189
1715940344811,"runtime.cgocallback(0x0, 0x0, 0x0)"
1715940344811,	/usr/local/go/src/runtime/asm_amd64.s:1079 +0xcc fp=0xc000094fe0 sp=0xc000094fb8 pc=0x47e7cc
1715940344811,runtime.goexit({})
1715940344811,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000094fe8 sp=0xc000094fe0 pc=0x47ea21
1715940344811,"goroutine 2921 gp=0xc00077e1c0 m=nil [IO wait, 2 minutes]:"
1715940344811,"runtime.gopark(0x92?, 0xc000599958?, 0x40?, 0x99?, 0xb?)"
1715940344811,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc00092d910 sp=0xc00092d8f0 pc=0x4466ae
1715940344811,"runtime.netpollblock(0x4a2f18?, 0x40c426?, 0x0?)"
1715940344811,	/usr/local/go/src/runtime/netpoll.go:573 +0xf7 fp=0xc00092d948 sp=0xc00092d910 pc=0x43e7d7
1715940344811,"internal/poll.runtime_pollWait(0x7f770d46e008, 0x72)"
1715940344811,	/usr/local/go/src/runtime/netpoll.go:345 +0x85 fp=0xc00092d968 sp=0xc00092d948 pc=0x478b05
1715940344811,"internal/poll.(*pollDesc).wait(0xc00041c800?, 0xc0004f0000?, 0x0)"
1715940344811,	/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc00092d990 sp=0xc00092d968 pc=0x531cc7
1715940344811,internal/poll.(*pollDesc).waitRead(...)
1715940344811,	/usr/local/go/src/internal/poll/fd_poll_runtime.go:89
1715940344811,"internal/poll.(*FD).Read(0xc00041c800, {0xc0004f0000, 0x1000, 0x1000})"
1715940344811,	/usr/local/go/src/internal/poll/fd_unix.go:164 +0x27a fp=0xc00092da28 sp=0xc00092d990 pc=0x532fba
1715940344811,"net.(*netFD).Read(0xc00041c800, {0xc0004f0000?, 0xc000599a98?, 0x532185?})"
1715940344811,	/usr/local/go/src/net/fd_posix.go:55 +0x25 fp=0xc00092da70 sp=0xc00092da28 pc=0x5e90c5
1715940344811,"net.(*conn).Read(0xc0001601f8, {0xc0004f0000?, 0x0?, 0xc000125928?})"
1715940344811,	/usr/local/go/src/net/net.go:179 +0x45 fp=0xc00092dab8 sp=0xc00092da70 pc=0x5fc645
1715940344811,"net.(*TCPConn).Read(0xc000125920?, {0xc0004f0000?, 0xc00041c800?, 0xc000599af0?})"
1715940344811,	<autogenerated>:1 +0x25 fp=0xc00092dae8 sp=0xc00092dab8 pc=0x60f265
1715940344811,"net/http.(*connReader).Read(0xc000125920, {0xc0004f0000, 0x1000, 0x1000})"
1715940344811,	/usr/local/go/src/net/http/server.go:789 +0x14b fp=0xc00092db38 sp=0xc00092dae8 pc=0x7407ab
1715940344811,bufio.(*Reader).fill(0xc000128a80)
1715940344811,	/usr/local/go/src/bufio/bufio.go:110 +0x103 fp=0xc00092db70 sp=0xc00092db38 pc=0x6bdf63
1715940344811,"bufio.(*Reader).Peek(0xc000128a80, 0x4)"
1715940344811,	/usr/local/go/src/bufio/bufio.go:148 +0x53 fp=0xc00092db90 sp=0xc00092db70 pc=0x6be093
1715940344811,"net/http.(*conn).serve(0xc00045f950, {0x2154d98, 0xc000125890})"
1715940344811,	/usr/local/go/src/net/http/server.go:2074 +0x749 fp=0xc00092dfb8 sp=0xc00092db90 pc=0x746509
1715940344811,net/http.(*Server).Serve.gowrap3()
1715940344811,	/usr/local/go/src/net/http/server.go:3285 +0x28 fp=0xc00092dfe0 sp=0xc00092dfb8 pc=0x74b8e8
1715940344811,runtime.goexit({})
1715940344811,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00092dfe8 sp=0xc00092dfe0 pc=0x47ea21
1715940344811,created by net/http.(*Server).Serve in goroutine 40
1715940344811,	/usr/local/go/src/net/http/server.go:3285 +0x4b4
1715940344811,goroutine 550 gp=0xc000682e00 m=nil [IO wait]:
1715940344811,"runtime.gopark(0x19e?, 0xc000599958?, 0x40?, 0x99?, 0xb?)"
1715940344811,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc000599910 sp=0xc0005998f0 pc=0x4466ae
1715940344811,"runtime.netpollblock(0x4a2f18?, 0x40c426?, 0x0?)"
1715940344811,	/usr/local/go/src/runtime/netpoll.go:573 +0xf7 fp=0xc000599948 sp=0xc000599910 pc=0x43e7d7
1715940344811,"internal/poll.runtime_pollWait(0x7f770d46e3e8, 0x72)"
1715940344811,	/usr/local/go/src/runtime/netpoll.go:345 +0x85 fp=0xc000599968 sp=0xc000599948 pc=0x478b05
1715940344811,"internal/poll.(*pollDesc).wait(0xc0005f8280?, 0xc000775000?, 0x0)"
1715940344811,	/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000599990 sp=0xc000599968 pc=0x531cc7
1715940344811,internal/poll.(*pollDesc).waitRead(...)
1715940344811,	/usr/local/go/src/internal/poll/fd_poll_runtime.go:89
1715940344811,"internal/poll.(*FD).Read(0xc0005f8280, {0xc000775000, 0x1000, 0x1000})"
1715940344811,	/usr/local/go/src/internal/poll/fd_unix.go:164 +0x27a fp=0xc000599a28 sp=0xc000599990 pc=0x532fba
1715940344811,"net.(*netFD).Read(0xc0005f8280, {0xc000775000?, 0xc000599a98?, 0x532185?})"
1715940344811,	/usr/local/go/src/net/fd_posix.go:55 +0x25 fp=0xc000599a70 sp=0xc000599a28 pc=0x5e90c5
1715940344811,"net.(*conn).Read(0xc00007ed68, {0xc000775000?, 0x0?, 0xc00062f898?})"
1715940344811,	/usr/local/go/src/net/net.go:179 +0x45 fp=0xc000599ab8 sp=0xc000599a70 pc=0x5fc645
1715940344811,"net.(*TCPConn).Read(0xc00062f890?, {0xc000775000?, 0xc0005f8280?, 0xc000599af0?})"
1715940344811,	<autogenerated>:1 +0x25 fp=0xc000599ae8 sp=0xc000599ab8 pc=0x60f265
1715940344811,"net/http.(*connReader).Read(0xc00062f890, {0xc000775000, 0x1000, 0x1000})"
1715940344811,	/usr/local/go/src/net/http/server.go:789 +0x14b fp=0xc000599b38 sp=0xc000599ae8 pc=0x7407ab
1715940344811,bufio.(*Reader).fill(0xc000486a80)
1715940344812,	/usr/local/go/src/bufio/bufio.go:110 +0x103 fp=0xc000599b70 sp=0xc000599b38 pc=0x6bdf63
1715940344812,"bufio.(*Reader).Peek(0xc000486a80, 0x4)"
1715940344812,	/usr/local/go/src/bufio/bufio.go:148 +0x53 fp=0xc000599b90 sp=0xc000599b70 pc=0x6be093
1715940344812,"net/http.(*conn).serve(0xc0005b7440, {0x2154d98, 0xc00062f830})"
1715940344812,	/usr/local/go/src/net/http/server.go:2074 +0x749 fp=0xc000599fb8 sp=0xc000599b90 pc=0x746509
1715940344812,net/http.(*Server).Serve.gowrap3()
1715940344812,	/usr/local/go/src/net/http/server.go:3285 +0x28 fp=0xc000599fe0 sp=0xc000599fb8 pc=0x74b8e8
1715940344812,runtime.goexit({})
1715940344812,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000599fe8 sp=0xc000599fe0 pc=0x47ea21
1715940344812,created by net/http.(*Server).Serve in goroutine 40
1715940344812,	/usr/local/go/src/net/http/server.go:3285 +0x4b4
1715940344812,goroutine 3118 gp=0xc0006a4380 m=nil [IO wait]:
1715940344812,"runtime.gopark(0x92?, 0xc000595958?, 0x40?, 0x59?, 0xb?)"
1715940344812,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc000595910 sp=0xc0005958f0 pc=0x4466ae
1715940344812,"runtime.netpollblock(0x4a2f18?, 0x40c426?, 0x0?)"
1715940344812,	/usr/local/go/src/runtime/netpoll.go:573 +0xf7 fp=0xc000595948 sp=0xc000595910 pc=0x43e7d7
1715940344812,"internal/poll.runtime_pollWait(0x7f770d46e4e0, 0x72)"
1715940344812,	/usr/local/go/src/runtime/netpoll.go:345 +0x85 fp=0xc000595968 sp=0xc000595948 pc=0x478b05
1715940344812,"internal/poll.(*pollDesc).wait(0xc000666f80?, 0xc0004fe000?, 0x0)"
1715940344812,	/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000595990 sp=0xc000595968 pc=0x531cc7
1715940344812,internal/poll.(*pollDesc).waitRead(...)
1715940344812,	/usr/local/go/src/internal/poll/fd_poll_runtime.go:89
1715940344812,"internal/poll.(*FD).Read(0xc000666f80, {0xc0004fe000, 0x1000, 0x1000})"
1715940344812,	/usr/local/go/src/internal/poll/fd_unix.go:164 +0x27a fp=0xc000595a28 sp=0xc000595990 pc=0x532fba
1715940344812,"net.(*netFD).Read(0xc000666f80, {0xc0004fe000?, 0xc000595a98?, 0x532185?})"
1715940344812,	/usr/local/go/src/net/fd_posix.go:55 +0x25 fp=0xc000595a70 sp=0xc000595a28 pc=0x5e90c5
1715940344812,"net.(*conn).Read(0xc00007ed28, {0xc0004fe000?, 0x0?, 0xc00065df58?})"
1715940344812,	/usr/local/go/src/net/net.go:179 +0x45 fp=0xc000595ab8 sp=0xc000595a70 pc=0x5fc645
1715940344812,"net.(*TCPConn).Read(0xc00065df50?, {0xc0004fe000?, 0xc000666f80?, 0xc000595af0?})"
1715940344812,	<autogenerated>:1 +0x25 fp=0xc000595ae8 sp=0xc000595ab8 pc=0x60f265
1715940344812,"net/http.(*connReader).Read(0xc00065df50, {0xc0004fe000, 0x1000, 0x1000})"
1715940344812,	/usr/local/go/src/net/http/server.go:789 +0x14b fp=0xc000595b38 sp=0xc000595ae8 pc=0x7407ab
1715940344812,bufio.(*Reader).fill(0xc00034f140)
1715940344812,	/usr/local/go/src/bufio/bufio.go:110 +0x103 fp=0xc000595b70 sp=0xc000595b38 pc=0x6bdf63
1715940344812,"bufio.(*Reader).Peek(0xc00034f140, 0x4)"
1715940344812,	/usr/local/go/src/bufio/bufio.go:148 +0x53 fp=0xc000595b90 sp=0xc000595b70 pc=0x6be093
1715940344812,"net/http.(*conn).serve(0xc0005f4bd0, {0x2154d98, 0xc000158cf0})"
1715940344812,	/usr/local/go/src/net/http/server.go:2074 +0x749 fp=0xc000595fb8 sp=0xc000595b90 pc=0x746509
1715940344812,net/http.(*Server).Serve.gowrap3()
1715940344812,	/usr/local/go/src/net/http/server.go:3285 +0x28 fp=0xc000595fe0 sp=0xc000595fb8 pc=0x74b8e8
1715940344812,runtime.goexit({})
1715940344812,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000595fe8 sp=0xc000595fe0 pc=0x47ea21
1715940344812,created by net/http.(*Server).Serve in goroutine 40
1715940344812,	/usr/local/go/src/net/http/server.go:3285 +0x4b4
1715940344812,"goroutine 3221 gp=0xc0006a4e00 m=nil [IO wait, 2 minutes]:"
1715940344812,"runtime.gopark(0x92?, 0xc0005d1958?, 0x40?, 0x19?, 0xb?)"
1715940344812,	/usr/local/go/src/runtime/proc.go:402 +0xce fp=0xc000717910 sp=0xc0007178f0 pc=0x4466ae
1715940344812,"runtime.netpollblock(0x4a2f18?, 0x40c426?, 0x0?)"
1715940344812,	/usr/local/go/src/runtime/netpoll.go:573 +0xf7 fp=0xc000717948 sp=0xc000717910 pc=0x43e7d7
1715940344812,"internal/poll.runtime_pollWait(0x7f770d46e2f0, 0x72)"
1715940344812,	/usr/local/go/src/runtime/netpoll.go:345 +0x85 fp=0xc000717968 sp=0xc000717948 pc=0x478b05
1715940344812,"internal/poll.(*pollDesc).wait(0xc00041ca00?, 0xc00002e000?, 0x0)"
1715940344812,	/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000717990 sp=0xc000717968 pc=0x531cc7
1715940344812,internal/poll.(*pollDesc).waitRead(...)
1715940344812,	/usr/local/go/src/internal/poll/fd_poll_runtime.go:89
1715940344812,"internal/poll.(*FD).Read(0xc00041ca00, {0xc00002e000, 0x1000, 0x1000})"
1715940344812,	/usr/local/go/src/internal/poll/fd_unix.go:164 +0x27a fp=0xc000717a28 sp=0xc000717990 pc=0x532fba
1715940344812,"net.(*netFD).Read(0xc00041ca00, {0xc00002e000?, 0xc0005d1a98?, 0x532185?})"
1715940344812,	/usr/local/go/src/net/fd_posix.go:55 +0x25 fp=0xc000717a70 sp=0xc000717a28 pc=0x5e90c5
1715940344812,"net.(*conn).Read(0xc00007f238, {0xc00002e000?, 0x0?, 0xc00033b0b8?})"
1715940344812,	/usr/local/go/src/net/net.go:179 +0x45 fp=0xc000717ab8 sp=0xc000717a70 pc=0x5fc645
1715940344812,"net.(*TCPConn).Read(0xc00033b0b0?, {0xc00002e000?, 0xc00041ca00?, 0xc0005d1af0?})"
1715940344812,	<autogenerated>:1 +0x25 fp=0xc000717ae8 sp=0xc000717ab8 pc=0x60f265
1715940344812,"net/http.(*connReader).Read(0xc00033b0b0, {0xc00002e000, 0x1000, 0x1000})"
1715940344812,	/usr/local/go/src/net/http/server.go:789 +0x14b fp=0xc000717b38 sp=0xc000717ae8 pc=0x7407ab
1715940344812,bufio.(*Reader).fill(0xc0001283c0)
1715940344812,	/usr/local/go/src/bufio/bufio.go:110 +0x103 fp=0xc000717b70 sp=0xc000717b38 pc=0x6bdf63
1715940344812,"bufio.(*Reader).Peek(0xc0001283c0, 0x4)"
1715940344812,	/usr/local/go/src/bufio/bufio.go:148 +0x53 fp=0xc000717b90 sp=0xc000717b70 pc=0x6be093
1715940344813,"net/http.(*conn).serve(0xc0005b7ef0, {0x2154d98, 0xc0005595f0})"
1715940344813,	/usr/local/go/src/net/http/server.go:2074 +0x749 fp=0xc000717fb8 sp=0xc000717b90 pc=0x746509
1715940344813,net/http.(*Server).Serve.gowrap3()
1715940344813,	/usr/local/go/src/net/http/server.go:3285 +0x28 fp=0xc000717fe0 sp=0xc000717fb8 pc=0x74b8e8
1715940344813,runtime.goexit({})
1715940344813,	/usr/local/go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000717fe8 sp=0xc000717fe0 pc=0x47ea21
1715940344813,created by net/http.(*Server).Serve in goroutine 40
1715940344813,	/usr/local/go/src/net/http/server.go:3285 +0x4b4
1715940344813,rax    0x0
1715940344813,rbx    0x20
1715940344813,rcx    0x7f7759f6ce2c
1715940344813,rdx    0x6
1715940344813,rdi    0x1
1715940344813,rsi    0x20
1715940344813,rbp    0x7f76d37fb6c0
1715940344813,rsp    0x7f76d37fa640
1715940344813,r8     0xffffffff
1715940344813,r9     0x0
1715940344813,r10    0x8
1715940344813,r11    0x246
1715940344813,r12    0x6
1715940344813,r13    0x7f775b1b9000
1715940344817,r14    0x1
1715940344817,r15    0x1
1715940344817,rip    0x7f7759f6ce2c
1715940344817,rflags 0x246
1715940344817,cs     0x33
1715940344817,fs     0x0
1715940344817,gs     0x0

@magnetik magnetik changed the title malloc(): unaligned tcache chunk detected and corrupted double-linked list SIGABRT malloc(): unaligned tcache chunk detected and corrupted double-linked list May 17, 2024
@withinboredom
Copy link
Collaborator

withinboredom commented May 17, 2024

Yeah, it's very unlikely this is hardware failure related (it wouldn't be the first time I'd ever seen hardware fail in AWS, but they're pretty good at flagging the machine and telling you it is broken).

The stack trace indicates the error is happening on the C side of the code and not the Go side.

Looking at your phpinfo, the only thing that stands out to me is the Tideways extension. You can try to disable the Tideways extension and see if the error still shows up, or a better solution would be to run both and see if the problem only shows up on Tideways enabled systems; if we wanted to play a game of disabling things until we're sure which component is causing the problem.

If you can keep the container running, I'm reasonably sure that the kernel will do a core dump on this error which we can load in a debugger, but you need to make sure you set ulimit -c unlimited, before starting frankenphp and a dump should appear in the working directory.

@magnetik
Copy link
Author

The phpinfo in the first comment comes from my first test with tideways enabled, but I've removed it since, and I still have this error (I'll edit my first post).

@withinboredom
Copy link
Collaborator

Just to be clear, you are only seeing this in aws and cannot reproduce it locally?

@magnetik
Copy link
Author

magnetik commented May 22, 2024

I was unable to reproduce locally indeed.

I've tried to deactivate pcntl extension (because I've seen a recent bug about it), and still the same crash.

I'll try to see if I can collect a crash dump (but it's not an easy task because AWS terminates the container automatically so I need some code to upload it to s3 or something).

@dunglas
Copy link
Owner

dunglas commented May 22, 2024

If you can take a shell on the server, you can use GDB and attach it to the process and gather a stack trace directly.

@magnetik
Copy link
Author

Will do this ! I'll keep in touch

@dunglas
Copy link
Owner

dunglas commented Jun 6, 2024

We refactored some code and it seems that similar issues are gone. Would you mind testing if the crash still happens for you?

@magnetik
Copy link
Author

I'll try again today. Thanks

@magnetik
Copy link
Author

Still the same issue with image dunglas/frankenphp:1.2.0-php8.3.7 : malloc(): unaligned tcache chunk detected.

@dunglas
Copy link
Owner

dunglas commented Jun 12, 2024

Sad! Could you try to gather a stack trace?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants