2026-02-13T02:26:08.862 INFO:root:teuthology version: 1.2.4.dev9+ga2c505dae 2026-02-13T02:26:08.879 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T02:26:08.961 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48001 branch: wip-pdonnell-testing-20260210.171210 description: fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/forward-scrub} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '48001' kernel: sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected - object missing on disk - Invalid tag char sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: cfcf307502511ba51c39a8b9085c2fcde505d421 owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7166 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 604/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: cfcf307502511ba51c39a8b9085c2fcde505d421 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial121.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKvc2fwMSPKZtOBjHBiIYpDC0U+qmHf3H7mEkngTAChiI6yS3y1W02Mr4smmsXUrx/pbfDEKbRplWFe13YhXDjk= trial178.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ/3TPcS+jR1KdbTSgvdeQ/H86TCVeOPawwkyklb68zex6A9+I2TTe8kX3hBZhDnKKZXjS7FtPZG87yoxSz3g/4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: kernel-fix-3 teuthology_sha1: a2c505dae37458c5537fa44f1320bd04eef25bb1 timestamp: 2026-02-13_01:53:26 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-13T02:26:08.961 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa; will attempt to use it 2026-02-13T02:26:08.962 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks 2026-02-13T02:26:08.962 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-13T02:26:08.963 INFO:teuthology.task.internal:Checking packages... 2026-02-13T02:26:08.964 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-13T02:26:08.964 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-13T02:26:08.964 INFO:teuthology.packaging:ref: None 2026-02-13T02:26:08.964 INFO:teuthology.packaging:tag: None 2026-02-13T02:26:08.964 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-13T02:26:08.964 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T02:26:08.964 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-13T02:26:09.087 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241-g8f8d3829-1jammy 2026-02-13T02:26:09.088 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-13T02:26:09.100 INFO:teuthology.task.internal:no buildpackages task found 2026-02-13T02:26:09.101 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-13T02:26:09.114 INFO:teuthology.task.internal:Saving configuration 2026-02-13T02:26:09.131 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-13T02:26:09.142 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-13T02:26:09.220 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial121.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48001', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 02:22:46.088180', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILWuTUB9yOQIi7cxeCZEtiursKKj4O6A0MS2YJ+n8o48'} 2026-02-13T02:26:09.275 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial178.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48001', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 02:22:46.088811', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPAurZ5t2iygrxJ3lEa4p1O5r0pAurT+iG9l7/xScRq5'} 2026-02-13T02:26:09.275 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-13T02:26:09.287 INFO:teuthology.task.internal:roles: ubuntu@trial121.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2026-02-13T02:26:09.287 INFO:teuthology.task.internal:roles: ubuntu@trial178.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2026-02-13T02:26:09.287 INFO:teuthology.run_tasks:Running task console_log... 2026-02-13T02:26:09.417 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x71edbf3c7f60>, signals=[15]) 2026-02-13T02:26:09.417 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-13T02:26:09.427 INFO:teuthology.task.internal:Opening connections... 2026-02-13T02:26:09.428 DEBUG:teuthology.task.internal:connecting to ubuntu@trial121.front.sepia.ceph.com 2026-02-13T02:26:09.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T02:26:09.491 DEBUG:teuthology.task.internal:connecting to ubuntu@trial178.front.sepia.ceph.com 2026-02-13T02:26:09.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T02:26:09.553 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-13T02:26:09.565 DEBUG:teuthology.orchestra.run.trial121:> uname -m 2026-02-13T02:26:09.568 INFO:teuthology.orchestra.run.trial121.stdout:x86_64 2026-02-13T02:26:09.569 DEBUG:teuthology.orchestra.run.trial121:> cat /etc/os-release 2026-02-13T02:26:09.614 INFO:teuthology.orchestra.run.trial121.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-13T02:26:09.614 INFO:teuthology.orchestra.run.trial121.stdout:NAME="Ubuntu" 2026-02-13T02:26:09.614 INFO:teuthology.orchestra.run.trial121.stdout:VERSION_ID="22.04" 2026-02-13T02:26:09.614 INFO:teuthology.orchestra.run.trial121.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-13T02:26:09.614 INFO:teuthology.orchestra.run.trial121.stdout:VERSION_CODENAME=jammy 2026-02-13T02:26:09.614 INFO:teuthology.orchestra.run.trial121.stdout:ID=ubuntu 2026-02-13T02:26:09.614 INFO:teuthology.orchestra.run.trial121.stdout:ID_LIKE=debian 2026-02-13T02:26:09.614 INFO:teuthology.orchestra.run.trial121.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-13T02:26:09.614 INFO:teuthology.orchestra.run.trial121.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-13T02:26:09.614 INFO:teuthology.orchestra.run.trial121.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-13T02:26:09.614 INFO:teuthology.orchestra.run.trial121.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-13T02:26:09.614 INFO:teuthology.orchestra.run.trial121.stdout:UBUNTU_CODENAME=jammy 2026-02-13T02:26:09.615 INFO:teuthology.lock.ops:Updating trial121.front.sepia.ceph.com on lock server 2026-02-13T02:26:09.680 DEBUG:teuthology.orchestra.run.trial178:> uname -m 2026-02-13T02:26:09.684 INFO:teuthology.orchestra.run.trial178.stdout:x86_64 2026-02-13T02:26:09.684 DEBUG:teuthology.orchestra.run.trial178:> cat /etc/os-release 2026-02-13T02:26:09.730 INFO:teuthology.orchestra.run.trial178.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-13T02:26:09.730 INFO:teuthology.orchestra.run.trial178.stdout:NAME="Ubuntu" 2026-02-13T02:26:09.730 INFO:teuthology.orchestra.run.trial178.stdout:VERSION_ID="22.04" 2026-02-13T02:26:09.730 INFO:teuthology.orchestra.run.trial178.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-13T02:26:09.730 INFO:teuthology.orchestra.run.trial178.stdout:VERSION_CODENAME=jammy 2026-02-13T02:26:09.730 INFO:teuthology.orchestra.run.trial178.stdout:ID=ubuntu 2026-02-13T02:26:09.730 INFO:teuthology.orchestra.run.trial178.stdout:ID_LIKE=debian 2026-02-13T02:26:09.730 INFO:teuthology.orchestra.run.trial178.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-13T02:26:09.730 INFO:teuthology.orchestra.run.trial178.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-13T02:26:09.730 INFO:teuthology.orchestra.run.trial178.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-13T02:26:09.730 INFO:teuthology.orchestra.run.trial178.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-13T02:26:09.730 INFO:teuthology.orchestra.run.trial178.stdout:UBUNTU_CODENAME=jammy 2026-02-13T02:26:09.730 INFO:teuthology.lock.ops:Updating trial178.front.sepia.ceph.com on lock server 2026-02-13T02:26:09.800 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-13T02:26:09.814 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-13T02:26:09.825 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-13T02:26:09.825 DEBUG:teuthology.orchestra.run.trial121:> test '!' -e /home/ubuntu/cephtest 2026-02-13T02:26:09.826 DEBUG:teuthology.orchestra.run.trial178:> test '!' -e /home/ubuntu/cephtest 2026-02-13T02:26:09.829 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-13T02:26:09.840 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-13T02:26:09.840 DEBUG:teuthology.orchestra.run.trial121:> test -z $(ls -A /var/lib/ceph) 2026-02-13T02:26:09.872 DEBUG:teuthology.orchestra.run.trial178:> test -z $(ls -A /var/lib/ceph) 2026-02-13T02:26:09.875 INFO:teuthology.orchestra.run.trial121.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-13T02:26:09.877 INFO:teuthology.orchestra.run.trial178.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-13T02:26:09.877 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-13T02:26:10.025 INFO:teuthology.run_tasks:Running task kernel... 2026-02-13T02:26:10.044 INFO:teuthology.task.kernel:normalize config orig: {'sha1': 'distro'} 2026-02-13T02:26:10.044 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro'}, 'mon.b': {'sha1': 'distro'}}, timeout 300 2026-02-13T02:26:10.044 DEBUG:teuthology.orchestra.run.trial121:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T02:26:10.045 DEBUG:teuthology.orchestra.run.trial178:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T02:26:10.047 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:26:10.047 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-13T02:26:10.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:26:10.048 DEBUG:teuthology.orchestra.run.trial121:> uname -r 2026-02-13T02:26:10.094 INFO:teuthology.orchestra.run.trial121.stdout:5.15.0-164-generic 2026-02-13T02:26:10.094 INFO:teuthology.task.kernel:Running kernel on trial121: 5.15.0-164-generic 2026-02-13T02:26:10.095 DEBUG:teuthology.orchestra.run.trial121:> sudo apt-get clean 2026-02-13T02:26:10.098 INFO:teuthology.orchestra.run.trial178.stdout:5.15.0-164-generic 2026-02-13T02:26:10.098 INFO:teuthology.task.kernel:Running kernel on trial178: 5.15.0-164-generic 2026-02-13T02:26:10.098 DEBUG:teuthology.orchestra.run.trial178:> sudo apt-get clean 2026-02-13T02:26:10.153 DEBUG:teuthology.orchestra.run.trial121:> sudo apt-get update 2026-02-13T02:26:10.155 DEBUG:teuthology.orchestra.run.trial178:> sudo apt-get update 2026-02-13T02:26:10.663 INFO:teuthology.orchestra.run.trial121.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-13T02:26:10.664 INFO:teuthology.orchestra.run.trial178.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-13T02:26:10.736 INFO:teuthology.orchestra.run.trial121.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-13T02:26:10.737 INFO:teuthology.orchestra.run.trial178.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-13T02:26:11.013 INFO:teuthology.orchestra.run.trial178.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-13T02:26:11.013 INFO:teuthology.orchestra.run.trial121.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-13T02:26:11.135 INFO:teuthology.orchestra.run.trial121.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-13T02:26:11.135 INFO:teuthology.orchestra.run.trial178.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-13T02:26:11.249 INFO:teuthology.orchestra.run.trial121.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3226 kB] 2026-02-13T02:26:11.250 INFO:teuthology.orchestra.run.trial178.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3226 kB] 2026-02-13T02:26:11.576 INFO:teuthology.orchestra.run.trial178.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [492 kB] 2026-02-13T02:26:11.577 INFO:teuthology.orchestra.run.trial121.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [492 kB] 2026-02-13T02:26:11.585 INFO:teuthology.orchestra.run.trial178.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-13T02:26:11.586 INFO:teuthology.orchestra.run.trial121.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-13T02:26:11.586 INFO:teuthology.orchestra.run.trial178.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1254 kB] 2026-02-13T02:26:11.587 INFO:teuthology.orchestra.run.trial121.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1254 kB] 2026-02-13T02:26:11.615 INFO:teuthology.orchestra.run.trial178.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [313 kB] 2026-02-13T02:26:11.615 INFO:teuthology.orchestra.run.trial121.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [313 kB] 2026-02-13T02:26:11.621 INFO:teuthology.orchestra.run.trial178.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.2 kB] 2026-02-13T02:26:11.621 INFO:teuthology.orchestra.run.trial178.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5260 kB] 2026-02-13T02:26:11.621 INFO:teuthology.orchestra.run.trial121.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.2 kB] 2026-02-13T02:26:11.622 INFO:teuthology.orchestra.run.trial121.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5260 kB] 2026-02-13T02:26:11.747 INFO:teuthology.orchestra.run.trial178.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [991 kB] 2026-02-13T02:26:11.749 INFO:teuthology.orchestra.run.trial121.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [991 kB] 2026-02-13T02:26:11.767 INFO:teuthology.orchestra.run.trial178.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2959 kB] 2026-02-13T02:26:11.768 INFO:teuthology.orchestra.run.trial121.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2959 kB] 2026-02-13T02:26:11.837 INFO:teuthology.orchestra.run.trial178.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [425 kB] 2026-02-13T02:26:11.838 INFO:teuthology.orchestra.run.trial121.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [425 kB] 2026-02-13T02:26:11.844 INFO:teuthology.orchestra.run.trial178.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-13T02:26:11.844 INFO:teuthology.orchestra.run.trial178.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1017 kB] 2026-02-13T02:26:11.846 INFO:teuthology.orchestra.run.trial121.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-13T02:26:11.846 INFO:teuthology.orchestra.run.trial121.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1017 kB] 2026-02-13T02:26:11.873 INFO:teuthology.orchestra.run.trial178.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [224 kB] 2026-02-13T02:26:11.873 INFO:teuthology.orchestra.run.trial121.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [224 kB] 2026-02-13T02:26:11.878 INFO:teuthology.orchestra.run.trial121.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.6 kB] 2026-02-13T02:26:11.879 INFO:teuthology.orchestra.run.trial121.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5089 kB] 2026-02-13T02:26:11.880 INFO:teuthology.orchestra.run.trial178.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.6 kB] 2026-02-13T02:26:11.880 INFO:teuthology.orchestra.run.trial178.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5089 kB] 2026-02-13T02:26:11.996 INFO:teuthology.orchestra.run.trial178.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [963 kB] 2026-02-13T02:26:12.000 INFO:teuthology.orchestra.run.trial121.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [963 kB] 2026-02-13T02:26:15.372 INFO:teuthology.orchestra.run.trial121.stdout:Fetched 22.7 MB in 3s (8237 kB/s) 2026-02-13T02:26:15.406 INFO:teuthology.orchestra.run.trial178.stdout:Fetched 22.7 MB in 3s (8220 kB/s) 2026-02-13T02:26:15.905 INFO:teuthology.orchestra.run.trial121.stdout:Reading package lists... 2026-02-13T02:26:15.919 DEBUG:teuthology.orchestra.run.trial121:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-13T02:26:15.943 INFO:teuthology.orchestra.run.trial178.stdout:Reading package lists... 2026-02-13T02:26:15.952 INFO:teuthology.orchestra.run.trial121.stdout:Reading package lists... 2026-02-13T02:26:15.957 DEBUG:teuthology.orchestra.run.trial178:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-13T02:26:15.992 INFO:teuthology.orchestra.run.trial178.stdout:Reading package lists... 2026-02-13T02:26:16.061 INFO:teuthology.orchestra.run.trial121.stdout:Building dependency tree... 2026-02-13T02:26:16.062 INFO:teuthology.orchestra.run.trial121.stdout:Reading state information... 2026-02-13T02:26:16.102 INFO:teuthology.orchestra.run.trial178.stdout:Building dependency tree... 2026-02-13T02:26:16.103 INFO:teuthology.orchestra.run.trial178.stdout:Reading state information... 2026-02-13T02:26:16.152 INFO:teuthology.orchestra.run.trial121.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T02:26:16.153 INFO:teuthology.orchestra.run.trial121.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T02:26:16.153 INFO:teuthology.orchestra.run.trial121.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T02:26:16.153 INFO:teuthology.orchestra.run.trial121.stdout: sg3-utils-udev 2026-02-13T02:26:16.153 INFO:teuthology.orchestra.run.trial121.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T02:26:16.154 INFO:teuthology.orchestra.run.trial121.stdout:The following additional packages will be installed: 2026-02-13T02:26:16.154 INFO:teuthology.orchestra.run.trial121.stdout: linux-generic linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-13T02:26:16.154 INFO:teuthology.orchestra.run.trial121.stdout: linux-headers-generic linux-image-5.15.0-170-generic 2026-02-13T02:26:16.154 INFO:teuthology.orchestra.run.trial121.stdout: linux-modules-5.15.0-170-generic linux-modules-extra-5.15.0-170-generic 2026-02-13T02:26:16.154 INFO:teuthology.orchestra.run.trial121.stdout:Suggested packages: 2026-02-13T02:26:16.154 INFO:teuthology.orchestra.run.trial121.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-13T02:26:16.166 INFO:teuthology.orchestra.run.trial121.stdout:The following NEW packages will be installed: 2026-02-13T02:26:16.166 INFO:teuthology.orchestra.run.trial121.stdout: linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-13T02:26:16.166 INFO:teuthology.orchestra.run.trial121.stdout: linux-image-5.15.0-170-generic linux-modules-5.15.0-170-generic 2026-02-13T02:26:16.167 INFO:teuthology.orchestra.run.trial121.stdout: linux-modules-extra-5.15.0-170-generic 2026-02-13T02:26:16.167 INFO:teuthology.orchestra.run.trial121.stdout:The following packages will be upgraded: 2026-02-13T02:26:16.167 INFO:teuthology.orchestra.run.trial121.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-13T02:26:16.195 INFO:teuthology.orchestra.run.trial178.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T02:26:16.195 INFO:teuthology.orchestra.run.trial178.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T02:26:16.195 INFO:teuthology.orchestra.run.trial178.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T02:26:16.195 INFO:teuthology.orchestra.run.trial178.stdout: sg3-utils-udev 2026-02-13T02:26:16.195 INFO:teuthology.orchestra.run.trial178.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T02:26:16.195 INFO:teuthology.orchestra.run.trial178.stdout:The following additional packages will be installed: 2026-02-13T02:26:16.195 INFO:teuthology.orchestra.run.trial178.stdout: linux-generic linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-13T02:26:16.195 INFO:teuthology.orchestra.run.trial178.stdout: linux-headers-generic linux-image-5.15.0-170-generic 2026-02-13T02:26:16.195 INFO:teuthology.orchestra.run.trial178.stdout: linux-modules-5.15.0-170-generic linux-modules-extra-5.15.0-170-generic 2026-02-13T02:26:16.196 INFO:teuthology.orchestra.run.trial178.stdout:Suggested packages: 2026-02-13T02:26:16.196 INFO:teuthology.orchestra.run.trial178.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-13T02:26:16.209 INFO:teuthology.orchestra.run.trial178.stdout:The following NEW packages will be installed: 2026-02-13T02:26:16.209 INFO:teuthology.orchestra.run.trial178.stdout: linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-13T02:26:16.209 INFO:teuthology.orchestra.run.trial178.stdout: linux-image-5.15.0-170-generic linux-modules-5.15.0-170-generic 2026-02-13T02:26:16.210 INFO:teuthology.orchestra.run.trial178.stdout: linux-modules-extra-5.15.0-170-generic 2026-02-13T02:26:16.210 INFO:teuthology.orchestra.run.trial178.stdout:The following packages will be upgraded: 2026-02-13T02:26:16.210 INFO:teuthology.orchestra.run.trial178.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-13T02:26:16.515 INFO:teuthology.orchestra.run.trial121.stdout:3 upgraded, 5 newly installed, 0 to remove and 38 not upgraded. 2026-02-13T02:26:16.516 INFO:teuthology.orchestra.run.trial121.stdout:Need to get 113 MB of archives. 2026-02-13T02:26:16.516 INFO:teuthology.orchestra.run.trial121.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-13T02:26:16.516 INFO:teuthology.orchestra.run.trial121.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-170-generic amd64 5.15.0-170.180 [22.7 MB] 2026-02-13T02:26:16.554 INFO:teuthology.orchestra.run.trial178.stdout:3 upgraded, 5 newly installed, 0 to remove and 38 not upgraded. 2026-02-13T02:26:16.554 INFO:teuthology.orchestra.run.trial178.stdout:Need to get 113 MB of archives. 2026-02-13T02:26:16.554 INFO:teuthology.orchestra.run.trial178.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-13T02:26:16.554 INFO:teuthology.orchestra.run.trial178.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-170-generic amd64 5.15.0-170.180 [22.7 MB] 2026-02-13T02:26:17.609 INFO:teuthology.orchestra.run.trial121.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-170-generic amd64 5.15.0-170.180 [11.6 MB] 2026-02-13T02:26:17.647 INFO:teuthology.orchestra.run.trial178.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-170-generic amd64 5.15.0-170.180 [11.6 MB] 2026-02-13T02:26:17.879 INFO:teuthology.orchestra.run.trial121.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-170-generic amd64 5.15.0-170.180 [64.0 MB] 2026-02-13T02:26:17.918 INFO:teuthology.orchestra.run.trial178.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-170-generic amd64 5.15.0-170.180 [64.0 MB] 2026-02-13T02:26:19.370 INFO:teuthology.orchestra.run.trial121.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.170.159 [1654 B] 2026-02-13T02:26:19.370 INFO:teuthology.orchestra.run.trial121.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.170.159 [2474 B] 2026-02-13T02:26:19.370 INFO:teuthology.orchestra.run.trial121.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170 all 5.15.0-170.180 [12.4 MB] 2026-02-13T02:26:19.408 INFO:teuthology.orchestra.run.trial178.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.170.159 [1654 B] 2026-02-13T02:26:19.408 INFO:teuthology.orchestra.run.trial178.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.170.159 [2474 B] 2026-02-13T02:26:19.408 INFO:teuthology.orchestra.run.trial178.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170 all 5.15.0-170.180 [12.4 MB] 2026-02-13T02:26:19.647 INFO:teuthology.orchestra.run.trial121.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170-generic amd64 5.15.0-170.180 [2828 kB] 2026-02-13T02:26:19.685 INFO:teuthology.orchestra.run.trial178.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170-generic amd64 5.15.0-170.180 [2828 kB] 2026-02-13T02:26:19.711 INFO:teuthology.orchestra.run.trial121.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.170.159 [2316 B] 2026-02-13T02:26:19.749 INFO:teuthology.orchestra.run.trial178.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.170.159 [2316 B] 2026-02-13T02:26:19.908 INFO:teuthology.orchestra.run.trial121.stdout:Fetched 113 MB in 4s (32.0 MB/s) 2026-02-13T02:26:19.924 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package linux-modules-5.15.0-170-generic. 2026-02-13T02:26:19.950 INFO:teuthology.orchestra.run.trial178.stdout:Fetched 113 MB in 4s (32.1 MB/s) 2026-02-13T02:26:19.970 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package linux-modules-5.15.0-170-generic. 2026-02-13T02:26:20.090 INFO:teuthology.orchestra.run.trial121.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 131954 files and directories currently installed.) 2026-02-13T02:26:20.092 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../0-linux-modules-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T02:26:20.093 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T02:26:20.133 INFO:teuthology.orchestra.run.trial178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 131954 files and directories currently installed.) 2026-02-13T02:26:20.134 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../0-linux-modules-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T02:26:20.136 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T02:26:20.442 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package linux-image-5.15.0-170-generic. 2026-02-13T02:26:20.448 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../1-linux-image-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T02:26:20.469 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T02:26:20.488 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package linux-image-5.15.0-170-generic. 2026-02-13T02:26:20.495 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../1-linux-image-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T02:26:20.507 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-170-generic. 2026-02-13T02:26:20.511 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T02:26:20.513 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T02:26:20.514 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T02:26:20.552 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-170-generic. 2026-02-13T02:26:20.559 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T02:26:20.559 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T02:26:21.611 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../3-linux-generic_5.15.0.170.159_amd64.deb ... 2026-02-13T02:26:21.612 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking linux-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-13T02:26:21.635 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.170.159_amd64.deb ... 2026-02-13T02:26:21.636 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking linux-image-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-13T02:26:21.653 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package linux-headers-5.15.0-170. 2026-02-13T02:26:21.660 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../5-linux-headers-5.15.0-170_5.15.0-170.180_all.deb ... 2026-02-13T02:26:21.661 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-13T02:26:21.677 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../3-linux-generic_5.15.0.170.159_amd64.deb ... 2026-02-13T02:26:21.677 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking linux-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-13T02:26:21.702 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.170.159_amd64.deb ... 2026-02-13T02:26:21.703 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking linux-image-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-13T02:26:21.720 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package linux-headers-5.15.0-170. 2026-02-13T02:26:21.727 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../5-linux-headers-5.15.0-170_5.15.0-170.180_all.deb ... 2026-02-13T02:26:21.728 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-13T02:26:23.029 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package linux-headers-5.15.0-170-generic. 2026-02-13T02:26:23.041 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../6-linux-headers-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T02:26:23.041 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T02:26:23.092 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package linux-headers-5.15.0-170-generic. 2026-02-13T02:26:23.103 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../6-linux-headers-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T02:26:23.104 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T02:26:23.633 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.170.159_amd64.deb ... 2026-02-13T02:26:23.634 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking linux-headers-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-13T02:26:23.658 INFO:teuthology.orchestra.run.trial121.stdout:Setting up linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-13T02:26:23.659 INFO:teuthology.orchestra.run.trial121.stdout:Setting up linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T02:26:23.661 INFO:teuthology.orchestra.run.trial121.stdout:Setting up linux-headers-generic (5.15.0.170.159) ... 2026-02-13T02:26:23.662 INFO:teuthology.orchestra.run.trial121.stdout:Setting up linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T02:26:23.709 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.170.159_amd64.deb ... 2026-02-13T02:26:23.710 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking linux-headers-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-13T02:26:23.735 INFO:teuthology.orchestra.run.trial178.stdout:Setting up linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-13T02:26:23.736 INFO:teuthology.orchestra.run.trial178.stdout:Setting up linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T02:26:23.737 INFO:teuthology.orchestra.run.trial178.stdout:Setting up linux-headers-generic (5.15.0.170.159) ... 2026-02-13T02:26:23.738 INFO:teuthology.orchestra.run.trial178.stdout:Setting up linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T02:26:24.458 INFO:teuthology.orchestra.run.trial121.stdout:Setting up linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T02:26:24.555 INFO:teuthology.orchestra.run.trial178.stdout:Setting up linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T02:26:25.303 INFO:teuthology.orchestra.run.trial121.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-13T02:26:25.303 INFO:teuthology.orchestra.run.trial121.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-170-generic 2026-02-13T02:26:25.309 INFO:teuthology.orchestra.run.trial121.stdout:Setting up linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T02:26:25.415 INFO:teuthology.orchestra.run.trial178.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-13T02:26:25.415 INFO:teuthology.orchestra.run.trial178.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-170-generic 2026-02-13T02:26:25.422 INFO:teuthology.orchestra.run.trial178.stdout:Setting up linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T02:26:26.121 INFO:teuthology.orchestra.run.trial121.stdout:Setting up linux-image-generic (5.15.0.170.159) ... 2026-02-13T02:26:26.122 INFO:teuthology.orchestra.run.trial121.stdout:Setting up linux-generic (5.15.0.170.159) ... 2026-02-13T02:26:26.124 INFO:teuthology.orchestra.run.trial121.stdout:Processing triggers for linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T02:26:26.129 INFO:teuthology.orchestra.run.trial121.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-13T02:26:26.129 INFO:teuthology.orchestra.run.trial121.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-170-generic 2026-02-13T02:26:26.251 INFO:teuthology.orchestra.run.trial178.stdout:Setting up linux-image-generic (5.15.0.170.159) ... 2026-02-13T02:26:26.252 INFO:teuthology.orchestra.run.trial178.stdout:Setting up linux-generic (5.15.0.170.159) ... 2026-02-13T02:26:26.253 INFO:teuthology.orchestra.run.trial178.stdout:Processing triggers for linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T02:26:26.258 INFO:teuthology.orchestra.run.trial178.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-13T02:26:26.258 INFO:teuthology.orchestra.run.trial178.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-170-generic 2026-02-13T02:26:33.171 INFO:teuthology.orchestra.run.trial121.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-13T02:26:33.335 INFO:teuthology.orchestra.run.trial178.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-13T02:26:39.786 INFO:teuthology.orchestra.run.trial121.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-13T02:26:39.786 INFO:teuthology.orchestra.run.trial121.stdout:Sourcing file `/etc/default/grub' 2026-02-13T02:26:39.805 INFO:teuthology.orchestra.run.trial121.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-13T02:26:39.806 INFO:teuthology.orchestra.run.trial121.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-13T02:26:39.808 INFO:teuthology.orchestra.run.trial121.stdout:Generating grub configuration file ... 2026-02-13T02:26:39.889 INFO:teuthology.orchestra.run.trial121.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-13T02:26:39.896 INFO:teuthology.orchestra.run.trial121.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-13T02:26:39.931 INFO:teuthology.orchestra.run.trial178.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-13T02:26:39.932 INFO:teuthology.orchestra.run.trial178.stdout:Sourcing file `/etc/default/grub' 2026-02-13T02:26:39.951 INFO:teuthology.orchestra.run.trial178.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-13T02:26:39.952 INFO:teuthology.orchestra.run.trial178.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-13T02:26:39.954 INFO:teuthology.orchestra.run.trial178.stdout:Generating grub configuration file ... 2026-02-13T02:26:40.035 INFO:teuthology.orchestra.run.trial178.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-13T02:26:40.041 INFO:teuthology.orchestra.run.trial178.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-13T02:26:40.069 INFO:teuthology.orchestra.run.trial121.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-13T02:26:40.074 INFO:teuthology.orchestra.run.trial121.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-13T02:26:40.145 INFO:teuthology.orchestra.run.trial121.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-13T02:26:40.145 INFO:teuthology.orchestra.run.trial121.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-13T02:26:40.145 INFO:teuthology.orchestra.run.trial121.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-13T02:26:40.148 INFO:teuthology.orchestra.run.trial121.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T02:26:40.156 INFO:teuthology.orchestra.run.trial121.stdout:done 2026-02-13T02:26:40.217 INFO:teuthology.orchestra.run.trial178.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-13T02:26:40.223 INFO:teuthology.orchestra.run.trial178.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-13T02:26:40.296 INFO:teuthology.orchestra.run.trial178.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-13T02:26:40.297 INFO:teuthology.orchestra.run.trial178.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-13T02:26:40.297 INFO:teuthology.orchestra.run.trial178.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-13T02:26:40.299 INFO:teuthology.orchestra.run.trial178.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T02:26:40.308 INFO:teuthology.orchestra.run.trial178.stdout:done 2026-02-13T02:26:40.576 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:26:40.576 INFO:teuthology.orchestra.run.trial121.stdout:Pending kernel upgrade! 2026-02-13T02:26:40.576 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:26:40.576 INFO:teuthology.orchestra.run.trial121.stdout:Running kernel version: 2026-02-13T02:26:40.576 INFO:teuthology.orchestra.run.trial121.stdout: 5.15.0-164-generic 2026-02-13T02:26:40.576 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:26:40.577 INFO:teuthology.orchestra.run.trial121.stdout:Diagnostics: 2026-02-13T02:26:40.577 INFO:teuthology.orchestra.run.trial121.stdout: The currently running kernel version is not the expected kernel version 5.15.0-170-generic. 2026-02-13T02:26:40.577 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:26:40.577 INFO:teuthology.orchestra.run.trial121.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-13T02:26:40.577 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:26:40.577 INFO:teuthology.orchestra.run.trial121.stdout:The processor microcode seems to be up-to-date. 2026-02-13T02:26:40.577 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:26:40.577 INFO:teuthology.orchestra.run.trial121.stdout:No services need to be restarted. 2026-02-13T02:26:40.577 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:26:40.577 INFO:teuthology.orchestra.run.trial121.stdout:No containers need to be restarted. 2026-02-13T02:26:40.577 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:26:40.577 INFO:teuthology.orchestra.run.trial121.stdout:No user sessions are running outdated binaries. 2026-02-13T02:26:40.578 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:26:40.578 INFO:teuthology.orchestra.run.trial121.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-13T02:26:40.715 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:26:40.715 INFO:teuthology.orchestra.run.trial178.stdout:Pending kernel upgrade! 2026-02-13T02:26:40.715 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:26:40.715 INFO:teuthology.orchestra.run.trial178.stdout:Running kernel version: 2026-02-13T02:26:40.715 INFO:teuthology.orchestra.run.trial178.stdout: 5.15.0-164-generic 2026-02-13T02:26:40.715 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:26:40.715 INFO:teuthology.orchestra.run.trial178.stdout:Diagnostics: 2026-02-13T02:26:40.715 INFO:teuthology.orchestra.run.trial178.stdout: The currently running kernel version is not the expected kernel version 5.15.0-170-generic. 2026-02-13T02:26:40.715 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:26:40.715 INFO:teuthology.orchestra.run.trial178.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-13T02:26:40.716 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:26:40.716 INFO:teuthology.orchestra.run.trial178.stdout:The processor microcode seems to be up-to-date. 2026-02-13T02:26:40.716 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:26:40.716 INFO:teuthology.orchestra.run.trial178.stdout:No services need to be restarted. 2026-02-13T02:26:40.716 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:26:40.716 INFO:teuthology.orchestra.run.trial178.stdout:No containers need to be restarted. 2026-02-13T02:26:40.716 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:26:40.716 INFO:teuthology.orchestra.run.trial178.stdout:No user sessions are running outdated binaries. 2026-02-13T02:26:40.716 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:26:40.716 INFO:teuthology.orchestra.run.trial178.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-13T02:26:41.225 DEBUG:teuthology.orchestra.run.trial121:> dpkg -s linux-image-generic 2026-02-13T02:26:41.278 INFO:teuthology.orchestra.run.trial121.stdout:Package: linux-image-generic 2026-02-13T02:26:41.278 INFO:teuthology.orchestra.run.trial121.stdout:Status: install ok installed 2026-02-13T02:26:41.278 INFO:teuthology.orchestra.run.trial121.stdout:Priority: optional 2026-02-13T02:26:41.278 INFO:teuthology.orchestra.run.trial121.stdout:Section: kernel 2026-02-13T02:26:41.278 INFO:teuthology.orchestra.run.trial121.stdout:Installed-Size: 21 2026-02-13T02:26:41.278 INFO:teuthology.orchestra.run.trial121.stdout:Maintainer: Ubuntu Kernel Team 2026-02-13T02:26:41.278 INFO:teuthology.orchestra.run.trial121.stdout:Architecture: amd64 2026-02-13T02:26:41.278 INFO:teuthology.orchestra.run.trial121.stdout:Source: linux-meta 2026-02-13T02:26:41.278 INFO:teuthology.orchestra.run.trial121.stdout:Version: 5.15.0.170.159 2026-02-13T02:26:41.279 INFO:teuthology.orchestra.run.trial121.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-13T02:26:41.279 INFO:teuthology.orchestra.run.trial121.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-13T02:26:41.279 INFO:teuthology.orchestra.run.trial121.stdout:Recommends: thermald 2026-02-13T02:26:41.279 INFO:teuthology.orchestra.run.trial121.stdout:Description: Generic Linux kernel image 2026-02-13T02:26:41.279 INFO:teuthology.orchestra.run.trial121.stdout: This package will always depend on the latest generic kernel image 2026-02-13T02:26:41.279 INFO:teuthology.orchestra.run.trial121.stdout: available. 2026-02-13T02:26:41.279 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-164-generic Expected: 5.15.0-170-generic 2026-02-13T02:26:41.279 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-13T02:26:41.280 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-13T02:26:41.280 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-13T02:26:41.280 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial121.front.sepia.ceph.com, path=None, version=distro) 2026-02-13T02:26:41.280 DEBUG:teuthology.orchestra.run.trial121:> sudo apt-get clean 2026-02-13T02:26:41.359 DEBUG:teuthology.orchestra.run.trial121:> sudo apt-get update 2026-02-13T02:26:41.381 DEBUG:teuthology.orchestra.run.trial178:> dpkg -s linux-image-generic 2026-02-13T02:26:41.432 INFO:teuthology.orchestra.run.trial178.stdout:Package: linux-image-generic 2026-02-13T02:26:41.432 INFO:teuthology.orchestra.run.trial178.stdout:Status: install ok installed 2026-02-13T02:26:41.432 INFO:teuthology.orchestra.run.trial178.stdout:Priority: optional 2026-02-13T02:26:41.432 INFO:teuthology.orchestra.run.trial178.stdout:Section: kernel 2026-02-13T02:26:41.432 INFO:teuthology.orchestra.run.trial178.stdout:Installed-Size: 21 2026-02-13T02:26:41.432 INFO:teuthology.orchestra.run.trial178.stdout:Maintainer: Ubuntu Kernel Team 2026-02-13T02:26:41.432 INFO:teuthology.orchestra.run.trial178.stdout:Architecture: amd64 2026-02-13T02:26:41.433 INFO:teuthology.orchestra.run.trial178.stdout:Source: linux-meta 2026-02-13T02:26:41.433 INFO:teuthology.orchestra.run.trial178.stdout:Version: 5.15.0.170.159 2026-02-13T02:26:41.433 INFO:teuthology.orchestra.run.trial178.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-13T02:26:41.433 INFO:teuthology.orchestra.run.trial178.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-13T02:26:41.433 INFO:teuthology.orchestra.run.trial178.stdout:Recommends: thermald 2026-02-13T02:26:41.433 INFO:teuthology.orchestra.run.trial178.stdout:Description: Generic Linux kernel image 2026-02-13T02:26:41.433 INFO:teuthology.orchestra.run.trial178.stdout: This package will always depend on the latest generic kernel image 2026-02-13T02:26:41.433 INFO:teuthology.orchestra.run.trial178.stdout: available. 2026-02-13T02:26:41.433 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-164-generic Expected: 5.15.0-170-generic 2026-02-13T02:26:41.434 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-13T02:26:41.434 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-13T02:26:41.434 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-13T02:26:41.434 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial178.front.sepia.ceph.com, path=None, version=distro) 2026-02-13T02:26:41.434 DEBUG:teuthology.orchestra.run.trial178:> sudo apt-get clean 2026-02-13T02:26:41.514 DEBUG:teuthology.orchestra.run.trial178:> sudo apt-get update 2026-02-13T02:26:41.873 INFO:teuthology.orchestra.run.trial121.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-13T02:26:41.955 INFO:teuthology.orchestra.run.trial121.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-13T02:26:42.002 INFO:teuthology.orchestra.run.trial178.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-13T02:26:42.044 INFO:teuthology.orchestra.run.trial121.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-13T02:26:42.084 INFO:teuthology.orchestra.run.trial178.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-13T02:26:42.132 INFO:teuthology.orchestra.run.trial121.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-13T02:26:42.172 INFO:teuthology.orchestra.run.trial178.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-13T02:26:42.260 INFO:teuthology.orchestra.run.trial178.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-13T02:26:42.792 INFO:teuthology.orchestra.run.trial121.stdout:Reading package lists... 2026-02-13T02:26:42.807 DEBUG:teuthology.orchestra.run.trial121:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-13T02:26:42.841 INFO:teuthology.orchestra.run.trial121.stdout:Reading package lists... 2026-02-13T02:26:42.913 INFO:teuthology.orchestra.run.trial178.stdout:Reading package lists... 2026-02-13T02:26:42.928 DEBUG:teuthology.orchestra.run.trial178:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-13T02:26:42.954 INFO:teuthology.orchestra.run.trial121.stdout:Building dependency tree... 2026-02-13T02:26:42.955 INFO:teuthology.orchestra.run.trial121.stdout:Reading state information... 2026-02-13T02:26:42.960 INFO:teuthology.orchestra.run.trial178.stdout:Reading package lists... 2026-02-13T02:26:43.041 INFO:teuthology.orchestra.run.trial121.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-13T02:26:43.042 INFO:teuthology.orchestra.run.trial121.stdout:linux-image-generic set to manually installed. 2026-02-13T02:26:43.042 INFO:teuthology.orchestra.run.trial121.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T02:26:43.042 INFO:teuthology.orchestra.run.trial121.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T02:26:43.042 INFO:teuthology.orchestra.run.trial121.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T02:26:43.042 INFO:teuthology.orchestra.run.trial121.stdout: sg3-utils-udev 2026-02-13T02:26:43.042 INFO:teuthology.orchestra.run.trial121.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T02:26:43.062 INFO:teuthology.orchestra.run.trial121.stdout:0 upgraded, 0 newly installed, 0 to remove and 38 not upgraded. 2026-02-13T02:26:43.064 DEBUG:teuthology.orchestra.run.trial121:> dpkg -s linux-image-generic 2026-02-13T02:26:43.065 INFO:teuthology.orchestra.run.trial178.stdout:Building dependency tree... 2026-02-13T02:26:43.066 INFO:teuthology.orchestra.run.trial178.stdout:Reading state information... 2026-02-13T02:26:43.120 INFO:teuthology.orchestra.run.trial121.stdout:Package: linux-image-generic 2026-02-13T02:26:43.120 INFO:teuthology.orchestra.run.trial121.stdout:Status: install ok installed 2026-02-13T02:26:43.120 INFO:teuthology.orchestra.run.trial121.stdout:Priority: optional 2026-02-13T02:26:43.120 INFO:teuthology.orchestra.run.trial121.stdout:Section: kernel 2026-02-13T02:26:43.120 INFO:teuthology.orchestra.run.trial121.stdout:Installed-Size: 21 2026-02-13T02:26:43.120 INFO:teuthology.orchestra.run.trial121.stdout:Maintainer: Ubuntu Kernel Team 2026-02-13T02:26:43.121 INFO:teuthology.orchestra.run.trial121.stdout:Architecture: amd64 2026-02-13T02:26:43.121 INFO:teuthology.orchestra.run.trial121.stdout:Source: linux-meta 2026-02-13T02:26:43.121 INFO:teuthology.orchestra.run.trial121.stdout:Version: 5.15.0.170.159 2026-02-13T02:26:43.121 INFO:teuthology.orchestra.run.trial121.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-13T02:26:43.121 INFO:teuthology.orchestra.run.trial121.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-13T02:26:43.121 INFO:teuthology.orchestra.run.trial121.stdout:Recommends: thermald 2026-02-13T02:26:43.121 INFO:teuthology.orchestra.run.trial121.stdout:Description: Generic Linux kernel image 2026-02-13T02:26:43.121 INFO:teuthology.orchestra.run.trial121.stdout: This package will always depend on the latest generic kernel image 2026-02-13T02:26:43.121 INFO:teuthology.orchestra.run.trial121.stdout: available. 2026-02-13T02:26:43.122 DEBUG:teuthology.orchestra.run.trial121:> mktemp 2026-02-13T02:26:43.150 INFO:teuthology.orchestra.run.trial178.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-13T02:26:43.150 INFO:teuthology.orchestra.run.trial178.stdout:linux-image-generic set to manually installed. 2026-02-13T02:26:43.150 INFO:teuthology.orchestra.run.trial178.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T02:26:43.150 INFO:teuthology.orchestra.run.trial178.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T02:26:43.150 INFO:teuthology.orchestra.run.trial178.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T02:26:43.150 INFO:teuthology.orchestra.run.trial178.stdout: sg3-utils-udev 2026-02-13T02:26:43.150 INFO:teuthology.orchestra.run.trial178.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T02:26:43.167 INFO:teuthology.orchestra.run.trial121.stdout:/tmp/tmp.xwiKkqPlrs 2026-02-13T02:26:43.167 DEBUG:teuthology.orchestra.run.trial121:> sudo cp /boot/grub/grub.cfg /tmp/tmp.xwiKkqPlrs 2026-02-13T02:26:43.170 INFO:teuthology.orchestra.run.trial178.stdout:0 upgraded, 0 newly installed, 0 to remove and 38 not upgraded. 2026-02-13T02:26:43.172 DEBUG:teuthology.orchestra.run.trial178:> dpkg -s linux-image-generic 2026-02-13T02:26:43.216 DEBUG:teuthology.orchestra.run.trial121:> sudo chmod 0666 /tmp/tmp.xwiKkqPlrs 2026-02-13T02:26:43.223 INFO:teuthology.orchestra.run.trial178.stdout:Package: linux-image-generic 2026-02-13T02:26:43.223 INFO:teuthology.orchestra.run.trial178.stdout:Status: install ok installed 2026-02-13T02:26:43.223 INFO:teuthology.orchestra.run.trial178.stdout:Priority: optional 2026-02-13T02:26:43.223 INFO:teuthology.orchestra.run.trial178.stdout:Section: kernel 2026-02-13T02:26:43.224 INFO:teuthology.orchestra.run.trial178.stdout:Installed-Size: 21 2026-02-13T02:26:43.224 INFO:teuthology.orchestra.run.trial178.stdout:Maintainer: Ubuntu Kernel Team 2026-02-13T02:26:43.224 INFO:teuthology.orchestra.run.trial178.stdout:Architecture: amd64 2026-02-13T02:26:43.224 INFO:teuthology.orchestra.run.trial178.stdout:Source: linux-meta 2026-02-13T02:26:43.224 INFO:teuthology.orchestra.run.trial178.stdout:Version: 5.15.0.170.159 2026-02-13T02:26:43.224 INFO:teuthology.orchestra.run.trial178.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-13T02:26:43.224 INFO:teuthology.orchestra.run.trial178.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-13T02:26:43.224 INFO:teuthology.orchestra.run.trial178.stdout:Recommends: thermald 2026-02-13T02:26:43.224 INFO:teuthology.orchestra.run.trial178.stdout:Description: Generic Linux kernel image 2026-02-13T02:26:43.224 INFO:teuthology.orchestra.run.trial178.stdout: This package will always depend on the latest generic kernel image 2026-02-13T02:26:43.224 INFO:teuthology.orchestra.run.trial178.stdout: available. 2026-02-13T02:26:43.226 DEBUG:teuthology.orchestra.run.trial178:> mktemp 2026-02-13T02:26:43.271 INFO:teuthology.orchestra.run.trial178.stdout:/tmp/tmp.GfHn7FwqG7 2026-02-13T02:26:43.272 DEBUG:teuthology.orchestra.run.trial178:> sudo cp /boot/grub/grub.cfg /tmp/tmp.GfHn7FwqG7 2026-02-13T02:26:43.313 DEBUG:teuthology.orchestra.remote:trial121:/tmp/tmp.xwiKkqPlrs is 7KB 2026-02-13T02:26:43.321 DEBUG:teuthology.orchestra.run.trial121:> rm -fr /tmp/tmp.xwiKkqPlrs 2026-02-13T02:26:43.323 DEBUG:teuthology.orchestra.run.trial178:> sudo chmod 0666 /tmp/tmp.GfHn7FwqG7 2026-02-13T02:26:43.326 DEBUG:teuthology.orchestra.run.trial121:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-13T02:26:43.375 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:26:43.376 DEBUG:teuthology.orchestra.run.trial121:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-13T02:26:43.376 DEBUG:teuthology.orchestra.run.trial121:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-13T02:26:43.422 DEBUG:teuthology.orchestra.remote:trial178:/tmp/tmp.GfHn7FwqG7 is 7KB 2026-02-13T02:26:43.430 DEBUG:teuthology.orchestra.run.trial178:> rm -fr /tmp/tmp.GfHn7FwqG7 2026-02-13T02:26:43.434 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-170-generic 2026-02-13T02:26:43.434 DEBUG:teuthology.orchestra.run.trial121:> sudo update-grub 2026-02-13T02:26:43.435 DEBUG:teuthology.orchestra.run.trial178:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-13T02:26:43.486 DEBUG:teuthology.orchestra.run.trial178:> set -ex 2026-02-13T02:26:43.486 DEBUG:teuthology.orchestra.run.trial178:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-13T02:26:43.487 DEBUG:teuthology.orchestra.run.trial178:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-13T02:26:43.540 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-170-generic 2026-02-13T02:26:43.541 DEBUG:teuthology.orchestra.run.trial178:> sudo update-grub 2026-02-13T02:26:43.672 INFO:teuthology.orchestra.run.trial121.stderr:Sourcing file `/etc/default/grub' 2026-02-13T02:26:43.691 INFO:teuthology.orchestra.run.trial121.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-13T02:26:43.692 INFO:teuthology.orchestra.run.trial121.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-13T02:26:43.695 INFO:teuthology.orchestra.run.trial121.stderr:Generating grub configuration file ... 2026-02-13T02:26:43.776 INFO:teuthology.orchestra.run.trial121.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-13T02:26:43.782 INFO:teuthology.orchestra.run.trial121.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-13T02:26:43.783 INFO:teuthology.orchestra.run.trial178.stderr:Sourcing file `/etc/default/grub' 2026-02-13T02:26:43.802 INFO:teuthology.orchestra.run.trial178.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-13T02:26:43.803 INFO:teuthology.orchestra.run.trial178.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-13T02:26:43.805 INFO:teuthology.orchestra.run.trial178.stderr:Generating grub configuration file ... 2026-02-13T02:26:43.890 INFO:teuthology.orchestra.run.trial178.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-13T02:26:43.897 INFO:teuthology.orchestra.run.trial178.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-13T02:26:43.959 INFO:teuthology.orchestra.run.trial121.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-13T02:26:43.965 INFO:teuthology.orchestra.run.trial121.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-13T02:26:44.034 INFO:teuthology.orchestra.run.trial121.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-13T02:26:44.035 INFO:teuthology.orchestra.run.trial121.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-13T02:26:44.035 INFO:teuthology.orchestra.run.trial121.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-13T02:26:44.037 INFO:teuthology.orchestra.run.trial121.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T02:26:44.043 INFO:teuthology.orchestra.run.trial121.stderr:done 2026-02-13T02:26:44.045 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial121 2026-02-13T02:26:44.045 DEBUG:teuthology.orchestra.run.trial121:> sudo bash -c 'echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-13T02:26:44.069 INFO:teuthology.orchestra.run.trial178.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-13T02:26:44.075 INFO:teuthology.orchestra.run.trial178.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-13T02:26:44.144 INFO:teuthology.orchestra.run.trial178.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-13T02:26:44.145 INFO:teuthology.orchestra.run.trial178.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-13T02:26:44.145 INFO:teuthology.orchestra.run.trial178.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-13T02:26:44.147 INFO:teuthology.orchestra.run.trial178.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T02:26:44.154 INFO:teuthology.orchestra.run.trial178.stderr:done 2026-02-13T02:26:44.156 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial178 2026-02-13T02:26:44.156 DEBUG:teuthology.orchestra.run.trial178:> sudo bash -c 'echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-13T02:27:14.048 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-13T02:27:14.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial121.front.sepia.ceph.com' 2026-02-13T02:27:14.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T02:27:14.158 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-13T02:27:14.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-13T02:27:14.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T02:28:14.111 DEBUG:teuthology.orchestra.remote:timed out 2026-02-13T02:28:14.161 DEBUG:teuthology.orchestra.remote:timed out 2026-02-13T02:28:23.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial121.front.sepia.ceph.com' 2026-02-13T02:28:23.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T02:28:23.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-13T02:28:23.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T02:28:23.244 DEBUG:teuthology.orchestra.run.trial121:> true 2026-02-13T02:28:23.304 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-13T02:28:23.632 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial121.front.sepia.ceph.com' 2026-02-13T02:28:23.633 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-170-generic"... 2026-02-13T02:28:23.633 DEBUG:teuthology.orchestra.run.trial121:> uname -r 2026-02-13T02:28:23.680 INFO:teuthology.orchestra.run.trial121.stdout:5.15.0-170-generic 2026-02-13T02:28:23.680 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-170-generic vs 5.15.0-170-generic 2026-02-13T02:28:23.680 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T02:28:23.680 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-13T02:28:23.690 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-13T02:28:23.690 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-170-generic"... 2026-02-13T02:28:23.691 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-13T02:28:23.735 INFO:teuthology.orchestra.run.trial178.stdout:5.15.0-170-generic 2026-02-13T02:28:23.736 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-170-generic vs 5.15.0-170-generic 2026-02-13T02:28:23.736 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T02:28:23.736 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-13T02:28:24.682 DEBUG:teuthology.parallel:result is None 2026-02-13T02:28:24.736 DEBUG:teuthology.parallel:result is None 2026-02-13T02:28:24.737 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-13T02:28:24.749 INFO:teuthology.task.internal:Creating test directory... 2026-02-13T02:28:24.749 DEBUG:teuthology.orchestra.run.trial121:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T02:28:24.751 DEBUG:teuthology.orchestra.run.trial178:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T02:28:24.757 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-13T02:28:24.768 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-13T02:28:24.782 INFO:teuthology.task.internal:Creating archive directory... 2026-02-13T02:28:24.782 DEBUG:teuthology.orchestra.run.trial121:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T02:28:24.798 DEBUG:teuthology.orchestra.run.trial178:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T02:28:24.813 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-13T02:28:24.825 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-13T02:28:24.825 DEBUG:teuthology.orchestra.run.trial121:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T02:28:24.846 DEBUG:teuthology.orchestra.run.trial178:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T02:28:24.857 INFO:teuthology.orchestra.run.trial121.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T02:28:24.861 INFO:teuthology.orchestra.run.trial178.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T02:28:24.863 INFO:teuthology.orchestra.run.trial121.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T02:28:24.867 INFO:teuthology.orchestra.run.trial178.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T02:28:24.873 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-13T02:28:24.884 INFO:teuthology.task.internal:Configuring sudo... 2026-02-13T02:28:24.884 DEBUG:teuthology.orchestra.run.trial121:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T02:28:24.910 DEBUG:teuthology.orchestra.run.trial178:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T02:28:24.924 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-13T02:28:24.940 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-13T02:28:24.940 DEBUG:teuthology.orchestra.run.trial121:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T02:28:24.958 DEBUG:teuthology.orchestra.run.trial178:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T02:28:24.971 DEBUG:teuthology.orchestra.run.trial121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T02:28:25.004 DEBUG:teuthology.orchestra.run.trial121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T02:28:25.048 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:28:25.048 DEBUG:teuthology.orchestra.run.trial121:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T02:28:25.097 DEBUG:teuthology.orchestra.run.trial178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T02:28:25.102 DEBUG:teuthology.orchestra.run.trial178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T02:28:25.148 DEBUG:teuthology.orchestra.run.trial178:> set -ex 2026-02-13T02:28:25.148 DEBUG:teuthology.orchestra.run.trial178:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T02:28:25.201 DEBUG:teuthology.orchestra.run.trial121:> sudo service rsyslog restart 2026-02-13T02:28:25.202 DEBUG:teuthology.orchestra.run.trial178:> sudo service rsyslog restart 2026-02-13T02:28:25.261 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-13T02:28:25.274 INFO:teuthology.task.internal:Starting timer... 2026-02-13T02:28:25.274 INFO:teuthology.run_tasks:Running task pcp... 2026-02-13T02:28:25.296 INFO:teuthology.run_tasks:Running task selinux... 2026-02-13T02:28:25.314 DEBUG:teuthology.task.selinux:Excluding trial121: OS 'ubuntu' does not support SELinux 2026-02-13T02:28:25.314 DEBUG:teuthology.task.selinux:Excluding trial178: OS 'ubuntu' does not support SELinux 2026-02-13T02:28:25.314 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-13T02:28:25.314 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-13T02:28:25.314 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-13T02:28:25.314 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-13T02:28:25.329 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-13T02:28:25.341 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-13T02:28:25.342 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial121.front.sepia.ceph.com,trial178.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-13T02:29:25.934 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial121.front.sepia.ceph.com'), Remote(name='ubuntu@trial178.front.sepia.ceph.com')] 2026-02-13T02:29:25.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial121.front.sepia.ceph.com' 2026-02-13T02:29:25.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T02:29:26.044 DEBUG:teuthology.orchestra.run.trial121:> true 2026-02-13T02:29:26.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial121.front.sepia.ceph.com' 2026-02-13T02:29:26.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-13T02:29:26.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T02:29:26.399 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-13T02:29:26.644 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-13T02:29:26.644 INFO:teuthology.run_tasks:Running task clock... 2026-02-13T02:29:26.661 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-13T02:29:26.661 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T02:29:26.661 DEBUG:teuthology.orchestra.run.trial121:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T02:29:26.662 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T02:29:26.662 DEBUG:teuthology.orchestra.run.trial178:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T02:29:26.678 INFO:teuthology.orchestra.run.trial121.stdout:13 Feb 02:29:26 ntpd[4818]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-13T02:29:26.678 INFO:teuthology.orchestra.run.trial121.stdout:13 Feb 02:29:26 ntpd[4818]: Command line: ntpd -gq 2026-02-13T02:29:26.678 INFO:teuthology.orchestra.run.trial121.stdout:13 Feb 02:29:26 ntpd[4818]: ---------------------------------------------------- 2026-02-13T02:29:26.678 INFO:teuthology.orchestra.run.trial121.stdout:13 Feb 02:29:26 ntpd[4818]: ntp-4 is maintained by Network Time Foundation, 2026-02-13T02:29:26.678 INFO:teuthology.orchestra.run.trial121.stdout:13 Feb 02:29:26 ntpd[4818]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-13T02:29:26.678 INFO:teuthology.orchestra.run.trial121.stdout:13 Feb 02:29:26 ntpd[4818]: corporation. Support and training for ntp-4 are 2026-02-13T02:29:26.678 INFO:teuthology.orchestra.run.trial121.stdout:13 Feb 02:29:26 ntpd[4818]: available at https://www.nwtime.org/support 2026-02-13T02:29:26.678 INFO:teuthology.orchestra.run.trial121.stdout:13 Feb 02:29:26 ntpd[4818]: ---------------------------------------------------- 2026-02-13T02:29:26.678 INFO:teuthology.orchestra.run.trial121.stdout:13 Feb 02:29:26 ntpd[4818]: proto: precision = 0.020 usec (-25) 2026-02-13T02:29:26.678 INFO:teuthology.orchestra.run.trial121.stdout:13 Feb 02:29:26 ntpd[4818]: basedate set to 2022-02-04 2026-02-13T02:29:26.678 INFO:teuthology.orchestra.run.trial121.stdout:13 Feb 02:29:26 ntpd[4818]: gps base set to 2022-02-06 (week 2196) 2026-02-13T02:29:26.679 INFO:teuthology.orchestra.run.trial121.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-13T02:29:26.679 INFO:teuthology.orchestra.run.trial121.stdout:13 Feb 02:29:26 ntpd[4818]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-13T02:29:26.679 INFO:teuthology.orchestra.run.trial121.stdout:13 Feb 02:29:26 ntpd[4818]: restrict ::: KOD does nothing without LIMITED. 2026-02-13T02:29:26.679 INFO:teuthology.orchestra.run.trial121.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-13T02:29:26.679 INFO:teuthology.orchestra.run.trial121.stdout:13 Feb 02:29:26 ntpd[4818]: Listen and drop on 0 v6wildcard [::]:123 2026-02-13T02:29:26.679 INFO:teuthology.orchestra.run.trial121.stdout:13 Feb 02:29:26 ntpd[4818]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-13T02:29:26.679 INFO:teuthology.orchestra.run.trial121.stdout:13 Feb 02:29:26 ntpd[4818]: Listen normally on 2 lo 127.0.0.1:123 2026-02-13T02:29:26.679 INFO:teuthology.orchestra.run.trial121.stdout:13 Feb 02:29:26 ntpd[4818]: Listen normally on 3 enp1s0f0 10.20.193.121:123 2026-02-13T02:29:26.679 INFO:teuthology.orchestra.run.trial121.stdout:13 Feb 02:29:26 ntpd[4818]: Listen normally on 4 lo [::1]:123 2026-02-13T02:29:26.679 INFO:teuthology.orchestra.run.trial121.stdout:13 Feb 02:29:26 ntpd[4818]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:61fc%2]:123 2026-02-13T02:29:26.679 INFO:teuthology.orchestra.run.trial121.stdout:13 Feb 02:29:26 ntpd[4818]: Listening on routing socket on fd #22 for interface updates 2026-02-13T02:29:26.706 INFO:teuthology.orchestra.run.trial178.stdout:13 Feb 02:29:25 ntpd[4883]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-13T02:29:26.706 INFO:teuthology.orchestra.run.trial178.stdout:13 Feb 02:29:25 ntpd[4883]: Command line: ntpd -gq 2026-02-13T02:29:26.706 INFO:teuthology.orchestra.run.trial178.stdout:13 Feb 02:29:25 ntpd[4883]: ---------------------------------------------------- 2026-02-13T02:29:26.706 INFO:teuthology.orchestra.run.trial178.stdout:13 Feb 02:29:25 ntpd[4883]: ntp-4 is maintained by Network Time Foundation, 2026-02-13T02:29:26.706 INFO:teuthology.orchestra.run.trial178.stdout:13 Feb 02:29:25 ntpd[4883]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-13T02:29:26.706 INFO:teuthology.orchestra.run.trial178.stdout:13 Feb 02:29:25 ntpd[4883]: corporation. Support and training for ntp-4 are 2026-02-13T02:29:26.706 INFO:teuthology.orchestra.run.trial178.stdout:13 Feb 02:29:25 ntpd[4883]: available at https://www.nwtime.org/support 2026-02-13T02:29:26.706 INFO:teuthology.orchestra.run.trial178.stdout:13 Feb 02:29:25 ntpd[4883]: ---------------------------------------------------- 2026-02-13T02:29:26.706 INFO:teuthology.orchestra.run.trial178.stdout:13 Feb 02:29:25 ntpd[4883]: proto: precision = 0.030 usec (-25) 2026-02-13T02:29:26.706 INFO:teuthology.orchestra.run.trial178.stdout:13 Feb 02:29:25 ntpd[4883]: basedate set to 2022-02-04 2026-02-13T02:29:26.706 INFO:teuthology.orchestra.run.trial178.stdout:13 Feb 02:29:25 ntpd[4883]: gps base set to 2022-02-06 (week 2196) 2026-02-13T02:29:26.706 INFO:teuthology.orchestra.run.trial178.stdout:13 Feb 02:29:25 ntpd[4883]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-13T02:29:26.706 INFO:teuthology.orchestra.run.trial178.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-13T02:29:26.706 INFO:teuthology.orchestra.run.trial178.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-13T02:29:26.706 INFO:teuthology.orchestra.run.trial178.stdout:13 Feb 02:29:25 ntpd[4883]: restrict ::: KOD does nothing without LIMITED. 2026-02-13T02:29:26.706 INFO:teuthology.orchestra.run.trial178.stdout:13 Feb 02:29:25 ntpd[4883]: Listen and drop on 0 v6wildcard [::]:123 2026-02-13T02:29:26.706 INFO:teuthology.orchestra.run.trial178.stdout:13 Feb 02:29:25 ntpd[4883]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-13T02:29:26.707 INFO:teuthology.orchestra.run.trial178.stdout:13 Feb 02:29:25 ntpd[4883]: Listen normally on 2 lo 127.0.0.1:123 2026-02-13T02:29:26.707 INFO:teuthology.orchestra.run.trial178.stdout:13 Feb 02:29:25 ntpd[4883]: Listen normally on 3 enp1s0f0 10.20.193.178:123 2026-02-13T02:29:26.707 INFO:teuthology.orchestra.run.trial178.stdout:13 Feb 02:29:25 ntpd[4883]: Listen normally on 4 lo [::1]:123 2026-02-13T02:29:26.707 INFO:teuthology.orchestra.run.trial178.stdout:13 Feb 02:29:25 ntpd[4883]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:62b0%2]:123 2026-02-13T02:29:26.707 INFO:teuthology.orchestra.run.trial178.stdout:13 Feb 02:29:25 ntpd[4883]: Listening on routing socket on fd #22 for interface updates 2026-02-13T02:29:27.678 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:27 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:27.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:27 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:27.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:27 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:27.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:27 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:27.682 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:27 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:27.682 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:27 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:27.682 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:27 ntpd[4818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:27.682 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:27 ntpd[4818]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:27.751 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:27 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:27.751 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:27 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:27.752 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:27 ntpd[4818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:27.752 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:27 ntpd[4818]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:28.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:28 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:28.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:28 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:28.747 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:28 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:28.747 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:28 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:28.747 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:28 ntpd[4818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:28.747 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:28 ntpd[4818]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:29.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:29 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:29.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:29 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:29.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:29 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:29.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:29 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:29.682 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:29 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:29.682 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:29 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:29.682 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:29 ntpd[4818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:29.682 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:29 ntpd[4818]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:29.706 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:28 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:29.706 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:28 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:29.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:28 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:29.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:28 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:29.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:28 ntpd[4883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:29.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:28 ntpd[4883]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:29.749 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:29 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:29.749 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:29 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:29.749 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:29 ntpd[4818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:29.749 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:29 ntpd[4818]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:30.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:30 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:30.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:30 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:30.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:30 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:30.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:30 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:30.698 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:30 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:30.699 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:30 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:30.699 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:30 ntpd[4818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:30.699 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:30 ntpd[4818]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:30.706 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:29 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:30.706 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:29 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:30.706 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:29 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:30.707 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:29 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:30.707 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:29 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:30.707 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:29 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:30.734 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:29 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:30.734 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:29 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:30.734 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:29 ntpd[4883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:30.734 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:29 ntpd[4883]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:30.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:29 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:30.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:29 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:30.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:29 ntpd[4883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:30.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:29 ntpd[4883]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:30.746 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:30 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:30.746 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:30 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:30.746 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:30 ntpd[4818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:30.746 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:30 ntpd[4818]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:30.779 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:30 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:30.779 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:30 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:30.779 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:30 ntpd[4883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:30.779 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:30 ntpd[4883]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:31.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:31 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:31.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:31 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:31.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:31 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:31.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:31 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:31.682 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:31 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:31.682 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:31 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:31.682 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:31 ntpd[4818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:31.682 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:31 ntpd[4818]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:31.706 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:30 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:31.706 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:30 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:31.743 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:30 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:31.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:30 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:31.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:30 ntpd[4883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:31.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:30 ntpd[4883]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:31.748 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:31 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:31.748 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:31 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:31.749 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:31 ntpd[4818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:31.749 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:31 ntpd[4818]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:32.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:32 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:32.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:32 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:32.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:32 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:32.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:32 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:32.698 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:32 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:32.698 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:32 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:32.698 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:32 ntpd[4818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:32.699 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:32 ntpd[4818]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:32.706 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:31 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:32.706 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:31 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:32.706 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:31 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:32.707 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:31 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:32.707 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:31 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:32.707 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:31 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:32.734 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:31 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:32.734 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:31 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:32.734 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:31 ntpd[4883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:32.734 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:31 ntpd[4883]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:32.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:31 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:32.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:31 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:32.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:31 ntpd[4883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:32.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:31 ntpd[4883]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:32.746 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:32 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:32.746 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:32 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:32.746 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:32 ntpd[4818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:32.747 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:32 ntpd[4818]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:32.776 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:32 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:32.776 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:32 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:32.776 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:32 ntpd[4883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:32.776 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:32 ntpd[4883]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:33.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:33 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:33.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:33 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:33.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:33 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:33.679 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:33 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:33.682 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:33 ntpd[4818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:33.682 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:33 ntpd[4818]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:33.682 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:33 ntpd[4818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:33.682 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:33 ntpd[4818]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:33.683 INFO:teuthology.orchestra.run.trial121.stdout:13 Feb 02:29:33 ntpd[4818]: ntpd: time set -0.244999 s 2026-02-13T02:29:33.683 INFO:teuthology.orchestra.run.trial121.stdout:ntpd: time set -0.244999s 2026-02-13T02:29:33.683 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:33 ntpd[4818]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-13T02:29:33.683 INFO:teuthology.orchestra.run.trial121.stderr:13 Feb 02:29:33 ntpd[4818]: can't open /var/log/ntpstats/loopstats.20260213: Permission denied 2026-02-13T02:29:33.706 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:32 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:33.706 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:32 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:33.743 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:32 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:33.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:32 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:33.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:32 ntpd[4883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:33.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:32 ntpd[4883]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:33.745 INFO:teuthology.orchestra.run.trial121.stdout: remote refid st t when poll reach delay offset jitter 2026-02-13T02:29:33.745 INFO:teuthology.orchestra.run.trial121.stdout:============================================================================== 2026-02-13T02:29:33.745 INFO:teuthology.orchestra.run.trial121.stdout: 172-234-44-141. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-13T02:29:33.745 INFO:teuthology.orchestra.run.trial121.stdout: time4.lshiy.com .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-13T02:29:33.745 INFO:teuthology.orchestra.run.trial121.stdout: nyc2.us.ntp.li .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-13T02:29:33.745 INFO:teuthology.orchestra.run.trial121.stdout: time.ecansol.ne .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-13T02:29:34.707 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:33 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:34.707 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:33 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:34.707 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:33 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:34.707 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:33 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:34.707 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:33 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:34.707 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:33 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:34.733 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:33 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:34.734 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:33 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:34.734 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:33 ntpd[4883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:34.734 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:33 ntpd[4883]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:34.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:33 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:34.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:33 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:34.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:33 ntpd[4883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:34.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:33 ntpd[4883]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:34.778 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:34 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:34.778 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:34 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:34.779 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:34 ntpd[4883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:34.779 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:34 ntpd[4883]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:35.706 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:34 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:35.706 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:34 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:35.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:34 ntpd[4883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T02:29:35.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:34 ntpd[4883]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T02:29:35.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:34 ntpd[4883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T02:29:35.744 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:34 ntpd[4883]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T02:29:35.745 INFO:teuthology.orchestra.run.trial178.stdout:13 Feb 02:29:35 ntpd[4883]: ntpd: time set +0.768105 s 2026-02-13T02:29:35.745 INFO:teuthology.orchestra.run.trial178.stdout:ntpd: time set +0.768105s 2026-02-13T02:29:35.745 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:35 ntpd[4883]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-13T02:29:35.745 INFO:teuthology.orchestra.run.trial178.stderr:13 Feb 02:29:35 ntpd[4883]: can't open /var/log/ntpstats/loopstats.20260213: Permission denied 2026-02-13T02:29:35.800 INFO:teuthology.orchestra.run.trial178.stdout: remote refid st t when poll reach delay offset jitter 2026-02-13T02:29:35.800 INFO:teuthology.orchestra.run.trial178.stdout:============================================================================== 2026-02-13T02:29:35.800 INFO:teuthology.orchestra.run.trial178.stdout: 170-187-147-56. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-13T02:29:35.801 INFO:teuthology.orchestra.run.trial178.stdout: 155.248.196.28 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-13T02:29:35.801 INFO:teuthology.orchestra.run.trial178.stdout: 23.186.168.133 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-13T02:29:35.801 INFO:teuthology.orchestra.run.trial178.stdout: 172-104-209-204 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-13T02:29:35.802 INFO:teuthology.run_tasks:Running task install... 2026-02-13T02:29:35.816 DEBUG:teuthology.task.install:project ceph 2026-02-13T02:29:35.816 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f'}} 2026-02-13T02:29:35.816 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f'} 2026-02-13T02:29:35.817 INFO:teuthology.task.install:Using flavor: default 2026-02-13T02:29:35.825 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-13T02:29:35.825 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2026-02-13T02:29:35.826 DEBUG:teuthology.orchestra.run.trial121:> sudo apt-key list | grep Ceph 2026-02-13T02:29:35.827 DEBUG:teuthology.orchestra.run.trial178:> sudo apt-key list | grep Ceph 2026-02-13T02:29:35.881 INFO:teuthology.orchestra.run.trial121.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-13T02:29:35.894 INFO:teuthology.orchestra.run.trial178.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-13T02:29:35.907 INFO:teuthology.orchestra.run.trial121.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-13T02:29:35.908 INFO:teuthology.orchestra.run.trial121.stdout:uid [ unknown] Ceph.com (release key) 2026-02-13T02:29:35.909 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-osd, ceph-osd-classic, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2026-02-13T02:29:35.909 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2026-02-13T02:29:35.909 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T02:29:35.923 INFO:teuthology.orchestra.run.trial178.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-13T02:29:35.924 INFO:teuthology.orchestra.run.trial178.stdout:uid [ unknown] Ceph.com (release key) 2026-02-13T02:29:35.925 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-osd, ceph-osd-classic, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2026-02-13T02:29:35.925 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2026-02-13T02:29:35.925 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T02:29:36.102 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default/ 2026-02-13T02:29:36.102 INFO:teuthology.task.install.deb:Package version is 20.3.0-5241-g8f8d3829-1jammy 2026-02-13T02:29:36.113 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default/ 2026-02-13T02:29:36.113 INFO:teuthology.task.install.deb:Package version is 20.3.0-5241-g8f8d3829-1jammy 2026-02-13T02:29:36.263 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:29:36.263 DEBUG:teuthology.orchestra.run.trial121:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-13T02:29:36.273 DEBUG:teuthology.orchestra.run.trial178:> set -ex 2026-02-13T02:29:36.273 DEBUG:teuthology.orchestra.run.trial178:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-13T02:29:36.274 DEBUG:teuthology.orchestra.run.trial121:> sudo apt-get update 2026-02-13T02:29:36.284 DEBUG:teuthology.orchestra.run.trial178:> sudo apt-get update 2026-02-13T02:29:36.436 INFO:teuthology.orchestra.run.trial178.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy InRelease 2026-02-13T02:29:36.436 INFO:teuthology.orchestra.run.trial121.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy InRelease 2026-02-13T02:29:36.447 INFO:teuthology.orchestra.run.trial178.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy Release [7689 B] 2026-02-13T02:29:36.448 INFO:teuthology.orchestra.run.trial121.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy Release [7689 B] 2026-02-13T02:29:36.458 INFO:teuthology.orchestra.run.trial178.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-13T02:29:36.459 INFO:teuthology.orchestra.run.trial121.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-13T02:29:36.465 INFO:teuthology.orchestra.run.trial178.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-13T02:29:36.470 INFO:teuthology.orchestra.run.trial178.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [19.2 kB] 2026-02-13T02:29:36.471 INFO:teuthology.orchestra.run.trial121.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [19.2 kB] 2026-02-13T02:29:36.551 INFO:teuthology.orchestra.run.trial178.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-13T02:29:36.560 INFO:teuthology.orchestra.run.trial178.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-13T02:29:36.570 INFO:teuthology.orchestra.run.trial178.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-13T02:29:36.706 INFO:teuthology.orchestra.run.trial121.stdout:Hit:5 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-13T02:29:36.773 INFO:teuthology.orchestra.run.trial121.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-13T02:29:36.818 INFO:teuthology.orchestra.run.trial178.stdout:Fetched 26.9 kB in 0s (71.8 kB/s) 2026-02-13T02:29:36.846 INFO:teuthology.orchestra.run.trial121.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-13T02:29:36.918 INFO:teuthology.orchestra.run.trial121.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-13T02:29:37.062 INFO:teuthology.orchestra.run.trial121.stdout:Fetched 26.9 kB in 1s (42.8 kB/s) 2026-02-13T02:29:37.351 INFO:teuthology.orchestra.run.trial178.stdout:Reading package lists... 2026-02-13T02:29:37.365 DEBUG:teuthology.orchestra.run.trial178:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=20.3.0-5241-g8f8d3829-1jammy cephadm=20.3.0-5241-g8f8d3829-1jammy ceph-mds=20.3.0-5241-g8f8d3829-1jammy ceph-mgr=20.3.0-5241-g8f8d3829-1jammy ceph-osd=20.3.0-5241-g8f8d3829-1jammy ceph-osd-classic=20.3.0-5241-g8f8d3829-1jammy ceph-common=20.3.0-5241-g8f8d3829-1jammy ceph-fuse=20.3.0-5241-g8f8d3829-1jammy ceph-test=20.3.0-5241-g8f8d3829-1jammy ceph-volume=20.3.0-5241-g8f8d3829-1jammy radosgw=20.3.0-5241-g8f8d3829-1jammy python3-rados=20.3.0-5241-g8f8d3829-1jammy python3-rgw=20.3.0-5241-g8f8d3829-1jammy python3-cephfs=20.3.0-5241-g8f8d3829-1jammy python3-rbd=20.3.0-5241-g8f8d3829-1jammy libcephfs2=20.3.0-5241-g8f8d3829-1jammy libcephfs-dev=20.3.0-5241-g8f8d3829-1jammy librados2=20.3.0-5241-g8f8d3829-1jammy librbd1=20.3.0-5241-g8f8d3829-1jammy rbd-fuse=20.3.0-5241-g8f8d3829-1jammy python3-cephfs=20.3.0-5241-g8f8d3829-1jammy cephfs-shell=20.3.0-5241-g8f8d3829-1jammy cephfs-top=20.3.0-5241-g8f8d3829-1jammy cephfs-mirror=20.3.0-5241-g8f8d3829-1jammy 2026-02-13T02:29:37.399 INFO:teuthology.orchestra.run.trial178.stdout:Reading package lists... 2026-02-13T02:29:37.508 INFO:teuthology.orchestra.run.trial178.stdout:Building dependency tree... 2026-02-13T02:29:37.508 INFO:teuthology.orchestra.run.trial178.stdout:Reading state information... 2026-02-13T02:29:37.571 INFO:teuthology.orchestra.run.trial121.stdout:Reading package lists... 2026-02-13T02:29:37.584 DEBUG:teuthology.orchestra.run.trial121:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=20.3.0-5241-g8f8d3829-1jammy cephadm=20.3.0-5241-g8f8d3829-1jammy ceph-mds=20.3.0-5241-g8f8d3829-1jammy ceph-mgr=20.3.0-5241-g8f8d3829-1jammy ceph-osd=20.3.0-5241-g8f8d3829-1jammy ceph-osd-classic=20.3.0-5241-g8f8d3829-1jammy ceph-common=20.3.0-5241-g8f8d3829-1jammy ceph-fuse=20.3.0-5241-g8f8d3829-1jammy ceph-test=20.3.0-5241-g8f8d3829-1jammy ceph-volume=20.3.0-5241-g8f8d3829-1jammy radosgw=20.3.0-5241-g8f8d3829-1jammy python3-rados=20.3.0-5241-g8f8d3829-1jammy python3-rgw=20.3.0-5241-g8f8d3829-1jammy python3-cephfs=20.3.0-5241-g8f8d3829-1jammy python3-rbd=20.3.0-5241-g8f8d3829-1jammy libcephfs2=20.3.0-5241-g8f8d3829-1jammy libcephfs-dev=20.3.0-5241-g8f8d3829-1jammy librados2=20.3.0-5241-g8f8d3829-1jammy librbd1=20.3.0-5241-g8f8d3829-1jammy rbd-fuse=20.3.0-5241-g8f8d3829-1jammy python3-cephfs=20.3.0-5241-g8f8d3829-1jammy cephfs-shell=20.3.0-5241-g8f8d3829-1jammy cephfs-top=20.3.0-5241-g8f8d3829-1jammy cephfs-mirror=20.3.0-5241-g8f8d3829-1jammy 2026-02-13T02:29:37.599 INFO:teuthology.orchestra.run.trial178.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T02:29:37.599 INFO:teuthology.orchestra.run.trial178.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T02:29:37.599 INFO:teuthology.orchestra.run.trial178.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T02:29:37.599 INFO:teuthology.orchestra.run.trial178.stdout: sg3-utils-udev 2026-02-13T02:29:37.599 INFO:teuthology.orchestra.run.trial178.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T02:29:37.600 INFO:teuthology.orchestra.run.trial178.stdout:The following additional packages will be installed: 2026-02-13T02:29:37.600 INFO:teuthology.orchestra.run.trial178.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-13T02:29:37.600 INFO:teuthology.orchestra.run.trial178.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon jq libcephfs-daemon 2026-02-13T02:29:37.600 INFO:teuthology.orchestra.run.trial178.stdout: libcephfs-proxy2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-13T02:29:37.600 INFO:teuthology.orchestra.run.trial178.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-13T02:29:37.600 INFO:teuthology.orchestra.run.trial178.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2026-02-13T02:29:37.600 INFO:teuthology.orchestra.run.trial178.stdout: nvme-cli python-asyncssh-doc python3-asyncssh python3-cachetools 2026-02-13T02:29:37.600 INFO:teuthology.orchestra.run.trial178.stdout: python3-ceph-argparse python3-ceph-common python3-cheroot python3-cherrypy3 2026-02-13T02:29:37.600 INFO:teuthology.orchestra.run.trial178.stdout: python3-cmd2 python3-google-auth python3-iniconfig python3-jaraco.classes 2026-02-13T02:29:37.600 INFO:teuthology.orchestra.run.trial178.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2026-02-13T02:29:37.600 INFO:teuthology.orchestra.run.trial178.stdout: python3-joblib python3-kubernetes python3-natsort python3-pluggy 2026-02-13T02:29:37.600 INFO:teuthology.orchestra.run.trial178.stdout: python3-portend python3-prettytable python3-psutil python3-py 2026-02-13T02:29:37.601 INFO:teuthology.orchestra.run.trial178.stdout: python3-pygments python3-pyperclip python3-pytest python3-repoze.lru 2026-02-13T02:29:37.601 INFO:teuthology.orchestra.run.trial178.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplejson 2026-02-13T02:29:37.601 INFO:teuthology.orchestra.run.trial178.stdout: python3-sklearn python3-sklearn-lib python3-tempora python3-threadpoolctl 2026-02-13T02:29:37.601 INFO:teuthology.orchestra.run.trial178.stdout: python3-toml python3-wcwidth python3-webob python3-websocket 2026-02-13T02:29:37.601 INFO:teuthology.orchestra.run.trial178.stdout: python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2026-02-13T02:29:37.601 INFO:teuthology.orchestra.run.trial178.stdout:Suggested packages: 2026-02-13T02:29:37.601 INFO:teuthology.orchestra.run.trial178.stdout: python3-influxdb liblua5.3-dev luarocks python-natsort-doc python-psutil-doc 2026-02-13T02:29:37.601 INFO:teuthology.orchestra.run.trial178.stdout: subversion python-pygments-doc ttf-bitstream-vera python3-paste python3-dap 2026-02-13T02:29:37.601 INFO:teuthology.orchestra.run.trial178.stdout: python-sklearn-doc ipython3 python-webob-doc 2026-02-13T02:29:37.601 INFO:teuthology.orchestra.run.trial178.stdout:Recommended packages: 2026-02-13T02:29:37.601 INFO:teuthology.orchestra.run.trial178.stdout: btrfs-tools 2026-02-13T02:29:37.619 INFO:teuthology.orchestra.run.trial121.stdout:Reading package lists... 2026-02-13T02:29:37.635 INFO:teuthology.orchestra.run.trial178.stdout:The following NEW packages will be installed: 2026-02-13T02:29:37.636 INFO:teuthology.orchestra.run.trial178.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-13T02:29:37.636 INFO:teuthology.orchestra.run.trial178.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-13T02:29:37.636 INFO:teuthology.orchestra.run.trial178.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-osd-classic ceph-test 2026-02-13T02:29:37.636 INFO:teuthology.orchestra.run.trial178.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq 2026-02-13T02:29:37.636 INFO:teuthology.orchestra.run.trial178.stdout: libcephfs-daemon libcephfs-dev libcephfs-proxy2 libcephfs2 2026-02-13T02:29:37.636 INFO:teuthology.orchestra.run.trial178.stdout: libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 liboath0 2026-02-13T02:29:37.636 INFO:teuthology.orchestra.run.trial178.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2026-02-13T02:29:37.636 INFO:teuthology.orchestra.run.trial178.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2026-02-13T02:29:37.636 INFO:teuthology.orchestra.run.trial178.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python3-asyncssh 2026-02-13T02:29:37.636 INFO:teuthology.orchestra.run.trial178.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2026-02-13T02:29:37.637 INFO:teuthology.orchestra.run.trial178.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-google-auth 2026-02-13T02:29:37.637 INFO:teuthology.orchestra.run.trial178.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2026-02-13T02:29:37.637 INFO:teuthology.orchestra.run.trial178.stdout: python3-jaraco.functools python3-jaraco.text python3-joblib 2026-02-13T02:29:37.637 INFO:teuthology.orchestra.run.trial178.stdout: python3-kubernetes python3-natsort python3-pluggy python3-portend 2026-02-13T02:29:37.637 INFO:teuthology.orchestra.run.trial178.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-13T02:29:37.637 INFO:teuthology.orchestra.run.trial178.stdout: python3-pyperclip python3-pytest python3-rados python3-rbd 2026-02-13T02:29:37.637 INFO:teuthology.orchestra.run.trial178.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2026-02-13T02:29:37.637 INFO:teuthology.orchestra.run.trial178.stdout: python3-rsa python3-simplejson python3-sklearn python3-sklearn-lib 2026-02-13T02:29:37.637 INFO:teuthology.orchestra.run.trial178.stdout: python3-tempora python3-threadpoolctl python3-toml python3-wcwidth 2026-02-13T02:29:37.637 INFO:teuthology.orchestra.run.trial178.stdout: python3-webob python3-websocket python3-zc.lockfile qttranslations5-l10n 2026-02-13T02:29:37.637 INFO:teuthology.orchestra.run.trial178.stdout: radosgw rbd-fuse socat xmlstarlet 2026-02-13T02:29:37.715 INFO:teuthology.orchestra.run.trial178.stdout:0 upgraded, 92 newly installed, 0 to remove and 38 not upgraded. 2026-02-13T02:29:37.715 INFO:teuthology.orchestra.run.trial178.stdout:Need to get 696 MB of archives. 2026-02-13T02:29:37.715 INFO:teuthology.orchestra.run.trial178.stdout:After this operation, 2591 MB of additional disk space will be used. 2026-02-13T02:29:37.716 INFO:teuthology.orchestra.run.trial178.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 20.3.0-5241-g8f8d3829-1jammy [3797 kB] 2026-02-13T02:29:37.724 INFO:teuthology.orchestra.run.trial121.stdout:Building dependency tree... 2026-02-13T02:29:37.725 INFO:teuthology.orchestra.run.trial121.stdout:Reading state information... 2026-02-13T02:29:37.815 INFO:teuthology.orchestra.run.trial121.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T02:29:37.815 INFO:teuthology.orchestra.run.trial121.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T02:29:37.815 INFO:teuthology.orchestra.run.trial121.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T02:29:37.816 INFO:teuthology.orchestra.run.trial121.stdout: sg3-utils-udev 2026-02-13T02:29:37.816 INFO:teuthology.orchestra.run.trial121.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T02:29:37.816 INFO:teuthology.orchestra.run.trial121.stdout:The following additional packages will be installed: 2026-02-13T02:29:37.816 INFO:teuthology.orchestra.run.trial121.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-13T02:29:37.816 INFO:teuthology.orchestra.run.trial121.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon jq libcephfs-daemon 2026-02-13T02:29:37.816 INFO:teuthology.orchestra.run.trial121.stdout: libcephfs-proxy2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-13T02:29:37.816 INFO:teuthology.orchestra.run.trial121.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-13T02:29:37.816 INFO:teuthology.orchestra.run.trial121.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2026-02-13T02:29:37.816 INFO:teuthology.orchestra.run.trial121.stdout: nvme-cli python-asyncssh-doc python3-asyncssh python3-cachetools 2026-02-13T02:29:37.816 INFO:teuthology.orchestra.run.trial121.stdout: python3-ceph-argparse python3-ceph-common python3-cheroot python3-cherrypy3 2026-02-13T02:29:37.816 INFO:teuthology.orchestra.run.trial121.stdout: python3-cmd2 python3-google-auth python3-iniconfig python3-jaraco.classes 2026-02-13T02:29:37.816 INFO:teuthology.orchestra.run.trial121.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2026-02-13T02:29:37.817 INFO:teuthology.orchestra.run.trial121.stdout: python3-joblib python3-kubernetes python3-natsort python3-pluggy 2026-02-13T02:29:37.817 INFO:teuthology.orchestra.run.trial121.stdout: python3-portend python3-prettytable python3-psutil python3-py 2026-02-13T02:29:37.817 INFO:teuthology.orchestra.run.trial121.stdout: python3-pygments python3-pyperclip python3-pytest python3-repoze.lru 2026-02-13T02:29:37.817 INFO:teuthology.orchestra.run.trial121.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplejson 2026-02-13T02:29:37.817 INFO:teuthology.orchestra.run.trial121.stdout: python3-sklearn python3-sklearn-lib python3-tempora python3-threadpoolctl 2026-02-13T02:29:37.817 INFO:teuthology.orchestra.run.trial121.stdout: python3-toml python3-wcwidth python3-webob python3-websocket 2026-02-13T02:29:37.817 INFO:teuthology.orchestra.run.trial121.stdout: python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2026-02-13T02:29:37.817 INFO:teuthology.orchestra.run.trial121.stdout:Suggested packages: 2026-02-13T02:29:37.817 INFO:teuthology.orchestra.run.trial121.stdout: python3-influxdb liblua5.3-dev luarocks python-natsort-doc python-psutil-doc 2026-02-13T02:29:37.817 INFO:teuthology.orchestra.run.trial121.stdout: subversion python-pygments-doc ttf-bitstream-vera python3-paste python3-dap 2026-02-13T02:29:37.817 INFO:teuthology.orchestra.run.trial121.stdout: python-sklearn-doc ipython3 python-webob-doc 2026-02-13T02:29:37.817 INFO:teuthology.orchestra.run.trial121.stdout:Recommended packages: 2026-02-13T02:29:37.818 INFO:teuthology.orchestra.run.trial121.stdout: btrfs-tools 2026-02-13T02:29:37.820 INFO:teuthology.orchestra.run.trial178.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 20.3.0-5241-g8f8d3829-1jammy [2910 kB] 2026-02-13T02:29:37.851 INFO:teuthology.orchestra.run.trial121.stdout:The following NEW packages will be installed: 2026-02-13T02:29:37.851 INFO:teuthology.orchestra.run.trial121.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-13T02:29:37.851 INFO:teuthology.orchestra.run.trial121.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-13T02:29:37.851 INFO:teuthology.orchestra.run.trial121.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-osd-classic ceph-test 2026-02-13T02:29:37.851 INFO:teuthology.orchestra.run.trial121.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq 2026-02-13T02:29:37.851 INFO:teuthology.orchestra.run.trial121.stdout: libcephfs-daemon libcephfs-dev libcephfs-proxy2 libcephfs2 2026-02-13T02:29:37.851 INFO:teuthology.orchestra.run.trial121.stdout: libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 liboath0 2026-02-13T02:29:37.852 INFO:teuthology.orchestra.run.trial121.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2026-02-13T02:29:37.852 INFO:teuthology.orchestra.run.trial121.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2026-02-13T02:29:37.852 INFO:teuthology.orchestra.run.trial121.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python3-asyncssh 2026-02-13T02:29:37.852 INFO:teuthology.orchestra.run.trial121.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2026-02-13T02:29:37.852 INFO:teuthology.orchestra.run.trial121.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-google-auth 2026-02-13T02:29:37.852 INFO:teuthology.orchestra.run.trial121.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2026-02-13T02:29:37.852 INFO:teuthology.orchestra.run.trial121.stdout: python3-jaraco.functools python3-jaraco.text python3-joblib 2026-02-13T02:29:37.852 INFO:teuthology.orchestra.run.trial121.stdout: python3-kubernetes python3-natsort python3-pluggy python3-portend 2026-02-13T02:29:37.852 INFO:teuthology.orchestra.run.trial121.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-13T02:29:37.852 INFO:teuthology.orchestra.run.trial121.stdout: python3-pyperclip python3-pytest python3-rados python3-rbd 2026-02-13T02:29:37.852 INFO:teuthology.orchestra.run.trial121.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2026-02-13T02:29:37.852 INFO:teuthology.orchestra.run.trial121.stdout: python3-rsa python3-simplejson python3-sklearn python3-sklearn-lib 2026-02-13T02:29:37.853 INFO:teuthology.orchestra.run.trial121.stdout: python3-tempora python3-threadpoolctl python3-toml python3-wcwidth 2026-02-13T02:29:37.853 INFO:teuthology.orchestra.run.trial121.stdout: python3-webob python3-websocket python3-zc.lockfile qttranslations5-l10n 2026-02-13T02:29:37.853 INFO:teuthology.orchestra.run.trial121.stdout: radosgw rbd-fuse socat xmlstarlet 2026-02-13T02:29:37.859 INFO:teuthology.orchestra.run.trial178.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 20.3.0-5241-g8f8d3829-1jammy [882 kB] 2026-02-13T02:29:37.873 INFO:teuthology.orchestra.run.trial178.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 20.3.0-5241-g8f8d3829-1jammy [359 kB] 2026-02-13T02:29:37.879 INFO:teuthology.orchestra.run.trial178.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 20.3.0-5241-g8f8d3829-1jammy [32.8 kB] 2026-02-13T02:29:37.879 INFO:teuthology.orchestra.run.trial178.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 20.3.0-5241-g8f8d3829-1jammy [225 kB] 2026-02-13T02:29:37.883 INFO:teuthology.orchestra.run.trial178.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 20.3.0-5241-g8f8d3829-1jammy [88.3 kB] 2026-02-13T02:29:37.884 INFO:teuthology.orchestra.run.trial178.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 20.3.0-5241-g8f8d3829-1jammy [339 kB] 2026-02-13T02:29:37.890 INFO:teuthology.orchestra.run.trial178.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 20.3.0-5241-g8f8d3829-1jammy [9086 kB] 2026-02-13T02:29:37.950 INFO:teuthology.orchestra.run.trial121.stdout:0 upgraded, 92 newly installed, 0 to remove and 38 not upgraded. 2026-02-13T02:29:37.950 INFO:teuthology.orchestra.run.trial121.stdout:Need to get 696 MB of archives. 2026-02-13T02:29:37.950 INFO:teuthology.orchestra.run.trial121.stdout:After this operation, 2591 MB of additional disk space will be used. 2026-02-13T02:29:37.951 INFO:teuthology.orchestra.run.trial121.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2026-02-13T02:29:37.963 INFO:teuthology.orchestra.run.trial121.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-13T02:29:37.969 INFO:teuthology.orchestra.run.trial121.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2026-02-13T02:29:37.989 INFO:teuthology.orchestra.run.trial121.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-13T02:29:37.990 INFO:teuthology.orchestra.run.trial178.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2026-02-13T02:29:38.000 INFO:teuthology.orchestra.run.trial121.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-13T02:29:38.002 INFO:teuthology.orchestra.run.trial121.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-13T02:29:38.008 INFO:teuthology.orchestra.run.trial121.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-13T02:29:38.030 INFO:teuthology.orchestra.run.trial121.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-13T02:29:38.031 INFO:teuthology.orchestra.run.trial121.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-13T02:29:38.036 INFO:teuthology.orchestra.run.trial121.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-13T02:29:38.038 INFO:teuthology.orchestra.run.trial121.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-13T02:29:38.039 INFO:teuthology.orchestra.run.trial121.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-13T02:29:38.040 INFO:teuthology.orchestra.run.trial121.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-13T02:29:38.040 INFO:teuthology.orchestra.run.trial178.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 20.3.0-5241-g8f8d3829-1jammy [112 kB] 2026-02-13T02:29:38.041 INFO:teuthology.orchestra.run.trial178.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 20.3.0-5241-g8f8d3829-1jammy [261 kB] 2026-02-13T02:29:38.044 INFO:teuthology.orchestra.run.trial121.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-13T02:29:38.044 INFO:teuthology.orchestra.run.trial178.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 20.3.0-5241-g8f8d3829-1jammy [31.5 MB] 2026-02-13T02:29:38.045 INFO:teuthology.orchestra.run.trial121.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-13T02:29:38.045 INFO:teuthology.orchestra.run.trial121.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-13T02:29:38.046 INFO:teuthology.orchestra.run.trial121.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-13T02:29:38.050 INFO:teuthology.orchestra.run.trial121.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-13T02:29:38.051 INFO:teuthology.orchestra.run.trial121.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-13T02:29:38.051 INFO:teuthology.orchestra.run.trial121.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-13T02:29:38.051 INFO:teuthology.orchestra.run.trial121.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-13T02:29:38.060 INFO:teuthology.orchestra.run.trial121.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-13T02:29:38.060 INFO:teuthology.orchestra.run.trial121.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-13T02:29:38.062 INFO:teuthology.orchestra.run.trial121.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-13T02:29:38.062 INFO:teuthology.orchestra.run.trial121.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-13T02:29:38.063 INFO:teuthology.orchestra.run.trial121.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-13T02:29:38.065 INFO:teuthology.orchestra.run.trial121.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-13T02:29:38.070 INFO:teuthology.orchestra.run.trial121.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-13T02:29:38.070 INFO:teuthology.orchestra.run.trial121.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-13T02:29:38.085 INFO:teuthology.orchestra.run.trial178.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-13T02:29:38.085 INFO:teuthology.orchestra.run.trial121.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-13T02:29:38.086 INFO:teuthology.orchestra.run.trial121.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-13T02:29:38.087 INFO:teuthology.orchestra.run.trial121.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-13T02:29:38.095 INFO:teuthology.orchestra.run.trial121.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-13T02:29:38.096 INFO:teuthology.orchestra.run.trial121.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-13T02:29:38.096 INFO:teuthology.orchestra.run.trial121.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-13T02:29:38.096 INFO:teuthology.orchestra.run.trial121.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-13T02:29:38.096 INFO:teuthology.orchestra.run.trial121.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-13T02:29:38.097 INFO:teuthology.orchestra.run.trial121.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-13T02:29:38.099 INFO:teuthology.orchestra.run.trial121.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-13T02:29:38.100 INFO:teuthology.orchestra.run.trial121.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-13T02:29:38.100 INFO:teuthology.orchestra.run.trial121.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-13T02:29:38.108 INFO:teuthology.orchestra.run.trial121.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-13T02:29:38.109 INFO:teuthology.orchestra.run.trial121.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-13T02:29:38.110 INFO:teuthology.orchestra.run.trial121.stdout:Get:44 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 20.3.0-5241-g8f8d3829-1jammy [3797 kB] 2026-02-13T02:29:38.110 INFO:teuthology.orchestra.run.trial121.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-13T02:29:38.112 INFO:teuthology.orchestra.run.trial121.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-13T02:29:38.117 INFO:teuthology.orchestra.run.trial121.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-13T02:29:38.118 INFO:teuthology.orchestra.run.trial121.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-13T02:29:38.118 INFO:teuthology.orchestra.run.trial121.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-13T02:29:38.118 INFO:teuthology.orchestra.run.trial121.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-13T02:29:38.119 INFO:teuthology.orchestra.run.trial121.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-13T02:29:38.121 INFO:teuthology.orchestra.run.trial121.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-13T02:29:38.127 INFO:teuthology.orchestra.run.trial121.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-13T02:29:38.127 INFO:teuthology.orchestra.run.trial178.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2026-02-13T02:29:38.128 INFO:teuthology.orchestra.run.trial121.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-13T02:29:38.128 INFO:teuthology.orchestra.run.trial121.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-13T02:29:38.128 INFO:teuthology.orchestra.run.trial121.stdout:Get:56 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-13T02:29:38.274 INFO:teuthology.orchestra.run.trial178.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-13T02:29:38.359 INFO:teuthology.orchestra.run.trial178.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-13T02:29:38.370 INFO:teuthology.orchestra.run.trial178.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-13T02:29:38.414 INFO:teuthology.orchestra.run.trial178.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-13T02:29:38.567 INFO:teuthology.orchestra.run.trial178.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-13T02:29:38.576 INFO:teuthology.orchestra.run.trial178.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-13T02:29:38.600 INFO:teuthology.orchestra.run.trial178.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-13T02:29:38.602 INFO:teuthology.orchestra.run.trial178.stdout:Get:23 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 20.3.0-5241-g8f8d3829-1jammy [4982 kB] 2026-02-13T02:29:38.607 INFO:teuthology.orchestra.run.trial178.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-13T02:29:38.609 INFO:teuthology.orchestra.run.trial178.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-13T02:29:38.610 INFO:teuthology.orchestra.run.trial178.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-13T02:29:38.626 INFO:teuthology.orchestra.run.trial178.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-13T02:29:38.626 INFO:teuthology.orchestra.run.trial178.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-13T02:29:38.627 INFO:teuthology.orchestra.run.trial178.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-13T02:29:38.639 INFO:teuthology.orchestra.run.trial178.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-13T02:29:38.685 INFO:teuthology.orchestra.run.trial178.stdout:Get:31 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 20.3.0-5241-g8f8d3829-1jammy [293 kB] 2026-02-13T02:29:38.690 INFO:teuthology.orchestra.run.trial178.stdout:Get:32 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 20.3.0-5241-g8f8d3829-1jammy [127 kB] 2026-02-13T02:29:38.692 INFO:teuthology.orchestra.run.trial178.stdout:Get:33 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 20.3.0-5241-g8f8d3829-1jammy [925 kB] 2026-02-13T02:29:38.699 INFO:teuthology.orchestra.run.trial178.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-13T02:29:38.700 INFO:teuthology.orchestra.run.trial178.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-13T02:29:38.700 INFO:teuthology.orchestra.run.trial178.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-13T02:29:38.700 INFO:teuthology.orchestra.run.trial178.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-13T02:29:38.701 INFO:teuthology.orchestra.run.trial178.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-13T02:29:38.701 INFO:teuthology.orchestra.run.trial178.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-13T02:29:38.702 INFO:teuthology.orchestra.run.trial178.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-13T02:29:38.711 INFO:teuthology.orchestra.run.trial178.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-13T02:29:38.712 INFO:teuthology.orchestra.run.trial178.stdout:Get:42 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 20.3.0-5241-g8f8d3829-1jammy [7537 kB] 2026-02-13T02:29:38.712 INFO:teuthology.orchestra.run.trial178.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-13T02:29:38.775 INFO:teuthology.orchestra.run.trial178.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-13T02:29:38.775 INFO:teuthology.orchestra.run.trial178.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-13T02:29:38.776 INFO:teuthology.orchestra.run.trial178.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-13T02:29:38.799 INFO:teuthology.orchestra.run.trial178.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-13T02:29:38.800 INFO:teuthology.orchestra.run.trial178.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-13T02:29:38.801 INFO:teuthology.orchestra.run.trial178.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-13T02:29:38.850 INFO:teuthology.orchestra.run.trial178.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-classic amd64 20.3.0-5241-g8f8d3829-1jammy [468 MB] 2026-02-13T02:29:38.860 INFO:teuthology.orchestra.run.trial178.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-13T02:29:38.860 INFO:teuthology.orchestra.run.trial178.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-13T02:29:38.861 INFO:teuthology.orchestra.run.trial178.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-13T02:29:38.861 INFO:teuthology.orchestra.run.trial178.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-13T02:29:38.861 INFO:teuthology.orchestra.run.trial178.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-13T02:29:38.862 INFO:teuthology.orchestra.run.trial178.stdout:Get:56 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-13T02:29:38.922 INFO:teuthology.orchestra.run.trial121.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 20.3.0-5241-g8f8d3829-1jammy [2910 kB] 2026-02-13T02:29:38.930 INFO:teuthology.orchestra.run.trial178.stdout:Get:57 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-13T02:29:38.931 INFO:teuthology.orchestra.run.trial178.stdout:Get:58 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-13T02:29:38.932 INFO:teuthology.orchestra.run.trial178.stdout:Get:59 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-13T02:29:39.002 INFO:teuthology.orchestra.run.trial178.stdout:Get:60 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-13T02:29:39.005 INFO:teuthology.orchestra.run.trial178.stdout:Get:61 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-13T02:29:39.007 INFO:teuthology.orchestra.run.trial178.stdout:Get:62 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-13T02:29:39.011 INFO:teuthology.orchestra.run.trial178.stdout:Get:63 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-13T02:29:39.013 INFO:teuthology.orchestra.run.trial178.stdout:Get:64 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-13T02:29:39.014 INFO:teuthology.orchestra.run.trial178.stdout:Get:65 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-13T02:29:39.014 INFO:teuthology.orchestra.run.trial178.stdout:Get:66 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-13T02:29:39.074 INFO:teuthology.orchestra.run.trial178.stdout:Get:67 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-13T02:29:39.075 INFO:teuthology.orchestra.run.trial178.stdout:Get:68 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-13T02:29:39.081 INFO:teuthology.orchestra.run.trial178.stdout:Get:69 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-13T02:29:39.147 INFO:teuthology.orchestra.run.trial178.stdout:Get:70 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-13T02:29:39.148 INFO:teuthology.orchestra.run.trial178.stdout:Get:71 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-13T02:29:39.149 INFO:teuthology.orchestra.run.trial178.stdout:Get:72 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-13T02:29:39.150 INFO:teuthology.orchestra.run.trial178.stdout:Get:73 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-13T02:29:39.217 INFO:teuthology.orchestra.run.trial121.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 20.3.0-5241-g8f8d3829-1jammy [882 kB] 2026-02-13T02:29:39.331 INFO:teuthology.orchestra.run.trial121.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 20.3.0-5241-g8f8d3829-1jammy [359 kB] 2026-02-13T02:29:39.385 INFO:teuthology.orchestra.run.trial121.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 20.3.0-5241-g8f8d3829-1jammy [32.8 kB] 2026-02-13T02:29:39.386 INFO:teuthology.orchestra.run.trial121.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 20.3.0-5241-g8f8d3829-1jammy [225 kB] 2026-02-13T02:29:39.390 INFO:teuthology.orchestra.run.trial121.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 20.3.0-5241-g8f8d3829-1jammy [88.3 kB] 2026-02-13T02:29:39.391 INFO:teuthology.orchestra.run.trial121.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 20.3.0-5241-g8f8d3829-1jammy [339 kB] 2026-02-13T02:29:39.446 INFO:teuthology.orchestra.run.trial121.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 20.3.0-5241-g8f8d3829-1jammy [9086 kB] 2026-02-13T02:29:40.088 INFO:teuthology.orchestra.run.trial121.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 20.3.0-5241-g8f8d3829-1jammy [112 kB] 2026-02-13T02:29:40.089 INFO:teuthology.orchestra.run.trial121.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 20.3.0-5241-g8f8d3829-1jammy [261 kB] 2026-02-13T02:29:40.144 INFO:teuthology.orchestra.run.trial121.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 20.3.0-5241-g8f8d3829-1jammy [31.5 MB] 2026-02-13T02:29:41.351 INFO:teuthology.orchestra.run.trial121.stdout:Get:68 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 20.3.0-5241-g8f8d3829-1jammy [4982 kB] 2026-02-13T02:29:41.517 INFO:teuthology.orchestra.run.trial121.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 20.3.0-5241-g8f8d3829-1jammy [293 kB] 2026-02-13T02:29:41.547 INFO:teuthology.orchestra.run.trial121.stdout:Get:70 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 20.3.0-5241-g8f8d3829-1jammy [127 kB] 2026-02-13T02:29:41.548 INFO:teuthology.orchestra.run.trial121.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 20.3.0-5241-g8f8d3829-1jammy [925 kB] 2026-02-13T02:29:41.563 INFO:teuthology.orchestra.run.trial121.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 20.3.0-5241-g8f8d3829-1jammy [7537 kB] 2026-02-13T02:29:41.834 INFO:teuthology.orchestra.run.trial121.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-classic amd64 20.3.0-5241-g8f8d3829-1jammy [468 MB] 2026-02-13T02:29:52.983 INFO:teuthology.orchestra.run.trial178.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 20.3.0-5241-g8f8d3829-1jammy [180 kB] 2026-02-13T02:29:52.984 INFO:teuthology.orchestra.run.trial178.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 20.3.0-5241-g8f8d3829-1jammy [14.0 kB] 2026-02-13T02:29:52.984 INFO:teuthology.orchestra.run.trial178.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 20.3.0-5241-g8f8d3829-1jammy [1030 kB] 2026-02-13T02:29:52.990 INFO:teuthology.orchestra.run.trial178.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 20.3.0-5241-g8f8d3829-1jammy [2439 kB] 2026-02-13T02:29:53.002 INFO:teuthology.orchestra.run.trial178.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 20.3.0-5241-g8f8d3829-1jammy [1069 kB] 2026-02-13T02:29:53.026 INFO:teuthology.orchestra.run.trial178.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 20.3.0-5241-g8f8d3829-1jammy [189 kB] 2026-02-13T02:29:53.029 INFO:teuthology.orchestra.run.trial178.stdout:Get:80 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 20.3.0-5241-g8f8d3829-1jammy [48.7 MB] 2026-02-13T02:29:54.580 INFO:teuthology.orchestra.run.trial178.stdout:Get:81 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 20.3.0-5241-g8f8d3829-1jammy [8626 kB] 2026-02-13T02:29:54.838 INFO:teuthology.orchestra.run.trial178.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 20.3.0-5241-g8f8d3829-1jammy [14.2 kB] 2026-02-13T02:29:54.838 INFO:teuthology.orchestra.run.trial178.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 20.3.0-5241-g8f8d3829-1jammy [68.6 MB] 2026-02-13T02:29:57.115 INFO:teuthology.orchestra.run.trial178.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 20.3.0-5241-g8f8d3829-1jammy [136 kB] 2026-02-13T02:29:57.117 INFO:teuthology.orchestra.run.trial178.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 20.3.0-5241-g8f8d3829-1jammy [252 kB] 2026-02-13T02:29:57.122 INFO:teuthology.orchestra.run.trial178.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 20.3.0-5241-g8f8d3829-1jammy [34.1 kB] 2026-02-13T02:29:57.123 INFO:teuthology.orchestra.run.trial178.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 20.3.0-5241-g8f8d3829-1jammy [23.6 kB] 2026-02-13T02:29:57.124 INFO:teuthology.orchestra.run.trial178.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-daemon amd64 20.3.0-5241-g8f8d3829-1jammy [44.7 kB] 2026-02-13T02:29:57.135 INFO:teuthology.orchestra.run.trial178.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-proxy2 amd64 20.3.0-5241-g8f8d3829-1jammy [31.3 kB] 2026-02-13T02:29:57.136 INFO:teuthology.orchestra.run.trial178.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 20.3.0-5241-g8f8d3829-1jammy [44.2 kB] 2026-02-13T02:29:57.137 INFO:teuthology.orchestra.run.trial178.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 20.3.0-5241-g8f8d3829-1jammy [18.3 MB] 2026-02-13T02:29:57.663 INFO:teuthology.orchestra.run.trial178.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 20.3.0-5241-g8f8d3829-1jammy [93.8 kB] 2026-02-13T02:29:57.702 INFO:teuthology.orchestra.run.trial121.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 20.3.0-5241-g8f8d3829-1jammy [180 kB] 2026-02-13T02:29:57.703 INFO:teuthology.orchestra.run.trial121.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 20.3.0-5241-g8f8d3829-1jammy [14.0 kB] 2026-02-13T02:29:57.704 INFO:teuthology.orchestra.run.trial121.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 20.3.0-5241-g8f8d3829-1jammy [1030 kB] 2026-02-13T02:29:57.709 INFO:teuthology.orchestra.run.trial121.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 20.3.0-5241-g8f8d3829-1jammy [2439 kB] 2026-02-13T02:29:57.721 INFO:teuthology.orchestra.run.trial121.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 20.3.0-5241-g8f8d3829-1jammy [1069 kB] 2026-02-13T02:29:57.727 INFO:teuthology.orchestra.run.trial121.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 20.3.0-5241-g8f8d3829-1jammy [189 kB] 2026-02-13T02:29:57.729 INFO:teuthology.orchestra.run.trial121.stdout:Get:80 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 20.3.0-5241-g8f8d3829-1jammy [48.7 MB] 2026-02-13T02:29:57.981 INFO:teuthology.orchestra.run.trial178.stdout:Fetched 696 MB in 20s (34.8 MB/s) 2026-02-13T02:29:58.002 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-pyperclip. 2026-02-13T02:29:58.158 INFO:teuthology.orchestra.run.trial178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167438 files and directories currently installed.) 2026-02-13T02:29:58.160 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../00-python3-pyperclip_1.8.2-2_all.deb ... 2026-02-13T02:29:58.160 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2026-02-13T02:29:58.176 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-13T02:29:58.183 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../01-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-13T02:29:58.184 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-13T02:29:58.204 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-cmd2. 2026-02-13T02:29:58.215 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../02-python3-cmd2_2.3.3-1_all.deb ... 2026-02-13T02:29:58.215 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2026-02-13T02:29:58.236 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-13T02:29:58.248 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../03-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-13T02:29:58.249 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-13T02:29:58.267 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-13T02:29:58.276 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../04-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-13T02:29:58.276 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-13T02:29:58.292 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-13T02:29:58.302 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../05-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-13T02:29:58.302 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-13T02:29:58.319 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-13T02:29:58.327 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../06-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-13T02:29:58.331 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T02:29:58.363 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-13T02:29:58.371 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../07-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-13T02:29:58.372 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T02:29:58.387 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-13T02:29:58.395 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../08-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-13T02:29:58.395 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T02:29:58.415 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-13T02:29:58.423 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../09-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-13T02:29:58.424 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-13T02:29:58.439 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package librados2. 2026-02-13T02:29:58.447 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../10-librados2_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:29:58.447 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking librados2 (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:29:58.489 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libnbd0. 2026-02-13T02:29:58.498 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../11-libnbd0_1.10.5-1_amd64.deb ... 2026-02-13T02:29:58.498 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-13T02:29:58.513 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package librbd1. 2026-02-13T02:29:58.520 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../12-librbd1_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:29:58.521 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking librbd1 (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:29:58.530 INFO:teuthology.orchestra.run.trial121.stdout:Get:81 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 20.3.0-5241-g8f8d3829-1jammy [8626 kB] 2026-02-13T02:29:58.559 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libcephfs2. 2026-02-13T02:29:58.568 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../13-libcephfs2_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:29:58.568 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libcephfs2 (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:29:58.588 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-rados. 2026-02-13T02:29:58.595 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../14-python3-rados_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:29:58.596 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-rados (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:29:58.613 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-13T02:29:58.621 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../15-python3-ceph-argparse_20.3.0-5241-g8f8d3829-1jammy_all.deb ... 2026-02-13T02:29:58.622 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-ceph-argparse (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:29:58.635 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-cephfs. 2026-02-13T02:29:58.643 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../16-python3-cephfs_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:29:58.643 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-cephfs (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:29:58.654 INFO:teuthology.orchestra.run.trial121.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 20.3.0-5241-g8f8d3829-1jammy [14.2 kB] 2026-02-13T02:29:58.654 INFO:teuthology.orchestra.run.trial121.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 20.3.0-5241-g8f8d3829-1jammy [68.6 MB] 2026-02-13T02:29:58.660 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-13T02:29:58.668 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../17-python3-ceph-common_20.3.0-5241-g8f8d3829-1jammy_all.deb ... 2026-02-13T02:29:58.668 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-ceph-common (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:29:58.686 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-prettytable. 2026-02-13T02:29:58.694 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../18-python3-prettytable_2.5.0-2_all.deb ... 2026-02-13T02:29:58.694 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-13T02:29:58.710 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-rbd. 2026-02-13T02:29:58.718 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../19-python3-rbd_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:29:58.718 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-rbd (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:29:58.735 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-13T02:29:58.743 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../20-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-13T02:29:58.743 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-13T02:29:58.761 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package librgw2. 2026-02-13T02:29:58.769 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../21-librgw2_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:29:58.769 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking librgw2 (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:29:58.868 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-rgw. 2026-02-13T02:29:58.876 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../22-python3-rgw_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:29:58.877 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-rgw (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:29:58.892 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-13T02:29:58.900 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../23-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-13T02:29:58.901 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-13T02:29:58.915 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libradosstriper1. 2026-02-13T02:29:58.924 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../24-libradosstriper1_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:29:58.924 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libradosstriper1 (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:29:58.941 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package ceph-common. 2026-02-13T02:29:58.949 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../25-ceph-common_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:29:58.949 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking ceph-common (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:29:59.208 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package ceph-base. 2026-02-13T02:29:59.216 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../26-ceph-base_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:29:59.221 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking ceph-base (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:29:59.279 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-13T02:29:59.287 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../27-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-13T02:29:59.288 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-13T02:29:59.302 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-cheroot. 2026-02-13T02:29:59.310 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../28-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-13T02:29:59.310 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-13T02:29:59.327 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-13T02:29:59.335 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../29-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-13T02:29:59.335 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-13T02:29:59.350 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-13T02:29:59.358 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../30-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-13T02:29:59.358 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-13T02:29:59.373 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-13T02:29:59.381 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../31-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-13T02:29:59.381 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-13T02:29:59.395 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-tempora. 2026-02-13T02:29:59.403 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../32-python3-tempora_4.1.2-1_all.deb ... 2026-02-13T02:29:59.404 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-13T02:29:59.418 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-portend. 2026-02-13T02:29:59.427 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../33-python3-portend_3.0.0-1_all.deb ... 2026-02-13T02:29:59.427 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-13T02:29:59.441 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-13T02:29:59.449 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../34-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-13T02:29:59.449 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-13T02:29:59.464 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-13T02:29:59.472 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../35-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-13T02:29:59.472 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-13T02:29:59.497 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-natsort. 2026-02-13T02:29:59.505 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../36-python3-natsort_8.0.2-1_all.deb ... 2026-02-13T02:29:59.505 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-13T02:29:59.522 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-13T02:29:59.530 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../37-ceph-mgr-modules-core_20.3.0-5241-g8f8d3829-1jammy_all.deb ... 2026-02-13T02:29:59.531 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking ceph-mgr-modules-core (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:29:59.562 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-13T02:29:59.570 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../38-libsqlite3-mod-ceph_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:29:59.570 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libsqlite3-mod-ceph (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:29:59.586 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package ceph-mgr. 2026-02-13T02:29:59.594 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../39-ceph-mgr_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:29:59.594 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking ceph-mgr (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:29:59.615 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package ceph-mon. 2026-02-13T02:29:59.623 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../40-ceph-mon_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:29:59.624 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking ceph-mon (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:29:59.688 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-13T02:29:59.696 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../41-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-13T02:29:59.697 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-13T02:29:59.712 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package ceph-osd-classic. 2026-02-13T02:29:59.720 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../42-ceph-osd-classic_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:29:59.720 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking ceph-osd-classic (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:29:59.789 INFO:teuthology.orchestra.run.trial121.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 20.3.0-5241-g8f8d3829-1jammy [136 kB] 2026-02-13T02:29:59.789 INFO:teuthology.orchestra.run.trial121.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 20.3.0-5241-g8f8d3829-1jammy [252 kB] 2026-02-13T02:29:59.791 INFO:teuthology.orchestra.run.trial121.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 20.3.0-5241-g8f8d3829-1jammy [34.1 kB] 2026-02-13T02:29:59.791 INFO:teuthology.orchestra.run.trial121.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 20.3.0-5241-g8f8d3829-1jammy [23.6 kB] 2026-02-13T02:29:59.791 INFO:teuthology.orchestra.run.trial121.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-daemon amd64 20.3.0-5241-g8f8d3829-1jammy [44.7 kB] 2026-02-13T02:29:59.792 INFO:teuthology.orchestra.run.trial121.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-proxy2 amd64 20.3.0-5241-g8f8d3829-1jammy [31.3 kB] 2026-02-13T02:29:59.792 INFO:teuthology.orchestra.run.trial121.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 20.3.0-5241-g8f8d3829-1jammy [44.2 kB] 2026-02-13T02:29:59.792 INFO:teuthology.orchestra.run.trial121.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 20.3.0-5241-g8f8d3829-1jammy [18.3 MB] 2026-02-13T02:30:00.087 INFO:teuthology.orchestra.run.trial121.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 20.3.0-5241-g8f8d3829-1jammy [93.8 kB] 2026-02-13T02:30:00.399 INFO:teuthology.orchestra.run.trial121.stdout:Fetched 696 MB in 22s (31.3 MB/s) 2026-02-13T02:30:00.415 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-pyperclip. 2026-02-13T02:30:00.571 INFO:teuthology.orchestra.run.trial121.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167438 files and directories currently installed.) 2026-02-13T02:30:00.573 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../00-python3-pyperclip_1.8.2-2_all.deb ... 2026-02-13T02:30:00.574 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2026-02-13T02:30:00.590 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-13T02:30:00.602 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../01-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-13T02:30:00.603 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-13T02:30:00.622 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-cmd2. 2026-02-13T02:30:00.631 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../02-python3-cmd2_2.3.3-1_all.deb ... 2026-02-13T02:30:00.632 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2026-02-13T02:30:00.651 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-13T02:30:00.659 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../03-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-13T02:30:00.660 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-13T02:30:00.676 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-13T02:30:00.684 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../04-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-13T02:30:00.684 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-13T02:30:00.698 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-13T02:30:00.705 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../05-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-13T02:30:00.706 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-13T02:30:00.722 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-13T02:30:00.730 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../06-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-13T02:30:00.735 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T02:30:00.764 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-13T02:30:00.773 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../07-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-13T02:30:00.773 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T02:30:00.789 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-13T02:30:00.797 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../08-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-13T02:30:00.797 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T02:30:00.816 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-13T02:30:00.825 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../09-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-13T02:30:00.825 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-13T02:30:00.840 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package librados2. 2026-02-13T02:30:00.848 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../10-librados2_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:00.849 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking librados2 (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:00.891 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libnbd0. 2026-02-13T02:30:00.899 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../11-libnbd0_1.10.5-1_amd64.deb ... 2026-02-13T02:30:00.899 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-13T02:30:00.914 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package librbd1. 2026-02-13T02:30:00.922 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../12-librbd1_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:00.922 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking librbd1 (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:00.960 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libcephfs2. 2026-02-13T02:30:00.968 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../13-libcephfs2_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:00.968 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libcephfs2 (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:00.988 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-rados. 2026-02-13T02:30:00.996 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../14-python3-rados_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:00.996 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-rados (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:01.012 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-13T02:30:01.020 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../15-python3-ceph-argparse_20.3.0-5241-g8f8d3829-1jammy_all.deb ... 2026-02-13T02:30:01.021 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-ceph-argparse (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:01.035 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-cephfs. 2026-02-13T02:30:01.043 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../16-python3-cephfs_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:01.043 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-cephfs (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:01.058 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-13T02:30:01.067 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../17-python3-ceph-common_20.3.0-5241-g8f8d3829-1jammy_all.deb ... 2026-02-13T02:30:01.067 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-ceph-common (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:01.085 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-prettytable. 2026-02-13T02:30:01.092 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../18-python3-prettytable_2.5.0-2_all.deb ... 2026-02-13T02:30:01.093 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-13T02:30:01.108 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-rbd. 2026-02-13T02:30:01.116 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../19-python3-rbd_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:01.116 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-rbd (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:01.134 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-13T02:30:01.142 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../20-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-13T02:30:01.142 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-13T02:30:01.160 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package librgw2. 2026-02-13T02:30:01.168 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../21-librgw2_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:01.169 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking librgw2 (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:01.271 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-rgw. 2026-02-13T02:30:01.279 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../22-python3-rgw_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:01.280 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-rgw (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:01.295 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-13T02:30:01.302 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../23-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-13T02:30:01.303 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-13T02:30:01.318 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libradosstriper1. 2026-02-13T02:30:01.327 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../24-libradosstriper1_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:01.327 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libradosstriper1 (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:01.344 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package ceph-common. 2026-02-13T02:30:01.351 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../25-ceph-common_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:01.352 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking ceph-common (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:01.618 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package ceph-base. 2026-02-13T02:30:01.627 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../26-ceph-base_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:01.632 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking ceph-base (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:01.690 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-13T02:30:01.699 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../27-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-13T02:30:01.699 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-13T02:30:01.713 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-cheroot. 2026-02-13T02:30:01.722 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../28-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-13T02:30:01.722 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-13T02:30:01.739 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-13T02:30:01.747 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../29-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-13T02:30:01.748 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-13T02:30:01.761 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-13T02:30:01.770 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../30-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-13T02:30:01.770 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-13T02:30:01.785 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-13T02:30:01.793 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../31-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-13T02:30:01.794 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-13T02:30:01.808 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-tempora. 2026-02-13T02:30:01.816 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../32-python3-tempora_4.1.2-1_all.deb ... 2026-02-13T02:30:01.816 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-13T02:30:01.831 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-portend. 2026-02-13T02:30:01.839 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../33-python3-portend_3.0.0-1_all.deb ... 2026-02-13T02:30:01.839 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-13T02:30:01.854 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-13T02:30:01.862 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../34-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-13T02:30:01.862 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-13T02:30:01.877 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-13T02:30:01.885 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../35-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-13T02:30:01.886 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-13T02:30:01.909 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-natsort. 2026-02-13T02:30:01.917 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../36-python3-natsort_8.0.2-1_all.deb ... 2026-02-13T02:30:01.918 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-13T02:30:01.934 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-13T02:30:01.942 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../37-ceph-mgr-modules-core_20.3.0-5241-g8f8d3829-1jammy_all.deb ... 2026-02-13T02:30:01.942 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking ceph-mgr-modules-core (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:01.973 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-13T02:30:01.981 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../38-libsqlite3-mod-ceph_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:01.981 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libsqlite3-mod-ceph (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:01.997 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package ceph-mgr. 2026-02-13T02:30:02.005 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../39-ceph-mgr_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:02.005 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking ceph-mgr (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:02.026 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package ceph-mon. 2026-02-13T02:30:02.035 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../40-ceph-mon_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:02.035 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking ceph-mon (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:02.097 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-13T02:30:02.105 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../41-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-13T02:30:02.105 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-13T02:30:02.120 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package ceph-osd-classic. 2026-02-13T02:30:02.129 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../42-ceph-osd-classic_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:02.129 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking ceph-osd-classic (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:03.636 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package ceph-osd. 2026-02-13T02:30:03.648 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../43-ceph-osd_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:03.648 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking ceph-osd (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:03.667 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package ceph. 2026-02-13T02:30:03.679 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../44-ceph_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:03.680 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking ceph (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:03.694 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package ceph-fuse. 2026-02-13T02:30:03.706 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../45-ceph-fuse_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:03.706 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking ceph-fuse (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:03.731 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package ceph-mds. 2026-02-13T02:30:03.741 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../46-ceph-mds_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:03.742 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking ceph-mds (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:03.774 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package cephadm. 2026-02-13T02:30:03.782 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../47-cephadm_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:03.782 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking cephadm (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:03.800 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-13T02:30:03.808 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../48-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-13T02:30:03.808 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-13T02:30:03.829 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-13T02:30:03.837 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../49-ceph-mgr-cephadm_20.3.0-5241-g8f8d3829-1jammy_all.deb ... 2026-02-13T02:30:03.837 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking ceph-mgr-cephadm (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:03.858 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-13T02:30:03.867 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../50-python3-repoze.lru_0.7-2_all.deb ... 2026-02-13T02:30:03.867 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-13T02:30:03.882 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-routes. 2026-02-13T02:30:03.890 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../51-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-13T02:30:03.890 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-13T02:30:03.911 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-13T02:30:03.918 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../52-ceph-mgr-dashboard_20.3.0-5241-g8f8d3829-1jammy_all.deb ... 2026-02-13T02:30:03.918 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking ceph-mgr-dashboard (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:04.466 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-13T02:30:04.476 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../53-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-13T02:30:04.476 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-13T02:30:04.514 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-joblib. 2026-02-13T02:30:04.523 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../54-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-13T02:30:04.523 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-13T02:30:04.550 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-13T02:30:04.559 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../55-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-13T02:30:04.560 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-13T02:30:04.574 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-sklearn. 2026-02-13T02:30:04.583 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../56-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-13T02:30:04.583 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-13T02:30:04.671 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-13T02:30:04.681 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../57-ceph-mgr-diskprediction-local_20.3.0-5241-g8f8d3829-1jammy_all.deb ... 2026-02-13T02:30:04.681 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking ceph-mgr-diskprediction-local (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:04.843 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-cachetools. 2026-02-13T02:30:04.851 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../58-python3-cachetools_5.0.0-1_all.deb ... 2026-02-13T02:30:04.852 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-13T02:30:04.866 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-rsa. 2026-02-13T02:30:04.874 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../59-python3-rsa_4.8-1_all.deb ... 2026-02-13T02:30:04.875 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-13T02:30:04.893 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-google-auth. 2026-02-13T02:30:04.902 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../60-python3-google-auth_1.5.1-3_all.deb ... 2026-02-13T02:30:04.902 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-13T02:30:04.920 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-13T02:30:04.928 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../61-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-13T02:30:04.928 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-13T02:30:04.944 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-websocket. 2026-02-13T02:30:04.953 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../62-python3-websocket_1.2.3-1_all.deb ... 2026-02-13T02:30:04.954 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-13T02:30:04.971 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-13T02:30:04.979 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../63-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-13T02:30:04.979 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-13T02:30:05.076 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-13T02:30:05.085 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../64-ceph-mgr-k8sevents_20.3.0-5241-g8f8d3829-1jammy_all.deb ... 2026-02-13T02:30:05.086 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking ceph-mgr-k8sevents (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:05.100 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-13T02:30:05.108 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../65-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-13T02:30:05.108 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-13T02:30:05.123 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-13T02:30:05.132 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../66-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-13T02:30:05.132 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-13T02:30:05.147 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package jq. 2026-02-13T02:30:05.155 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../67-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-13T02:30:05.156 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-13T02:30:05.170 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package socat. 2026-02-13T02:30:05.179 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../68-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-13T02:30:05.179 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-13T02:30:05.198 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package xmlstarlet. 2026-02-13T02:30:05.206 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../69-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-13T02:30:05.207 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-13T02:30:05.242 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package ceph-test. 2026-02-13T02:30:05.250 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../70-ceph-test_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:05.251 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking ceph-test (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:05.883 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package ceph-volume. 2026-02-13T02:30:05.891 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../71-ceph-volume_20.3.0-5241-g8f8d3829-1jammy_all.deb ... 2026-02-13T02:30:05.892 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking ceph-volume (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:05.914 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package cephfs-mirror. 2026-02-13T02:30:05.922 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../72-cephfs-mirror_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:05.923 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking cephfs-mirror (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:05.939 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package cephfs-shell. 2026-02-13T02:30:05.948 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../73-cephfs-shell_20.3.0-5241-g8f8d3829-1jammy_all.deb ... 2026-02-13T02:30:05.948 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking cephfs-shell (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:05.964 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package cephfs-top. 2026-02-13T02:30:05.972 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../74-cephfs-top_20.3.0-5241-g8f8d3829-1jammy_all.deb ... 2026-02-13T02:30:05.972 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking cephfs-top (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:05.987 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libcephfs-daemon. 2026-02-13T02:30:05.995 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../75-libcephfs-daemon_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:05.996 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libcephfs-daemon (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:06.010 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libcephfs-proxy2. 2026-02-13T02:30:06.019 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../76-libcephfs-proxy2_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:06.019 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libcephfs-proxy2 (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:06.034 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-13T02:30:06.042 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../77-libcephfs-dev_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:06.043 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libcephfs-dev (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:06.058 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package nvme-cli. 2026-02-13T02:30:06.065 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package ceph-osd. 2026-02-13T02:30:06.067 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../78-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-13T02:30:06.067 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-13T02:30:06.077 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../43-ceph-osd_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:06.078 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking ceph-osd (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:06.097 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package ceph. 2026-02-13T02:30:06.098 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-13T02:30:06.104 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../44-ceph_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:06.105 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking ceph (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:06.106 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../79-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-13T02:30:06.107 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-13T02:30:06.121 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package ceph-fuse. 2026-02-13T02:30:06.133 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../45-ceph-fuse_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:06.133 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking ceph-fuse (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:06.136 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-13T02:30:06.145 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../80-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-13T02:30:06.145 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-13T02:30:06.157 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package ceph-mds. 2026-02-13T02:30:06.160 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-pluggy. 2026-02-13T02:30:06.166 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../46-ceph-mds_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:06.166 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking ceph-mds (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:06.168 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../81-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-13T02:30:06.168 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-13T02:30:06.184 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-psutil. 2026-02-13T02:30:06.193 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../82-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-13T02:30:06.193 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-13T02:30:06.197 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package cephadm. 2026-02-13T02:30:06.206 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../47-cephadm_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:06.206 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking cephadm (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:06.219 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-py. 2026-02-13T02:30:06.223 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-13T02:30:06.227 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../83-python3-py_1.10.0-1_all.deb ... 2026-02-13T02:30:06.228 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-13T02:30:06.231 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../48-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-13T02:30:06.231 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-13T02:30:06.248 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-pygments. 2026-02-13T02:30:06.252 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-13T02:30:06.256 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../84-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-13T02:30:06.257 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-13T02:30:06.260 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../49-ceph-mgr-cephadm_20.3.0-5241-g8f8d3829-1jammy_all.deb ... 2026-02-13T02:30:06.261 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking ceph-mgr-cephadm (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:06.281 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-13T02:30:06.290 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../50-python3-repoze.lru_0.7-2_all.deb ... 2026-02-13T02:30:06.290 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-13T02:30:06.298 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-toml. 2026-02-13T02:30:06.305 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-routes. 2026-02-13T02:30:06.306 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../85-python3-toml_0.10.2-1_all.deb ... 2026-02-13T02:30:06.307 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-13T02:30:06.313 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../51-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-13T02:30:06.314 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-13T02:30:06.322 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-pytest. 2026-02-13T02:30:06.331 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../86-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-13T02:30:06.331 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-13T02:30:06.333 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-13T02:30:06.341 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../52-ceph-mgr-dashboard_20.3.0-5241-g8f8d3829-1jammy_all.deb ... 2026-02-13T02:30:06.342 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking ceph-mgr-dashboard (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:06.353 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-simplejson. 2026-02-13T02:30:06.362 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../87-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-13T02:30:06.362 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-13T02:30:06.381 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package python3-webob. 2026-02-13T02:30:06.389 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../88-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-13T02:30:06.389 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-13T02:30:06.406 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-13T02:30:06.415 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../89-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-13T02:30:06.415 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-13T02:30:06.483 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package radosgw. 2026-02-13T02:30:06.492 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../90-radosgw_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:06.493 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking radosgw (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:06.650 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package rbd-fuse. 2026-02-13T02:30:06.659 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../91-rbd-fuse_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:06.659 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking rbd-fuse (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:06.687 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-13T02:30:06.753 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-13T02:30:06.754 INFO:teuthology.orchestra.run.trial178.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-13T02:30:06.812 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T02:30:06.880 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-13T02:30:06.890 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../53-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-13T02:30:06.890 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-13T02:30:06.929 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-joblib. 2026-02-13T02:30:06.938 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../54-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-13T02:30:06.938 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-13T02:30:06.965 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-13T02:30:06.973 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../55-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-13T02:30:06.974 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-13T02:30:06.989 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-sklearn. 2026-02-13T02:30:06.998 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../56-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-13T02:30:06.998 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-13T02:30:07.079 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-13T02:30:07.088 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../57-ceph-mgr-diskprediction-local_20.3.0-5241-g8f8d3829-1jammy_all.deb ... 2026-02-13T02:30:07.089 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking ceph-mgr-diskprediction-local (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:07.100 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-13T02:30:07.252 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-cachetools. 2026-02-13T02:30:07.261 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../58-python3-cachetools_5.0.0-1_all.deb ... 2026-02-13T02:30:07.261 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-13T02:30:07.275 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-rsa. 2026-02-13T02:30:07.283 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../59-python3-rsa_4.8-1_all.deb ... 2026-02-13T02:30:07.284 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-13T02:30:07.301 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-google-auth. 2026-02-13T02:30:07.310 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../60-python3-google-auth_1.5.1-3_all.deb ... 2026-02-13T02:30:07.310 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-13T02:30:07.327 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-13T02:30:07.335 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../61-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-13T02:30:07.336 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-13T02:30:07.351 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-websocket. 2026-02-13T02:30:07.360 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../62-python3-websocket_1.2.3-1_all.deb ... 2026-02-13T02:30:07.360 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-13T02:30:07.377 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-13T02:30:07.386 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../63-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-13T02:30:07.386 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-13T02:30:07.469 INFO:teuthology.orchestra.run.trial178.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-13T02:30:07.480 INFO:teuthology.orchestra.run.trial178.stdout:Setting up cephadm (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:07.484 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-13T02:30:07.493 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../64-ceph-mgr-k8sevents_20.3.0-5241-g8f8d3829-1jammy_all.deb ... 2026-02-13T02:30:07.493 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking ceph-mgr-k8sevents (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:07.508 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-13T02:30:07.516 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../65-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-13T02:30:07.516 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-13T02:30:07.532 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-13T02:30:07.534 INFO:teuthology.orchestra.run.trial178.stdout:Adding system user cephadm....done 2026-02-13T02:30:07.540 INFO:teuthology.orchestra.run.trial178.stdout:usermod: no changes 2026-02-13T02:30:07.541 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../66-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-13T02:30:07.542 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-13T02:30:07.546 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-13T02:30:07.557 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package jq. 2026-02-13T02:30:07.565 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../67-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-13T02:30:07.566 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-13T02:30:07.580 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package socat. 2026-02-13T02:30:07.589 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../68-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-13T02:30:07.589 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-13T02:30:07.608 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package xmlstarlet. 2026-02-13T02:30:07.616 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../69-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-13T02:30:07.617 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-13T02:30:07.617 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-13T02:30:07.618 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-13T02:30:07.654 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package ceph-test. 2026-02-13T02:30:07.663 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../70-ceph-test_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:07.663 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking ceph-test (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:07.690 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-13T02:30:07.764 INFO:teuthology.orchestra.run.trial178.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-13T02:30:07.765 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-13T02:30:07.860 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-13T02:30:07.984 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-13T02:30:08.058 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-13T02:30:08.132 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-ceph-argparse (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:08.199 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-13T02:30:08.200 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-13T02:30:08.201 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2026-02-13T02:30:08.275 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-13T02:30:08.276 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-13T02:30:08.277 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-13T02:30:08.293 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package ceph-volume. 2026-02-13T02:30:08.302 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../71-ceph-volume_20.3.0-5241-g8f8d3829-1jammy_all.deb ... 2026-02-13T02:30:08.302 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking ceph-volume (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:08.325 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package cephfs-mirror. 2026-02-13T02:30:08.334 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../72-cephfs-mirror_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:08.334 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking cephfs-mirror (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:08.351 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package cephfs-shell. 2026-02-13T02:30:08.360 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../73-cephfs-shell_20.3.0-5241-g8f8d3829-1jammy_all.deb ... 2026-02-13T02:30:08.360 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking cephfs-shell (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:08.374 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package cephfs-top. 2026-02-13T02:30:08.383 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../74-cephfs-top_20.3.0-5241-g8f8d3829-1jammy_all.deb ... 2026-02-13T02:30:08.384 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking cephfs-top (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:08.398 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libcephfs-daemon. 2026-02-13T02:30:08.399 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-13T02:30:08.407 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../75-libcephfs-daemon_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:08.407 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libcephfs-daemon (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:08.421 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libcephfs-proxy2. 2026-02-13T02:30:08.430 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../76-libcephfs-proxy2_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:08.430 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libcephfs-proxy2 (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:08.445 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-13T02:30:08.454 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../77-libcephfs-dev_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:08.454 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libcephfs-dev (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:08.470 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package nvme-cli. 2026-02-13T02:30:08.475 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libcephfs-proxy2 (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:08.476 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-13T02:30:08.479 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../78-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-13T02:30:08.479 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-13T02:30:08.510 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-13T02:30:08.518 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../79-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-13T02:30:08.519 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-13T02:30:08.550 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-13T02:30:08.552 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-13T02:30:08.558 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../80-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-13T02:30:08.559 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-13T02:30:08.574 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-pluggy. 2026-02-13T02:30:08.582 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../81-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-13T02:30:08.583 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-13T02:30:08.599 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-psutil. 2026-02-13T02:30:08.608 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../82-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-13T02:30:08.608 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-13T02:30:08.634 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-py. 2026-02-13T02:30:08.643 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../83-python3-py_1.10.0-1_all.deb ... 2026-02-13T02:30:08.643 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-13T02:30:08.643 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-13T02:30:08.663 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-pygments. 2026-02-13T02:30:08.672 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../84-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-13T02:30:08.673 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-13T02:30:08.714 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-toml. 2026-02-13T02:30:08.723 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../85-python3-toml_0.10.2-1_all.deb ... 2026-02-13T02:30:08.723 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-13T02:30:08.738 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-pytest. 2026-02-13T02:30:08.747 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../86-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-13T02:30:08.747 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-13T02:30:08.769 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-simplejson. 2026-02-13T02:30:08.778 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../87-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-13T02:30:08.778 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-13T02:30:08.795 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package python3-webob. 2026-02-13T02:30:08.804 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../88-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-13T02:30:08.804 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-13T02:30:08.821 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-13T02:30:08.830 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../89-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-13T02:30:08.830 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-13T02:30:08.885 INFO:teuthology.orchestra.run.trial178.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-13T02:30:08.886 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-13T02:30:08.897 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package radosgw. 2026-02-13T02:30:08.906 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../90-radosgw_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:08.906 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking radosgw (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:08.979 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-13T02:30:09.064 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package rbd-fuse. 2026-02-13T02:30:09.073 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../91-rbd-fuse_20.3.0-5241-g8f8d3829-1jammy_amd64.deb ... 2026-02-13T02:30:09.074 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking rbd-fuse (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:09.101 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-13T02:30:09.102 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-13T02:30:09.166 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-13T02:30:09.167 INFO:teuthology.orchestra.run.trial121.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-13T02:30:09.182 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2026-02-13T02:30:09.239 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T02:30:09.281 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-13T02:30:09.353 INFO:teuthology.orchestra.run.trial178.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-13T02:30:09.354 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-ceph-common (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:09.443 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-13T02:30:09.526 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-13T02:30:09.914 INFO:teuthology.orchestra.run.trial121.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-13T02:30:09.925 INFO:teuthology.orchestra.run.trial121.stdout:Setting up cephadm (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:09.935 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T02:30:09.939 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-13T02:30:09.968 INFO:teuthology.orchestra.run.trial121.stdout:Adding system user cephadm....done 2026-02-13T02:30:09.975 INFO:teuthology.orchestra.run.trial121.stdout:usermod: no changes 2026-02-13T02:30:09.980 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-13T02:30:10.017 INFO:teuthology.orchestra.run.trial178.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-13T02:30:10.018 INFO:teuthology.orchestra.run.trial178.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-13T02:30:10.019 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-13T02:30:10.051 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-13T02:30:10.052 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-13T02:30:10.092 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-13T02:30:10.122 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-13T02:30:10.165 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T02:30:10.166 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-13T02:30:10.197 INFO:teuthology.orchestra.run.trial121.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-13T02:30:10.198 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-13T02:30:10.247 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-13T02:30:10.293 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-13T02:30:10.320 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-13T02:30:10.399 INFO:teuthology.orchestra.run.trial178.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-13T02:30:10.400 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-13T02:30:10.416 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-13T02:30:10.484 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-13T02:30:10.485 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-13T02:30:10.489 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-13T02:30:10.561 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-13T02:30:10.564 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-ceph-argparse (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:10.629 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-13T02:30:10.630 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-13T02:30:10.631 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2026-02-13T02:30:10.647 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-13T02:30:10.703 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-13T02:30:10.704 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-13T02:30:10.705 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-13T02:30:10.722 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-13T02:30:10.723 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-13T02:30:10.827 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-13T02:30:10.855 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-13T02:30:10.904 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libcephfs-proxy2 (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:10.905 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-13T02:30:10.926 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T02:30:10.927 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-13T02:30:10.984 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-13T02:30:11.011 INFO:teuthology.orchestra.run.trial178.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-13T02:30:11.012 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-13T02:30:11.072 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-13T02:30:11.144 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-13T02:30:11.145 INFO:teuthology.orchestra.run.trial178.stdout:Setting up librados2 (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:11.146 INFO:teuthology.orchestra.run.trial178.stdout:Setting up librgw2 (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:11.147 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libsqlite3-mod-ceph (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:11.148 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-13T02:30:11.315 INFO:teuthology.orchestra.run.trial121.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-13T02:30:11.316 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-13T02:30:11.408 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-13T02:30:11.530 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-13T02:30:11.611 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2026-02-13T02:30:11.687 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libcephfs2 (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:11.688 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libradosstriper1 (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:11.689 INFO:teuthology.orchestra.run.trial178.stdout:Setting up librbd1 (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:11.690 INFO:teuthology.orchestra.run.trial178.stdout:Setting up ceph-mgr-modules-core (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:11.691 INFO:teuthology.orchestra.run.trial178.stdout:Setting up ceph-fuse (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:11.708 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-13T02:30:11.763 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-13T02:30:11.763 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-13T02:30:11.782 INFO:teuthology.orchestra.run.trial121.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-13T02:30:11.783 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-ceph-common (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:11.872 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-13T02:30:12.155 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libcephfs-dev (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:12.156 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-rados (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:12.157 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libcephfs-daemon (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:12.158 INFO:teuthology.orchestra.run.trial178.stdout:Setting up cephfs-top (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:12.159 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-rbd (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:12.159 INFO:teuthology.orchestra.run.trial178.stdout:Setting up rbd-fuse (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:12.160 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-rgw (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:12.161 INFO:teuthology.orchestra.run.trial178.stdout:Setting up python3-cephfs (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:12.162 INFO:teuthology.orchestra.run.trial178.stdout:Setting up cephfs-shell (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:12.163 INFO:teuthology.orchestra.run.trial178.stdout:Setting up ceph-common (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:12.191 INFO:teuthology.orchestra.run.trial178.stdout:Adding group ceph....done 2026-02-13T02:30:12.227 INFO:teuthology.orchestra.run.trial178.stdout:Adding system user ceph....done 2026-02-13T02:30:12.237 INFO:teuthology.orchestra.run.trial178.stdout:Setting system user ceph properties....done 2026-02-13T02:30:12.243 INFO:teuthology.orchestra.run.trial178.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-13T02:30:12.329 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-13T02:30:12.362 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T02:30:12.367 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-13T02:30:12.442 INFO:teuthology.orchestra.run.trial121.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-13T02:30:12.443 INFO:teuthology.orchestra.run.trial121.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-13T02:30:12.444 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-13T02:30:12.517 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-13T02:30:12.590 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T02:30:12.591 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-13T02:30:12.601 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-13T02:30:12.668 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-13T02:30:12.729 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-13T02:30:12.808 INFO:teuthology.orchestra.run.trial121.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-13T02:30:12.809 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-13T02:30:12.893 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-13T02:30:12.894 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-13T02:30:12.970 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-13T02:30:12.987 INFO:teuthology.orchestra.run.trial178.stdout:Setting up cephfs-mirror (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:13.053 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-13T02:30:13.059 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /lib/systemd/system/cephfs-mirror.target. 2026-02-13T02:30:13.060 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /lib/systemd/system/cephfs-mirror.target. 2026-02-13T02:30:13.128 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-13T02:30:13.129 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-13T02:30:13.259 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-13T02:30:13.330 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T02:30:13.331 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-13T02:30:13.414 INFO:teuthology.orchestra.run.trial121.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-13T02:30:13.415 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-13T02:30:13.431 INFO:teuthology.orchestra.run.trial178.stdout:Setting up ceph-test (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:13.433 INFO:teuthology.orchestra.run.trial178.stdout:Setting up radosgw (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:13.547 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-13T02:30:13.548 INFO:teuthology.orchestra.run.trial121.stdout:Setting up librados2 (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:13.549 INFO:teuthology.orchestra.run.trial121.stdout:Setting up librgw2 (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:13.550 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libsqlite3-mod-ceph (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:13.551 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-13T02:30:13.683 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-13T02:30:13.684 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-13T02:30:14.055 INFO:teuthology.orchestra.run.trial178.stdout:Setting up ceph-base (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:14.069 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libcephfs2 (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:14.070 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libradosstriper1 (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:14.071 INFO:teuthology.orchestra.run.trial121.stdout:Setting up librbd1 (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:14.072 INFO:teuthology.orchestra.run.trial121.stdout:Setting up ceph-mgr-modules-core (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:14.072 INFO:teuthology.orchestra.run.trial121.stdout:Setting up ceph-fuse (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:14.147 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-13T02:30:14.147 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-13T02:30:14.184 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-13T02:30:14.552 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libcephfs-dev (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:14.552 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-rados (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:14.553 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libcephfs-daemon (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:14.554 INFO:teuthology.orchestra.run.trial121.stdout:Setting up cephfs-top (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:14.555 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-rbd (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:14.556 INFO:teuthology.orchestra.run.trial121.stdout:Setting up rbd-fuse (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:14.557 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-rgw (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:14.558 INFO:teuthology.orchestra.run.trial121.stdout:Setting up python3-cephfs (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:14.558 INFO:teuthology.orchestra.run.trial121.stdout:Setting up cephfs-shell (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:14.559 INFO:teuthology.orchestra.run.trial121.stdout:Setting up ceph-common (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:14.560 INFO:teuthology.orchestra.run.trial178.stdout:Setting up ceph-mds (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:14.587 INFO:teuthology.orchestra.run.trial121.stdout:Adding group ceph....done 2026-02-13T02:30:14.617 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-13T02:30:14.617 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-13T02:30:14.621 INFO:teuthology.orchestra.run.trial121.stdout:Adding system user ceph....done 2026-02-13T02:30:14.631 INFO:teuthology.orchestra.run.trial121.stdout:Setting system user ceph properties....done 2026-02-13T02:30:14.637 INFO:teuthology.orchestra.run.trial121.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-13T02:30:14.725 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-13T02:30:14.980 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-13T02:30:15.007 INFO:teuthology.orchestra.run.trial178.stdout:Setting up ceph-mgr (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:15.080 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-13T02:30:15.080 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-13T02:30:15.371 INFO:teuthology.orchestra.run.trial121.stdout:Setting up cephfs-mirror (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:15.446 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /lib/systemd/system/cephfs-mirror.target. 2026-02-13T02:30:15.446 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /lib/systemd/system/cephfs-mirror.target. 2026-02-13T02:30:15.460 INFO:teuthology.orchestra.run.trial178.stdout:Setting up ceph-mgr-k8sevents (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:15.461 INFO:teuthology.orchestra.run.trial178.stdout:Setting up ceph-osd-classic (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:15.478 INFO:teuthology.orchestra.run.trial178.stdout:update-alternatives: using /usr/bin/ceph-osd-classic to provide /usr/bin/ceph-osd (ceph-osd) in auto mode 2026-02-13T02:30:15.479 INFO:teuthology.orchestra.run.trial178.stdout:Setting up ceph-mgr-diskprediction-local (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:15.489 INFO:teuthology.orchestra.run.trial178.stdout:Setting up ceph-mon (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:15.542 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-13T02:30:15.542 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-13T02:30:15.832 INFO:teuthology.orchestra.run.trial121.stdout:Setting up ceph-test (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:15.833 INFO:teuthology.orchestra.run.trial121.stdout:Setting up radosgw (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:15.895 INFO:teuthology.orchestra.run.trial178.stdout:Setting up ceph-mgr-cephadm (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:15.906 INFO:teuthology.orchestra.run.trial178.stdout:Setting up ceph-mgr-dashboard (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:15.916 INFO:teuthology.orchestra.run.trial178.stdout:Setting up ceph-osd (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:16.003 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-13T02:30:16.003 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-13T02:30:16.101 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-13T02:30:16.101 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-13T02:30:16.398 INFO:teuthology.orchestra.run.trial178.stdout:Setting up ceph (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:16.399 INFO:teuthology.orchestra.run.trial178.stdout:Setting up ceph-volume (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:16.473 INFO:teuthology.orchestra.run.trial121.stdout:Setting up ceph-base (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:16.509 INFO:teuthology.orchestra.run.trial178.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-13T02:30:16.590 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-13T02:30:16.593 INFO:teuthology.orchestra.run.trial178.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.11) ... 2026-02-13T02:30:16.953 INFO:teuthology.orchestra.run.trial121.stdout:Setting up ceph-mds (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:17.012 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-13T02:30:17.013 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-13T02:30:17.052 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:17.052 INFO:teuthology.orchestra.run.trial178.stdout:Running kernel seems to be up-to-date. 2026-02-13T02:30:17.052 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:17.052 INFO:teuthology.orchestra.run.trial178.stdout:The processor microcode seems to be up-to-date. 2026-02-13T02:30:17.053 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:17.053 INFO:teuthology.orchestra.run.trial178.stdout:No services need to be restarted. 2026-02-13T02:30:17.053 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:17.053 INFO:teuthology.orchestra.run.trial178.stdout:No containers need to be restarted. 2026-02-13T02:30:17.053 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:17.053 INFO:teuthology.orchestra.run.trial178.stdout:No user sessions are running outdated binaries. 2026-02-13T02:30:17.053 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:17.053 INFO:teuthology.orchestra.run.trial178.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-13T02:30:17.397 INFO:teuthology.orchestra.run.trial121.stdout:Setting up ceph-mgr (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:17.477 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-13T02:30:17.477 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-13T02:30:17.689 INFO:teuthology.orchestra.run.trial178.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-13T02:30:17.692 DEBUG:teuthology.orchestra.run.trial178:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2026-02-13T02:30:17.766 INFO:teuthology.orchestra.run.trial178.stdout:Reading package lists... 2026-02-13T02:30:17.869 INFO:teuthology.orchestra.run.trial121.stdout:Setting up ceph-mgr-k8sevents (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:17.870 INFO:teuthology.orchestra.run.trial121.stdout:Setting up ceph-osd-classic (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:17.874 INFO:teuthology.orchestra.run.trial178.stdout:Building dependency tree... 2026-02-13T02:30:17.874 INFO:teuthology.orchestra.run.trial178.stdout:Reading state information... 2026-02-13T02:30:17.886 INFO:teuthology.orchestra.run.trial121.stdout:update-alternatives: using /usr/bin/ceph-osd-classic to provide /usr/bin/ceph-osd (ceph-osd) in auto mode 2026-02-13T02:30:17.888 INFO:teuthology.orchestra.run.trial121.stdout:Setting up ceph-mgr-diskprediction-local (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:17.898 INFO:teuthology.orchestra.run.trial121.stdout:Setting up ceph-mon (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:17.963 INFO:teuthology.orchestra.run.trial178.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2026-02-13T02:30:17.964 INFO:teuthology.orchestra.run.trial178.stdout:iproute2 set to manually installed. 2026-02-13T02:30:17.964 INFO:teuthology.orchestra.run.trial178.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2026-02-13T02:30:17.964 INFO:teuthology.orchestra.run.trial178.stdout:util-linux is already the newest version (2.37.2-4ubuntu3.4). 2026-02-13T02:30:17.964 INFO:teuthology.orchestra.run.trial178.stdout:util-linux set to manually installed. 2026-02-13T02:30:17.964 INFO:teuthology.orchestra.run.trial178.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3.4). 2026-02-13T02:30:17.964 INFO:teuthology.orchestra.run.trial178.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2.1). 2026-02-13T02:30:17.964 INFO:teuthology.orchestra.run.trial178.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T02:30:17.964 INFO:teuthology.orchestra.run.trial178.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T02:30:17.964 INFO:teuthology.orchestra.run.trial178.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T02:30:17.964 INFO:teuthology.orchestra.run.trial178.stdout: sg3-utils-udev 2026-02-13T02:30:17.965 INFO:teuthology.orchestra.run.trial178.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T02:30:17.965 INFO:teuthology.orchestra.run.trial178.stdout:The following additional packages will be installed: 2026-02-13T02:30:17.965 INFO:teuthology.orchestra.run.trial178.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 libndp0 libnm0 libpq5 2026-02-13T02:30:17.965 INFO:teuthology.orchestra.run.trial178.stdout: libssl3 libteamdctl0 modemmanager network-manager-pptp postgresql-14 2026-02-13T02:30:17.965 INFO:teuthology.orchestra.run.trial178.stdout: postgresql-client-14 postgresql-client-common ppp pptp-linux wpasupplicant 2026-02-13T02:30:17.965 INFO:teuthology.orchestra.run.trial178.stdout:Suggested packages: 2026-02-13T02:30:17.965 INFO:teuthology.orchestra.run.trial178.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2026-02-13T02:30:17.965 INFO:teuthology.orchestra.run.trial178.stdout: postgresql-doc postgresql-doc-14 wpagui libengine-pkcs11-openssl 2026-02-13T02:30:17.970 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-13T02:30:17.970 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-13T02:30:17.979 INFO:teuthology.orchestra.run.trial178.stdout:The following NEW packages will be installed: 2026-02-13T02:30:17.980 INFO:teuthology.orchestra.run.trial178.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2026-02-13T02:30:17.980 INFO:teuthology.orchestra.run.trial178.stdout: libjson-perl libllvm14 libndp0 libnm0 libpq5 libssl-dev libteamdctl0 2026-02-13T02:30:17.980 INFO:teuthology.orchestra.run.trial178.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2026-02-13T02:30:17.980 INFO:teuthology.orchestra.run.trial178.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2026-02-13T02:30:17.980 INFO:teuthology.orchestra.run.trial178.stdout: postgresql-common postgresql-contrib ppp pptp-linux wpasupplicant 2026-02-13T02:30:17.981 INFO:teuthology.orchestra.run.trial178.stdout:The following packages will be upgraded: 2026-02-13T02:30:17.981 INFO:teuthology.orchestra.run.trial178.stdout: libssl3 2026-02-13T02:30:18.335 INFO:teuthology.orchestra.run.trial178.stdout:1 upgraded, 29 newly installed, 0 to remove and 37 not upgraded. 2026-02-13T02:30:18.336 INFO:teuthology.orchestra.run.trial178.stdout:Need to get 53.3 MB of archives. 2026-02-13T02:30:18.336 INFO:teuthology.orchestra.run.trial178.stdout:After this operation, 196 MB of additional disk space will be used. 2026-02-13T02:30:18.336 INFO:teuthology.orchestra.run.trial178.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2026-02-13T02:30:18.364 INFO:teuthology.orchestra.run.trial121.stdout:Setting up ceph-mgr-cephadm (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:18.375 INFO:teuthology.orchestra.run.trial121.stdout:Setting up ceph-mgr-dashboard (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:18.386 INFO:teuthology.orchestra.run.trial121.stdout:Setting up ceph-osd (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:18.472 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-13T02:30:18.472 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-13T02:30:18.723 INFO:teuthology.orchestra.run.trial178.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.21 [1905 kB] 2026-02-13T02:30:18.875 INFO:teuthology.orchestra.run.trial121.stdout:Setting up ceph (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:18.876 INFO:teuthology.orchestra.run.trial121.stdout:Setting up ceph-volume (20.3.0-5241-g8f8d3829-1jammy) ... 2026-02-13T02:30:18.947 INFO:teuthology.orchestra.run.trial178.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2026-02-13T02:30:18.978 INFO:teuthology.orchestra.run.trial178.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2026-02-13T02:30:18.982 INFO:teuthology.orchestra.run.trial121.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-13T02:30:18.983 INFO:teuthology.orchestra.run.trial178.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2026-02-13T02:30:18.985 INFO:teuthology.orchestra.run.trial178.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2026-02-13T02:30:18.986 INFO:teuthology.orchestra.run.trial178.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.4 [86.7 kB] 2026-02-13T02:30:18.989 INFO:teuthology.orchestra.run.trial178.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libelf-dev amd64 0.186-1ubuntu0.1 [64.4 kB] 2026-02-13T02:30:18.991 INFO:teuthology.orchestra.run.trial178.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2026-02-13T02:30:18.991 INFO:teuthology.orchestra.run.trial178.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6236 B] 2026-02-13T02:30:18.991 INFO:teuthology.orchestra.run.trial178.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2026-02-13T02:30:19.019 INFO:teuthology.orchestra.run.trial178.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2026-02-13T02:30:19.064 INFO:teuthology.orchestra.run.trial121.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.11) ... 2026-02-13T02:30:19.473 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:19.474 INFO:teuthology.orchestra.run.trial121.stdout:Running kernel seems to be up-to-date. 2026-02-13T02:30:19.474 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:19.474 INFO:teuthology.orchestra.run.trial121.stdout:The processor microcode seems to be up-to-date. 2026-02-13T02:30:19.474 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:19.474 INFO:teuthology.orchestra.run.trial121.stdout:No services need to be restarted. 2026-02-13T02:30:19.474 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:19.474 INFO:teuthology.orchestra.run.trial121.stdout:No containers need to be restarted. 2026-02-13T02:30:19.474 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:19.474 INFO:teuthology.orchestra.run.trial121.stdout:No user sessions are running outdated binaries. 2026-02-13T02:30:19.475 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:19.475 INFO:teuthology.orchestra.run.trial121.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-13T02:30:19.577 INFO:teuthology.orchestra.run.trial178.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2026-02-13T02:30:19.577 INFO:teuthology.orchestra.run.trial178.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2.2 [457 kB] 2026-02-13T02:30:19.581 INFO:teuthology.orchestra.run.trial178.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.20-0ubuntu0.22.04.1 [153 kB] 2026-02-13T02:30:19.584 INFO:teuthology.orchestra.run.trial178.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.21 [2375 kB] 2026-02-13T02:30:19.643 INFO:teuthology.orchestra.run.trial178.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2026-02-13T02:30:19.643 INFO:teuthology.orchestra.run.trial178.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.4 [1094 kB] 2026-02-13T02:30:19.671 INFO:teuthology.orchestra.run.trial178.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2.2 [2202 kB] 2026-02-13T02:30:19.721 INFO:teuthology.orchestra.run.trial178.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2026-02-13T02:30:19.728 INFO:teuthology.orchestra.run.trial178.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2026-02-13T02:30:19.729 INFO:teuthology.orchestra.run.trial178.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2026-02-13T02:30:19.729 INFO:teuthology.orchestra.run.trial178.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2026-02-13T02:30:19.730 INFO:teuthology.orchestra.run.trial178.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.20-0ubuntu0.22.04.1 [1250 kB] 2026-02-13T02:30:19.765 INFO:teuthology.orchestra.run.trial178.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2026-02-13T02:30:19.767 INFO:teuthology.orchestra.run.trial178.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.20-0ubuntu0.22.04.1 [16.2 MB] 2026-02-13T02:30:20.113 INFO:teuthology.orchestra.run.trial121.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-13T02:30:20.117 DEBUG:teuthology.orchestra.run.trial121:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2026-02-13T02:30:20.144 INFO:teuthology.orchestra.run.trial178.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3288 B] 2026-02-13T02:30:20.144 INFO:teuthology.orchestra.run.trial178.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3292 B] 2026-02-13T02:30:20.144 INFO:teuthology.orchestra.run.trial178.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3292 B] 2026-02-13T02:30:20.144 INFO:teuthology.orchestra.run.trial178.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.3 [1482 kB] 2026-02-13T02:30:20.190 INFO:teuthology.orchestra.run.trial121.stdout:Reading package lists... 2026-02-13T02:30:20.296 INFO:teuthology.orchestra.run.trial121.stdout:Building dependency tree... 2026-02-13T02:30:20.297 INFO:teuthology.orchestra.run.trial121.stdout:Reading state information... 2026-02-13T02:30:20.345 INFO:teuthology.orchestra.run.trial178.stdout:Preconfiguring packages ... 2026-02-13T02:30:20.385 INFO:teuthology.orchestra.run.trial121.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2026-02-13T02:30:20.385 INFO:teuthology.orchestra.run.trial121.stdout:iproute2 set to manually installed. 2026-02-13T02:30:20.386 INFO:teuthology.orchestra.run.trial121.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2026-02-13T02:30:20.386 INFO:teuthology.orchestra.run.trial121.stdout:util-linux is already the newest version (2.37.2-4ubuntu3.4). 2026-02-13T02:30:20.386 INFO:teuthology.orchestra.run.trial121.stdout:util-linux set to manually installed. 2026-02-13T02:30:20.386 INFO:teuthology.orchestra.run.trial121.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3.4). 2026-02-13T02:30:20.386 INFO:teuthology.orchestra.run.trial121.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2.1). 2026-02-13T02:30:20.386 INFO:teuthology.orchestra.run.trial121.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T02:30:20.386 INFO:teuthology.orchestra.run.trial121.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T02:30:20.386 INFO:teuthology.orchestra.run.trial121.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T02:30:20.386 INFO:teuthology.orchestra.run.trial121.stdout: sg3-utils-udev 2026-02-13T02:30:20.386 INFO:teuthology.orchestra.run.trial121.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T02:30:20.386 INFO:teuthology.orchestra.run.trial121.stdout:The following additional packages will be installed: 2026-02-13T02:30:20.387 INFO:teuthology.orchestra.run.trial121.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 libndp0 libnm0 libpq5 2026-02-13T02:30:20.387 INFO:teuthology.orchestra.run.trial121.stdout: libssl3 libteamdctl0 modemmanager network-manager-pptp postgresql-14 2026-02-13T02:30:20.387 INFO:teuthology.orchestra.run.trial121.stdout: postgresql-client-14 postgresql-client-common ppp pptp-linux wpasupplicant 2026-02-13T02:30:20.387 INFO:teuthology.orchestra.run.trial121.stdout:Suggested packages: 2026-02-13T02:30:20.387 INFO:teuthology.orchestra.run.trial121.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2026-02-13T02:30:20.387 INFO:teuthology.orchestra.run.trial121.stdout: postgresql-doc postgresql-doc-14 wpagui libengine-pkcs11-openssl 2026-02-13T02:30:20.396 INFO:teuthology.orchestra.run.trial178.stdout:Fetched 53.3 MB in 2s (24.3 MB/s) 2026-02-13T02:30:20.401 INFO:teuthology.orchestra.run.trial121.stdout:The following NEW packages will be installed: 2026-02-13T02:30:20.401 INFO:teuthology.orchestra.run.trial121.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2026-02-13T02:30:20.402 INFO:teuthology.orchestra.run.trial121.stdout: libjson-perl libllvm14 libndp0 libnm0 libpq5 libssl-dev libteamdctl0 2026-02-13T02:30:20.402 INFO:teuthology.orchestra.run.trial121.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2026-02-13T02:30:20.402 INFO:teuthology.orchestra.run.trial121.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2026-02-13T02:30:20.402 INFO:teuthology.orchestra.run.trial121.stdout: postgresql-common postgresql-contrib ppp pptp-linux wpasupplicant 2026-02-13T02:30:20.403 INFO:teuthology.orchestra.run.trial121.stdout:The following packages will be upgraded: 2026-02-13T02:30:20.403 INFO:teuthology.orchestra.run.trial121.stdout: libssl3 2026-02-13T02:30:20.413 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package flex. 2026-02-13T02:30:20.452 INFO:teuthology.orchestra.run.trial178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 175412 files and directories currently installed.) 2026-02-13T02:30:20.454 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2026-02-13T02:30:20.455 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking flex (2.6.4-8build2) ... 2026-02-13T02:30:20.488 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.21_amd64.deb ... 2026-02-13T02:30:20.489 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.21) over (3.0.2-0ubuntu1.20) ... 2026-02-13T02:30:20.531 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.21) ... 2026-02-13T02:30:20.602 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package bison. 2026-02-13T02:30:20.640 INFO:teuthology.orchestra.run.trial178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 175485 files and directories currently installed.) 2026-02-13T02:30:20.642 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2026-02-13T02:30:20.645 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2026-02-13T02:30:20.674 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package dump. 2026-02-13T02:30:20.683 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../01-dump_0.4b47-3_amd64.deb ... 2026-02-13T02:30:20.683 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking dump (0.4b47-3) ... 2026-02-13T02:30:20.703 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package indent. 2026-02-13T02:30:20.711 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../02-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2026-02-13T02:30:20.711 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2026-02-13T02:30:20.726 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libaio-dev:amd64. 2026-02-13T02:30:20.735 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../03-libaio-dev_0.3.112-13build1_amd64.deb ... 2026-02-13T02:30:20.736 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2026-02-13T02:30:20.748 INFO:teuthology.orchestra.run.trial121.stdout:1 upgraded, 29 newly installed, 0 to remove and 37 not upgraded. 2026-02-13T02:30:20.748 INFO:teuthology.orchestra.run.trial121.stdout:Need to get 53.3 MB of archives. 2026-02-13T02:30:20.749 INFO:teuthology.orchestra.run.trial121.stdout:After this operation, 196 MB of additional disk space will be used. 2026-02-13T02:30:20.749 INFO:teuthology.orchestra.run.trial121.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2026-02-13T02:30:20.754 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libbluetooth3:amd64. 2026-02-13T02:30:20.762 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../04-libbluetooth3_5.64-0ubuntu1.4_amd64.deb ... 2026-02-13T02:30:20.762 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.4) ... 2026-02-13T02:30:20.778 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libelf-dev:amd64. 2026-02-13T02:30:20.787 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../05-libelf-dev_0.186-1ubuntu0.1_amd64.deb ... 2026-02-13T02:30:20.787 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libelf-dev:amd64 (0.186-1ubuntu0.1) ... 2026-02-13T02:30:20.804 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libfl2:amd64. 2026-02-13T02:30:20.812 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../06-libfl2_2.6.4-8build2_amd64.deb ... 2026-02-13T02:30:20.812 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2026-02-13T02:30:20.826 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libfl-dev:amd64. 2026-02-13T02:30:20.835 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../07-libfl-dev_2.6.4-8build2_amd64.deb ... 2026-02-13T02:30:20.836 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2026-02-13T02:30:20.851 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libjson-perl. 2026-02-13T02:30:20.859 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../08-libjson-perl_4.04000-1_all.deb ... 2026-02-13T02:30:20.859 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libjson-perl (4.04000-1) ... 2026-02-13T02:30:20.875 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libllvm14:amd64. 2026-02-13T02:30:20.884 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../09-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2026-02-13T02:30:20.885 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2026-02-13T02:30:21.136 INFO:teuthology.orchestra.run.trial121.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.21 [1905 kB] 2026-02-13T02:30:21.166 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libndp0:amd64. 2026-02-13T02:30:21.177 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../10-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2026-02-13T02:30:21.177 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2026-02-13T02:30:21.194 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libnm0:amd64. 2026-02-13T02:30:21.207 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../11-libnm0_1.36.6-0ubuntu2.2_amd64.deb ... 2026-02-13T02:30:21.207 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2.2) ... 2026-02-13T02:30:21.227 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libpq5:amd64. 2026-02-13T02:30:21.238 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../12-libpq5_14.20-0ubuntu0.22.04.1_amd64.deb ... 2026-02-13T02:30:21.238 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libpq5:amd64 (14.20-0ubuntu0.22.04.1) ... 2026-02-13T02:30:21.254 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libssl-dev:amd64. 2026-02-13T02:30:21.262 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../13-libssl-dev_3.0.2-0ubuntu1.21_amd64.deb ... 2026-02-13T02:30:21.263 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.21) ... 2026-02-13T02:30:21.313 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package libteamdctl0:amd64. 2026-02-13T02:30:21.322 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../14-libteamdctl0_1.31-1build2_amd64.deb ... 2026-02-13T02:30:21.323 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2026-02-13T02:30:21.338 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package modemmanager. 2026-02-13T02:30:21.346 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../15-modemmanager_1.20.0-1~ubuntu22.04.4_amd64.deb ... 2026-02-13T02:30:21.347 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.4) ... 2026-02-13T02:30:21.360 INFO:teuthology.orchestra.run.trial121.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2026-02-13T02:30:21.382 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package network-manager. 2026-02-13T02:30:21.390 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../16-network-manager_1.36.6-0ubuntu2.2_amd64.deb ... 2026-02-13T02:30:21.391 INFO:teuthology.orchestra.run.trial121.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2026-02-13T02:30:21.395 INFO:teuthology.orchestra.run.trial121.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2026-02-13T02:30:21.396 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking network-manager (1.36.6-0ubuntu2.2) ... 2026-02-13T02:30:21.398 INFO:teuthology.orchestra.run.trial121.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2026-02-13T02:30:21.399 INFO:teuthology.orchestra.run.trial121.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.4 [86.7 kB] 2026-02-13T02:30:21.402 INFO:teuthology.orchestra.run.trial121.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libelf-dev amd64 0.186-1ubuntu0.1 [64.4 kB] 2026-02-13T02:30:21.404 INFO:teuthology.orchestra.run.trial121.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2026-02-13T02:30:21.405 INFO:teuthology.orchestra.run.trial121.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6236 B] 2026-02-13T02:30:21.405 INFO:teuthology.orchestra.run.trial121.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2026-02-13T02:30:21.432 INFO:teuthology.orchestra.run.trial121.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2026-02-13T02:30:21.436 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package ppp. 2026-02-13T02:30:21.445 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../17-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2026-02-13T02:30:21.681 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2026-02-13T02:30:21.709 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package pptp-linux. 2026-02-13T02:30:21.722 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../18-pptp-linux_1.10.0-1build3_amd64.deb ... 2026-02-13T02:30:21.723 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2026-02-13T02:30:21.739 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package network-manager-pptp. 2026-02-13T02:30:21.752 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../19-network-manager-pptp_1.2.10-1_amd64.deb ... 2026-02-13T02:30:21.753 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2026-02-13T02:30:21.771 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package postgresql-client-common. 2026-02-13T02:30:21.784 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../20-postgresql-client-common_238_all.deb ... 2026-02-13T02:30:21.785 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking postgresql-client-common (238) ... 2026-02-13T02:30:21.804 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package postgresql-client-14. 2026-02-13T02:30:21.817 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../21-postgresql-client-14_14.20-0ubuntu0.22.04.1_amd64.deb ... 2026-02-13T02:30:21.817 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking postgresql-client-14 (14.20-0ubuntu0.22.04.1) ... 2026-02-13T02:30:21.858 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package postgresql-common. 2026-02-13T02:30:21.867 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../22-postgresql-common_238_all.deb ... 2026-02-13T02:30:21.876 INFO:teuthology.orchestra.run.trial178.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2026-02-13T02:30:21.881 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking postgresql-common (238) ... 2026-02-13T02:30:21.907 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package postgresql-14. 2026-02-13T02:30:21.915 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../23-postgresql-14_14.20-0ubuntu0.22.04.1_amd64.deb ... 2026-02-13T02:30:21.918 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking postgresql-14 (14.20-0ubuntu0.22.04.1) ... 2026-02-13T02:30:21.995 INFO:teuthology.orchestra.run.trial121.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2026-02-13T02:30:21.996 INFO:teuthology.orchestra.run.trial121.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2.2 [457 kB] 2026-02-13T02:30:22.002 INFO:teuthology.orchestra.run.trial121.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.20-0ubuntu0.22.04.1 [153 kB] 2026-02-13T02:30:22.006 INFO:teuthology.orchestra.run.trial121.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.21 [2375 kB] 2026-02-13T02:30:22.061 INFO:teuthology.orchestra.run.trial121.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2026-02-13T02:30:22.062 INFO:teuthology.orchestra.run.trial121.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.4 [1094 kB] 2026-02-13T02:30:22.088 INFO:teuthology.orchestra.run.trial121.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2.2 [2202 kB] 2026-02-13T02:30:22.112 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package postgresql. 2026-02-13T02:30:22.122 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../24-postgresql_14+238_all.deb ... 2026-02-13T02:30:22.123 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking postgresql (14+238) ... 2026-02-13T02:30:22.136 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package postgresql-client. 2026-02-13T02:30:22.140 INFO:teuthology.orchestra.run.trial121.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2026-02-13T02:30:22.144 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../25-postgresql-client_14+238_all.deb ... 2026-02-13T02:30:22.145 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking postgresql-client (14+238) ... 2026-02-13T02:30:22.148 INFO:teuthology.orchestra.run.trial121.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2026-02-13T02:30:22.149 INFO:teuthology.orchestra.run.trial121.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2026-02-13T02:30:22.150 INFO:teuthology.orchestra.run.trial121.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2026-02-13T02:30:22.150 INFO:teuthology.orchestra.run.trial121.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.20-0ubuntu0.22.04.1 [1250 kB] 2026-02-13T02:30:22.160 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package postgresql-contrib. 2026-02-13T02:30:22.169 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../26-postgresql-contrib_14+238_all.deb ... 2026-02-13T02:30:22.169 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking postgresql-contrib (14+238) ... 2026-02-13T02:30:22.179 INFO:teuthology.orchestra.run.trial121.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2026-02-13T02:30:22.183 INFO:teuthology.orchestra.run.trial121.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.20-0ubuntu0.22.04.1 [16.2 MB] 2026-02-13T02:30:22.184 INFO:teuthology.orchestra.run.trial178.stdout:Selecting previously unselected package wpasupplicant. 2026-02-13T02:30:22.193 INFO:teuthology.orchestra.run.trial178.stdout:Preparing to unpack .../27-wpasupplicant_2%3a2.10-6ubuntu2.3_amd64.deb ... 2026-02-13T02:30:22.193 INFO:teuthology.orchestra.run.trial178.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.3) ... 2026-02-13T02:30:22.235 INFO:teuthology.orchestra.run.trial178.stdout:Setting up postgresql-client-common (238) ... 2026-02-13T02:30:22.236 INFO:teuthology.orchestra.run.trial178.stdout:Setting up flex (2.6.4-8build2) ... 2026-02-13T02:30:22.238 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libpq5:amd64 (14.20-0ubuntu0.22.04.1) ... 2026-02-13T02:30:22.239 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2026-02-13T02:30:22.240 INFO:teuthology.orchestra.run.trial178.stdout:Setting up postgresql-client-14 (14.20-0ubuntu0.22.04.1) ... 2026-02-13T02:30:22.562 INFO:teuthology.orchestra.run.trial121.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3288 B] 2026-02-13T02:30:22.562 INFO:teuthology.orchestra.run.trial121.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3292 B] 2026-02-13T02:30:22.562 INFO:teuthology.orchestra.run.trial121.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3292 B] 2026-02-13T02:30:22.563 INFO:teuthology.orchestra.run.trial121.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.3 [1482 kB] 2026-02-13T02:30:22.671 INFO:teuthology.orchestra.run.trial178.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2026-02-13T02:30:22.692 INFO:teuthology.orchestra.run.trial178.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.3) ... 2026-02-13T02:30:22.762 INFO:teuthology.orchestra.run.trial121.stdout:Preconfiguring packages ... 2026-02-13T02:30:22.769 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service → /lib/systemd/system/wpa_supplicant.service. 2026-02-13T02:30:22.770 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service → /lib/systemd/system/wpa_supplicant.service. 2026-02-13T02:30:22.813 INFO:teuthology.orchestra.run.trial121.stdout:Fetched 53.3 MB in 2s (24.4 MB/s) 2026-02-13T02:30:22.829 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package flex. 2026-02-13T02:30:22.865 INFO:teuthology.orchestra.run.trial121.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 175412 files and directories currently installed.) 2026-02-13T02:30:22.867 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2026-02-13T02:30:22.868 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking flex (2.6.4-8build2) ... 2026-02-13T02:30:22.899 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.21_amd64.deb ... 2026-02-13T02:30:22.900 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.21) over (3.0.2-0ubuntu1.20) ... 2026-02-13T02:30:22.940 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.21) ... 2026-02-13T02:30:23.008 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package bison. 2026-02-13T02:30:23.043 INFO:teuthology.orchestra.run.trial121.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 175485 files and directories currently installed.) 2026-02-13T02:30:23.045 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2026-02-13T02:30:23.048 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2026-02-13T02:30:23.075 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package dump. 2026-02-13T02:30:23.083 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../01-dump_0.4b47-3_amd64.deb ... 2026-02-13T02:30:23.083 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking dump (0.4b47-3) ... 2026-02-13T02:30:23.103 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package indent. 2026-02-13T02:30:23.112 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../02-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2026-02-13T02:30:23.112 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2026-02-13T02:30:23.128 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libaio-dev:amd64. 2026-02-13T02:30:23.137 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../03-libaio-dev_0.3.112-13build1_amd64.deb ... 2026-02-13T02:30:23.137 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2026-02-13T02:30:23.155 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libbluetooth3:amd64. 2026-02-13T02:30:23.164 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../04-libbluetooth3_5.64-0ubuntu1.4_amd64.deb ... 2026-02-13T02:30:23.164 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.4) ... 2026-02-13T02:30:23.167 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2026-02-13T02:30:23.168 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.21) ... 2026-02-13T02:30:23.169 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libelf-dev:amd64 (0.186-1ubuntu0.1) ... 2026-02-13T02:30:23.170 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2026-02-13T02:30:23.171 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2.2) ... 2026-02-13T02:30:23.172 INFO:teuthology.orchestra.run.trial178.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2026-02-13T02:30:23.179 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libelf-dev:amd64. 2026-02-13T02:30:23.188 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../05-libelf-dev_0.186-1ubuntu0.1_amd64.deb ... 2026-02-13T02:30:23.188 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libelf-dev:amd64 (0.186-1ubuntu0.1) ... 2026-02-13T02:30:23.189 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2026-02-13T02:30:23.190 INFO:teuthology.orchestra.run.trial178.stdout:Setting up dump (0.4b47-3) ... 2026-02-13T02:30:23.196 INFO:teuthology.orchestra.run.trial178.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2026-02-13T02:30:23.198 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.4) ... 2026-02-13T02:30:23.199 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libjson-perl (4.04000-1) ... 2026-02-13T02:30:23.200 INFO:teuthology.orchestra.run.trial178.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2026-02-13T02:30:23.203 INFO:teuthology.orchestra.run.trial178.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2026-02-13T02:30:23.204 INFO:teuthology.orchestra.run.trial178.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2026-02-13T02:30:23.205 INFO:teuthology.orchestra.run.trial178.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.4) ... 2026-02-13T02:30:23.205 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libfl2:amd64. 2026-02-13T02:30:23.214 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../06-libfl2_2.6.4-8build2_amd64.deb ... 2026-02-13T02:30:23.214 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2026-02-13T02:30:23.229 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libfl-dev:amd64. 2026-02-13T02:30:23.237 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../07-libfl-dev_2.6.4-8build2_amd64.deb ... 2026-02-13T02:30:23.238 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2026-02-13T02:30:23.253 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libjson-perl. 2026-02-13T02:30:23.261 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../08-libjson-perl_4.04000-1_all.deb ... 2026-02-13T02:30:23.262 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libjson-perl (4.04000-1) ... 2026-02-13T02:30:23.274 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service → /lib/systemd/system/ModemManager.service. 2026-02-13T02:30:23.275 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service → /lib/systemd/system/ModemManager.service. 2026-02-13T02:30:23.279 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libllvm14:amd64. 2026-02-13T02:30:23.287 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../09-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2026-02-13T02:30:23.288 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2026-02-13T02:30:23.565 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libndp0:amd64. 2026-02-13T02:30:23.579 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../10-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2026-02-13T02:30:23.579 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2026-02-13T02:30:23.596 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libnm0:amd64. 2026-02-13T02:30:23.609 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../11-libnm0_1.36.6-0ubuntu2.2_amd64.deb ... 2026-02-13T02:30:23.609 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2.2) ... 2026-02-13T02:30:23.631 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libpq5:amd64. 2026-02-13T02:30:23.645 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../12-libpq5_14.20-0ubuntu0.22.04.1_amd64.deb ... 2026-02-13T02:30:23.645 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libpq5:amd64 (14.20-0ubuntu0.22.04.1) ... 2026-02-13T02:30:23.662 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libssl-dev:amd64. 2026-02-13T02:30:23.671 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../13-libssl-dev_3.0.2-0ubuntu1.21_amd64.deb ... 2026-02-13T02:30:23.672 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.21) ... 2026-02-13T02:30:23.675 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2026-02-13T02:30:23.676 INFO:teuthology.orchestra.run.trial178.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2026-02-13T02:30:23.677 INFO:teuthology.orchestra.run.trial178.stdout:Setting up postgresql-client (14+238) ... 2026-02-13T02:30:23.678 INFO:teuthology.orchestra.run.trial178.stdout:Setting up network-manager (1.36.6-0ubuntu2.2) ... 2026-02-13T02:30:23.722 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package libteamdctl0:amd64. 2026-02-13T02:30:23.731 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../14-libteamdctl0_1.31-1build2_amd64.deb ... 2026-02-13T02:30:23.732 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2026-02-13T02:30:23.746 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package modemmanager. 2026-02-13T02:30:23.755 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../15-modemmanager_1.20.0-1~ubuntu22.04.4_amd64.deb ... 2026-02-13T02:30:23.755 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.4) ... 2026-02-13T02:30:23.790 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package network-manager. 2026-02-13T02:30:23.799 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../16-network-manager_1.36.6-0ubuntu2.2_amd64.deb ... 2026-02-13T02:30:23.803 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking network-manager (1.36.6-0ubuntu2.2) ... 2026-02-13T02:30:23.842 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package ppp. 2026-02-13T02:30:23.851 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../17-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2026-02-13T02:30:23.972 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service → /lib/systemd/system/NetworkManager-dispatcher.service. 2026-02-13T02:30:24.076 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2026-02-13T02:30:24.107 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package pptp-linux. 2026-02-13T02:30:24.120 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../18-pptp-linux_1.10.0-1build3_amd64.deb ... 2026-02-13T02:30:24.121 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2026-02-13T02:30:24.139 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package network-manager-pptp. 2026-02-13T02:30:24.152 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../19-network-manager-pptp_1.2.10-1_amd64.deb ... 2026-02-13T02:30:24.152 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2026-02-13T02:30:24.171 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package postgresql-client-common. 2026-02-13T02:30:24.184 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../20-postgresql-client-common_238_all.deb ... 2026-02-13T02:30:24.185 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking postgresql-client-common (238) ... 2026-02-13T02:30:24.206 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package postgresql-client-14. 2026-02-13T02:30:24.216 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../21-postgresql-client-14_14.20-0ubuntu0.22.04.1_amd64.deb ... 2026-02-13T02:30:24.217 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking postgresql-client-14 (14.20-0ubuntu0.22.04.1) ... 2026-02-13T02:30:24.235 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service → /lib/systemd/system/NetworkManager-wait-online.service. 2026-02-13T02:30:24.256 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package postgresql-common. 2026-02-13T02:30:24.265 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../22-postgresql-common_238_all.deb ... 2026-02-13T02:30:24.273 INFO:teuthology.orchestra.run.trial121.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2026-02-13T02:30:24.277 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking postgresql-common (238) ... 2026-02-13T02:30:24.302 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package postgresql-14. 2026-02-13T02:30:24.311 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../23-postgresql-14_14.20-0ubuntu0.22.04.1_amd64.deb ... 2026-02-13T02:30:24.313 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking postgresql-14 (14.20-0ubuntu0.22.04.1) ... 2026-02-13T02:30:24.462 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service → /lib/systemd/system/NetworkManager.service. 2026-02-13T02:30:24.503 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package postgresql. 2026-02-13T02:30:24.512 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../24-postgresql_14+238_all.deb ... 2026-02-13T02:30:24.513 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking postgresql (14+238) ... 2026-02-13T02:30:24.527 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package postgresql-client. 2026-02-13T02:30:24.536 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../25-postgresql-client_14+238_all.deb ... 2026-02-13T02:30:24.536 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking postgresql-client (14+238) ... 2026-02-13T02:30:24.550 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package postgresql-contrib. 2026-02-13T02:30:24.559 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../26-postgresql-contrib_14+238_all.deb ... 2026-02-13T02:30:24.560 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking postgresql-contrib (14+238) ... 2026-02-13T02:30:24.574 INFO:teuthology.orchestra.run.trial121.stdout:Selecting previously unselected package wpasupplicant. 2026-02-13T02:30:24.583 INFO:teuthology.orchestra.run.trial121.stdout:Preparing to unpack .../27-wpasupplicant_2%3a2.10-6ubuntu2.3_amd64.deb ... 2026-02-13T02:30:24.583 INFO:teuthology.orchestra.run.trial121.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.3) ... 2026-02-13T02:30:24.623 INFO:teuthology.orchestra.run.trial121.stdout:Setting up postgresql-client-common (238) ... 2026-02-13T02:30:24.625 INFO:teuthology.orchestra.run.trial121.stdout:Setting up flex (2.6.4-8build2) ... 2026-02-13T02:30:24.626 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libpq5:amd64 (14.20-0ubuntu0.22.04.1) ... 2026-02-13T02:30:24.627 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2026-02-13T02:30:24.628 INFO:teuthology.orchestra.run.trial121.stdout:Setting up postgresql-client-14 (14.20-0ubuntu0.22.04.1) ... 2026-02-13T02:30:24.857 INFO:teuthology.orchestra.run.trial178.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2026-02-13T02:30:24.858 INFO:teuthology.orchestra.run.trial178.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2026-02-13T02:30:24.859 INFO:teuthology.orchestra.run.trial178.stdout:Setting up postgresql-common (238) ... 2026-02-13T02:30:25.001 INFO:teuthology.orchestra.run.trial178.stdout:Adding user postgres to group ssl-cert 2026-02-13T02:30:25.059 INFO:teuthology.orchestra.run.trial121.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2026-02-13T02:30:25.067 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:25.068 INFO:teuthology.orchestra.run.trial178.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2026-02-13T02:30:25.079 INFO:teuthology.orchestra.run.trial121.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.3) ... 2026-02-13T02:30:25.157 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service → /lib/systemd/system/wpa_supplicant.service. 2026-02-13T02:30:25.157 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service → /lib/systemd/system/wpa_supplicant.service. 2026-02-13T02:30:25.176 INFO:teuthology.orchestra.run.trial178.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2026-02-13T02:30:25.176 INFO:teuthology.orchestra.run.trial178.stdout:Removing obsolete dictionary files: 2026-02-13T02:30:25.565 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2026-02-13T02:30:25.566 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.21) ... 2026-02-13T02:30:25.566 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libelf-dev:amd64 (0.186-1ubuntu0.1) ... 2026-02-13T02:30:25.567 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2026-02-13T02:30:25.568 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2.2) ... 2026-02-13T02:30:25.569 INFO:teuthology.orchestra.run.trial121.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2026-02-13T02:30:25.584 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2026-02-13T02:30:25.585 INFO:teuthology.orchestra.run.trial121.stdout:Setting up dump (0.4b47-3) ... 2026-02-13T02:30:25.590 INFO:teuthology.orchestra.run.trial121.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2026-02-13T02:30:25.591 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.4) ... 2026-02-13T02:30:25.592 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libjson-perl (4.04000-1) ... 2026-02-13T02:30:25.593 INFO:teuthology.orchestra.run.trial121.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2026-02-13T02:30:25.596 INFO:teuthology.orchestra.run.trial121.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2026-02-13T02:30:25.597 INFO:teuthology.orchestra.run.trial121.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2026-02-13T02:30:25.598 INFO:teuthology.orchestra.run.trial121.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.4) ... 2026-02-13T02:30:25.656 INFO:teuthology.orchestra.run.trial178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service → /lib/systemd/system/postgresql.service. 2026-02-13T02:30:25.660 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service → /lib/systemd/system/ModemManager.service. 2026-02-13T02:30:25.660 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service → /lib/systemd/system/ModemManager.service. 2026-02-13T02:30:25.884 INFO:teuthology.orchestra.run.trial178.stdout:Setting up postgresql-14 (14.20-0ubuntu0.22.04.1) ... 2026-02-13T02:30:26.019 INFO:teuthology.orchestra.run.trial178.stdout:Creating new PostgreSQL cluster 14/main ... 2026-02-13T02:30:26.025 INFO:teuthology.orchestra.run.trial178.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2026-02-13T02:30:26.038 INFO:teuthology.orchestra.run.trial178.stdout:The files belonging to this database system will be owned by user "postgres". 2026-02-13T02:30:26.038 INFO:teuthology.orchestra.run.trial178.stdout:This user must also own the server process. 2026-02-13T02:30:26.038 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:26.038 INFO:teuthology.orchestra.run.trial178.stdout:The database cluster will be initialized with locale "C.UTF-8". 2026-02-13T02:30:26.038 INFO:teuthology.orchestra.run.trial178.stdout:The default database encoding has accordingly been set to "UTF8". 2026-02-13T02:30:26.038 INFO:teuthology.orchestra.run.trial178.stdout:The default text search configuration will be set to "english". 2026-02-13T02:30:26.038 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:26.039 INFO:teuthology.orchestra.run.trial178.stdout:Data page checksums are disabled. 2026-02-13T02:30:26.039 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:26.039 INFO:teuthology.orchestra.run.trial178.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2026-02-13T02:30:26.039 INFO:teuthology.orchestra.run.trial178.stdout:creating subdirectories ... ok 2026-02-13T02:30:26.039 INFO:teuthology.orchestra.run.trial178.stdout:selecting dynamic shared memory implementation ... posix 2026-02-13T02:30:26.048 INFO:teuthology.orchestra.run.trial178.stdout:selecting default max_connections ... 100 2026-02-13T02:30:26.060 INFO:teuthology.orchestra.run.trial178.stdout:selecting default shared_buffers ... 128MB 2026-02-13T02:30:26.072 INFO:teuthology.orchestra.run.trial178.stdout:selecting default time zone ... Etc/UTC 2026-02-13T02:30:26.073 INFO:teuthology.orchestra.run.trial178.stdout:creating configuration files ... ok 2026-02-13T02:30:26.091 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2026-02-13T02:30:26.092 INFO:teuthology.orchestra.run.trial121.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2026-02-13T02:30:26.093 INFO:teuthology.orchestra.run.trial121.stdout:Setting up postgresql-client (14+238) ... 2026-02-13T02:30:26.094 INFO:teuthology.orchestra.run.trial121.stdout:Setting up network-manager (1.36.6-0ubuntu2.2) ... 2026-02-13T02:30:26.140 INFO:teuthology.orchestra.run.trial178.stdout:running bootstrap script ... ok 2026-02-13T02:30:26.353 INFO:teuthology.orchestra.run.trial178.stdout:performing post-bootstrap initialization ... ok 2026-02-13T02:30:26.390 INFO:teuthology.orchestra.run.trial178.stdout:syncing data to disk ... ok 2026-02-13T02:30:26.394 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service → /lib/systemd/system/NetworkManager-dispatcher.service. 2026-02-13T02:30:26.658 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service → /lib/systemd/system/NetworkManager-wait-online.service. 2026-02-13T02:30:26.675 INFO:teuthology.orchestra.run.trial178.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2026-02-13T02:30:26.909 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service → /lib/systemd/system/NetworkManager.service. 2026-02-13T02:30:27.317 INFO:teuthology.orchestra.run.trial121.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2026-02-13T02:30:27.318 INFO:teuthology.orchestra.run.trial121.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2026-02-13T02:30:27.320 INFO:teuthology.orchestra.run.trial121.stdout:Setting up postgresql-common (238) ... 2026-02-13T02:30:27.459 INFO:teuthology.orchestra.run.trial121.stdout:Adding user postgres to group ssl-cert 2026-02-13T02:30:27.526 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:27.526 INFO:teuthology.orchestra.run.trial121.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2026-02-13T02:30:27.631 INFO:teuthology.orchestra.run.trial121.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2026-02-13T02:30:27.631 INFO:teuthology.orchestra.run.trial121.stdout:Removing obsolete dictionary files: 2026-02-13T02:30:28.119 INFO:teuthology.orchestra.run.trial121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service → /lib/systemd/system/postgresql.service. 2026-02-13T02:30:28.365 INFO:teuthology.orchestra.run.trial121.stdout:Setting up postgresql-14 (14.20-0ubuntu0.22.04.1) ... 2026-02-13T02:30:28.470 INFO:teuthology.orchestra.run.trial121.stdout:Creating new PostgreSQL cluster 14/main ... 2026-02-13T02:30:28.475 INFO:teuthology.orchestra.run.trial121.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2026-02-13T02:30:28.489 INFO:teuthology.orchestra.run.trial121.stdout:The files belonging to this database system will be owned by user "postgres". 2026-02-13T02:30:28.489 INFO:teuthology.orchestra.run.trial121.stdout:This user must also own the server process. 2026-02-13T02:30:28.489 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:28.489 INFO:teuthology.orchestra.run.trial121.stdout:The database cluster will be initialized with locale "C.UTF-8". 2026-02-13T02:30:28.489 INFO:teuthology.orchestra.run.trial121.stdout:The default database encoding has accordingly been set to "UTF8". 2026-02-13T02:30:28.489 INFO:teuthology.orchestra.run.trial121.stdout:The default text search configuration will be set to "english". 2026-02-13T02:30:28.490 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:28.490 INFO:teuthology.orchestra.run.trial121.stdout:Data page checksums are disabled. 2026-02-13T02:30:28.490 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:28.490 INFO:teuthology.orchestra.run.trial121.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2026-02-13T02:30:28.490 INFO:teuthology.orchestra.run.trial121.stdout:creating subdirectories ... ok 2026-02-13T02:30:28.490 INFO:teuthology.orchestra.run.trial121.stdout:selecting dynamic shared memory implementation ... posix 2026-02-13T02:30:28.498 INFO:teuthology.orchestra.run.trial121.stdout:selecting default max_connections ... 100 2026-02-13T02:30:28.511 INFO:teuthology.orchestra.run.trial121.stdout:selecting default shared_buffers ... 128MB 2026-02-13T02:30:28.524 INFO:teuthology.orchestra.run.trial121.stdout:selecting default time zone ... Etc/UTC 2026-02-13T02:30:28.525 INFO:teuthology.orchestra.run.trial121.stdout:creating configuration files ... ok 2026-02-13T02:30:28.593 INFO:teuthology.orchestra.run.trial121.stdout:running bootstrap script ... ok 2026-02-13T02:30:28.800 INFO:teuthology.orchestra.run.trial121.stdout:performing post-bootstrap initialization ... ok 2026-02-13T02:30:28.839 INFO:teuthology.orchestra.run.trial121.stdout:syncing data to disk ... ok 2026-02-13T02:30:29.100 INFO:teuthology.orchestra.run.trial178.stdout:Setting up postgresql-contrib (14+238) ... 2026-02-13T02:30:29.101 INFO:teuthology.orchestra.run.trial178.stdout:Setting up postgresql (14+238) ... 2026-02-13T02:30:29.102 INFO:teuthology.orchestra.run.trial178.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2026-02-13T02:30:29.143 INFO:teuthology.orchestra.run.trial121.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2026-02-13T02:30:29.147 INFO:teuthology.orchestra.run.trial178.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.11) ... 2026-02-13T02:30:29.157 INFO:teuthology.orchestra.run.trial178.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-13T02:30:29.281 INFO:teuthology.orchestra.run.trial178.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2026-02-13T02:30:29.288 INFO:teuthology.orchestra.run.trial178.stdout:Processing triggers for install-info (6.8-4build1) ... 2026-02-13T02:30:29.896 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:29.896 INFO:teuthology.orchestra.run.trial178.stdout:Running kernel seems to be up-to-date. 2026-02-13T02:30:29.896 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:29.896 INFO:teuthology.orchestra.run.trial178.stdout:The processor microcode seems to be up-to-date. 2026-02-13T02:30:29.896 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:29.896 INFO:teuthology.orchestra.run.trial178.stdout:Services to be restarted: 2026-02-13T02:30:29.900 INFO:teuthology.orchestra.run.trial178.stdout: systemctl restart lttng-sessiond.service 2026-02-13T02:30:29.904 INFO:teuthology.orchestra.run.trial178.stdout: systemctl restart nagios-nrpe-server.service 2026-02-13T02:30:29.908 INFO:teuthology.orchestra.run.trial178.stdout: systemctl restart ntp.service 2026-02-13T02:30:29.913 INFO:teuthology.orchestra.run.trial178.stdout: systemctl restart packagekit.service 2026-02-13T02:30:29.918 INFO:teuthology.orchestra.run.trial178.stdout: systemctl restart ssh.service 2026-02-13T02:30:29.922 INFO:teuthology.orchestra.run.trial178.stdout: systemctl restart systemd-journald.service 2026-02-13T02:30:29.931 INFO:teuthology.orchestra.run.trial178.stdout: /etc/needrestart/restart.d/systemd-manager 2026-02-13T02:30:29.936 INFO:teuthology.orchestra.run.trial178.stdout: systemctl restart systemd-networkd.service 2026-02-13T02:30:29.940 INFO:teuthology.orchestra.run.trial178.stdout: systemctl restart systemd-resolved.service 2026-02-13T02:30:29.944 INFO:teuthology.orchestra.run.trial178.stdout: systemctl restart systemd-udevd.service 2026-02-13T02:30:29.949 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:29.950 INFO:teuthology.orchestra.run.trial178.stdout:Service restarts being deferred: 2026-02-13T02:30:29.950 INFO:teuthology.orchestra.run.trial178.stdout: systemctl restart systemd-logind.service 2026-02-13T02:30:29.950 INFO:teuthology.orchestra.run.trial178.stdout: systemctl restart user@1000.service 2026-02-13T02:30:29.950 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:29.950 INFO:teuthology.orchestra.run.trial178.stdout:No containers need to be restarted. 2026-02-13T02:30:29.950 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:29.950 INFO:teuthology.orchestra.run.trial178.stdout:No user sessions are running outdated binaries. 2026-02-13T02:30:29.950 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:29.951 INFO:teuthology.orchestra.run.trial178.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-13T02:30:30.591 INFO:teuthology.orchestra.run.trial178.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-13T02:30:30.597 DEBUG:teuthology.parallel:result is None 2026-02-13T02:30:31.586 INFO:teuthology.orchestra.run.trial121.stdout:Setting up postgresql-contrib (14+238) ... 2026-02-13T02:30:31.587 INFO:teuthology.orchestra.run.trial121.stdout:Setting up postgresql (14+238) ... 2026-02-13T02:30:31.588 INFO:teuthology.orchestra.run.trial121.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2026-02-13T02:30:31.631 INFO:teuthology.orchestra.run.trial121.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.11) ... 2026-02-13T02:30:31.640 INFO:teuthology.orchestra.run.trial121.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-13T02:30:31.762 INFO:teuthology.orchestra.run.trial121.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2026-02-13T02:30:31.769 INFO:teuthology.orchestra.run.trial121.stdout:Processing triggers for install-info (6.8-4build1) ... 2026-02-13T02:30:32.365 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:32.365 INFO:teuthology.orchestra.run.trial121.stdout:Running kernel seems to be up-to-date. 2026-02-13T02:30:32.365 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:32.365 INFO:teuthology.orchestra.run.trial121.stdout:The processor microcode seems to be up-to-date. 2026-02-13T02:30:32.365 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:32.365 INFO:teuthology.orchestra.run.trial121.stdout:Services to be restarted: 2026-02-13T02:30:32.368 INFO:teuthology.orchestra.run.trial121.stdout: systemctl restart lttng-sessiond.service 2026-02-13T02:30:32.373 INFO:teuthology.orchestra.run.trial121.stdout: systemctl restart nagios-nrpe-server.service 2026-02-13T02:30:32.377 INFO:teuthology.orchestra.run.trial121.stdout: systemctl restart ntp.service 2026-02-13T02:30:32.382 INFO:teuthology.orchestra.run.trial121.stdout: systemctl restart packagekit.service 2026-02-13T02:30:32.386 INFO:teuthology.orchestra.run.trial121.stdout: systemctl restart ssh.service 2026-02-13T02:30:32.391 INFO:teuthology.orchestra.run.trial121.stdout: systemctl restart systemd-journald.service 2026-02-13T02:30:32.401 INFO:teuthology.orchestra.run.trial121.stdout: /etc/needrestart/restart.d/systemd-manager 2026-02-13T02:30:32.405 INFO:teuthology.orchestra.run.trial121.stdout: systemctl restart systemd-networkd.service 2026-02-13T02:30:32.409 INFO:teuthology.orchestra.run.trial121.stdout: systemctl restart systemd-resolved.service 2026-02-13T02:30:32.414 INFO:teuthology.orchestra.run.trial121.stdout: systemctl restart systemd-udevd.service 2026-02-13T02:30:32.419 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:32.419 INFO:teuthology.orchestra.run.trial121.stdout:Service restarts being deferred: 2026-02-13T02:30:32.419 INFO:teuthology.orchestra.run.trial121.stdout: systemctl restart systemd-logind.service 2026-02-13T02:30:32.419 INFO:teuthology.orchestra.run.trial121.stdout: systemctl restart user@1000.service 2026-02-13T02:30:32.419 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:32.419 INFO:teuthology.orchestra.run.trial121.stdout:No containers need to be restarted. 2026-02-13T02:30:32.420 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:32.420 INFO:teuthology.orchestra.run.trial121.stdout:No user sessions are running outdated binaries. 2026-02-13T02:30:32.420 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:32.420 INFO:teuthology.orchestra.run.trial121.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-13T02:30:33.064 INFO:teuthology.orchestra.run.trial121.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-13T02:30:33.070 DEBUG:teuthology.parallel:result is None 2026-02-13T02:30:33.071 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T02:30:33.243 DEBUG:teuthology.orchestra.run.trial121:> dpkg-query -W -f '${Version}' ceph 2026-02-13T02:30:33.254 INFO:teuthology.orchestra.run.trial121.stdout:20.3.0-5241-g8f8d3829-1jammy 2026-02-13T02:30:33.254 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241-g8f8d3829-1jammy 2026-02-13T02:30:33.255 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241-g8f8d3829-1jammy is installed. 2026-02-13T02:30:33.257 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T02:30:33.403 DEBUG:teuthology.orchestra.run.trial178:> dpkg-query -W -f '${Version}' ceph 2026-02-13T02:30:33.413 INFO:teuthology.orchestra.run.trial178.stdout:20.3.0-5241-g8f8d3829-1jammy 2026-02-13T02:30:33.414 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241-g8f8d3829-1jammy 2026-02-13T02:30:33.414 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241-g8f8d3829-1jammy is installed. 2026-02-13T02:30:33.415 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-13T02:30:33.415 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:30:33.415 DEBUG:teuthology.orchestra.run.trial121:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T02:30:33.426 DEBUG:teuthology.orchestra.run.trial178:> set -ex 2026-02-13T02:30:33.426 DEBUG:teuthology.orchestra.run.trial178:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T02:30:33.466 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-13T02:30:33.466 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:30:33.467 DEBUG:teuthology.orchestra.run.trial121:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T02:30:33.479 DEBUG:teuthology.orchestra.run.trial121:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T02:30:33.529 DEBUG:teuthology.orchestra.run.trial178:> set -ex 2026-02-13T02:30:33.529 DEBUG:teuthology.orchestra.run.trial178:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T02:30:33.538 DEBUG:teuthology.orchestra.run.trial178:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T02:30:33.589 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-13T02:30:33.589 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:30:33.589 DEBUG:teuthology.orchestra.run.trial121:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T02:30:33.598 DEBUG:teuthology.orchestra.run.trial121:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T02:30:33.650 DEBUG:teuthology.orchestra.run.trial178:> set -ex 2026-02-13T02:30:33.650 DEBUG:teuthology.orchestra.run.trial178:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T02:30:33.658 DEBUG:teuthology.orchestra.run.trial178:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T02:30:33.708 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-13T02:30:33.709 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:30:33.709 DEBUG:teuthology.orchestra.run.trial121:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T02:30:33.717 DEBUG:teuthology.orchestra.run.trial121:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T02:30:33.765 DEBUG:teuthology.orchestra.run.trial178:> set -ex 2026-02-13T02:30:33.766 DEBUG:teuthology.orchestra.run.trial178:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T02:30:33.775 DEBUG:teuthology.orchestra.run.trial178:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T02:30:33.824 INFO:teuthology.run_tasks:Running task ceph... 2026-02-13T02:30:33.936 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-13T02:30:33.937 DEBUG:teuthology.orchestra.run.trial121:> sudo chmod 777 /var/log/ceph 2026-02-13T02:30:33.938 DEBUG:teuthology.orchestra.run.trial178:> sudo chmod 777 /var/log/ceph 2026-02-13T02:30:33.946 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-13T02:30:33.946 DEBUG:teuthology.orchestra.run.trial121:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-13T02:30:33.986 DEBUG:teuthology.orchestra.run.trial178:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-13T02:30:33.996 INFO:tasks.ceph:Creating extra log directories... 2026-02-13T02:30:33.996 DEBUG:teuthology.orchestra.run.trial121:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-13T02:30:34.039 DEBUG:teuthology.orchestra.run.trial178:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-13T02:30:34.055 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2026-02-13T02:30:34.055 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2026-02-13T02:30:34.055 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2026-02-13T02:30:34.055 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:30:34.055 DEBUG:teuthology.orchestra.run.trial121:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2026-02-13T02:30:34.090 DEBUG:teuthology.orchestra.run.trial121:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2026-02-13T02:30:34.153 DEBUG:teuthology.orchestra.run.trial178:> set -ex 2026-02-13T02:30:34.153 DEBUG:teuthology.orchestra.run.trial178:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2026-02-13T02:30:34.159 DEBUG:teuthology.orchestra.run.trial178:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2026-02-13T02:30:34.233 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-13T02:30:34.234 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'BLUESTORE_SLOW_OP_ALERT', 'slow operation indications in BlueStore', 'experiencing slow operations in BlueStore', 'MGR_MODULE_ERROR', 'OSD_DOWN', 'osd.* is down', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'osds down', 'osd.* is down', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected', 'object missing on disk', 'Invalid tag char'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-13T02:30:34.234 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48001', 'branch': 'wip-pdonnell-testing-20260210.171210', 'description': 'fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/forward-scrub}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '48001', 'kernel': {'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'trial', 'name': 'pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20260210.171210'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'BLUESTORE_SLOW_OP_ALERT', 'slow operation indications in BlueStore', 'experiencing slow operations in BlueStore', 'MGR_MODULE_ERROR', 'OSD_DOWN', 'osd.* is down', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'osds down', 'osd.* is down', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected', 'object missing on disk', 'Invalid tag char'], 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20260210.171210', 'sha1': 'cfcf307502511ba51c39a8b9085c2fcde505d421'}}, 'owner': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7166, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'sleep_before_teardown': 0, 'subset': '604/1024', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20260210.171210', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph', 'suite_sha1': 'cfcf307502511ba51c39a8b9085c2fcde505d421', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'trial121.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKvc2fwMSPKZtOBjHBiIYpDC0U+qmHf3H7mEkngTAChiI6yS3y1W02Mr4smmsXUrx/pbfDEKbRplWFe13YhXDjk=', 'trial178.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ/3TPcS+jR1KdbTSgvdeQ/H86TCVeOPawwkyklb68zex6A9+I2TTe8kX3hBZhDnKKZXjS7FtPZG87yoxSz3g/4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'BLUESTORE_SLOW_OP_ALERT', 'slow operation indications in BlueStore', 'experiencing slow operations in BlueStore', 'MGR_MODULE_ERROR', 'OSD_DOWN', 'osd.* is down', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'osds down', 'osd.* is down', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected', 'object missing on disk', 'Invalid tag char'], 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local kernel = py_attrgetter(yaml).get(\'kernel\')\nif kernel ~= nil then\n local branch = py_attrgetter(kernel).get(\'branch\')\n if branch and not kernel.branch:find "-all$" then\n log.debug("removing default kernel specification: %s", kernel)\n py_attrgetter(kernel).pop(\'branch\', nil)\n py_attrgetter(kernel).pop(\'deb\', nil)\n py_attrgetter(kernel).pop(\'flavor\', nil)\n py_attrgetter(kernel).pop(\'kdb\', nil)\n py_attrgetter(kernel).pop(\'koji\', nil)\n py_attrgetter(kernel).pop(\'koji_task\', nil)\n py_attrgetter(kernel).pop(\'rpm\', nil)\n py_attrgetter(kernel).pop(\'sha1\', nil)\n py_attrgetter(kernel).pop(\'tag\', nil)\n end\nend\n', 'local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'kernel-fix-3', 'teuthology_sha1': 'a2c505dae37458c5537fa44f1320bd04eef25bb1', 'timestamp': '2026-02-13_01:53:26', 'tube': 'trial', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482'} 2026-02-13T02:30:34.235 DEBUG:teuthology.orchestra.run.trial121:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-13T02:30:34.237 DEBUG:teuthology.orchestra.run.trial178:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-13T02:30:34.272 DEBUG:teuthology.orchestra.run.trial121:> sudo install -d -m0777 -- /var/run/ceph 2026-02-13T02:30:34.283 DEBUG:teuthology.orchestra.run.trial178:> sudo install -d -m0777 -- /var/run/ceph 2026-02-13T02:30:34.321 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:30:34.321 DEBUG:teuthology.orchestra.run.trial121:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T02:30:34.334 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T02:30:34.334 DEBUG:teuthology.orchestra.run.trial121:> stat /dev/vg_nvme/lv_1 2026-02-13T02:30:34.382 INFO:teuthology.orchestra.run.trial121.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T02:30:34.383 INFO:teuthology.orchestra.run.trial121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:30:34.383 INFO:teuthology.orchestra.run.trial121.stdout:Device: 5h/5d Inode: 905 Links: 1 2026-02-13T02:30:34.383 INFO:teuthology.orchestra.run.trial121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:30:34.383 INFO:teuthology.orchestra.run.trial121.stdout:Access: 2026-02-13 02:29:13.508298027 +0000 2026-02-13T02:30:34.383 INFO:teuthology.orchestra.run.trial121.stdout:Modify: 2026-02-13 02:29:13.328303764 +0000 2026-02-13T02:30:34.383 INFO:teuthology.orchestra.run.trial121.stdout:Change: 2026-02-13 02:29:13.328303764 +0000 2026-02-13T02:30:34.383 INFO:teuthology.orchestra.run.trial121.stdout: Birth: - 2026-02-13T02:30:34.383 DEBUG:teuthology.orchestra.run.trial121:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T02:30:34.432 INFO:teuthology.orchestra.run.trial121.stderr:1+0 records in 2026-02-13T02:30:34.433 INFO:teuthology.orchestra.run.trial121.stderr:1+0 records out 2026-02-13T02:30:34.433 INFO:teuthology.orchestra.run.trial121.stderr:512 bytes copied, 0.00018438 s, 2.8 MB/s 2026-02-13T02:30:34.434 DEBUG:teuthology.orchestra.run.trial121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T02:30:34.483 DEBUG:teuthology.orchestra.run.trial121:> stat /dev/vg_nvme/lv_2 2026-02-13T02:30:34.529 INFO:teuthology.orchestra.run.trial121.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T02:30:34.529 INFO:teuthology.orchestra.run.trial121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:30:34.530 INFO:teuthology.orchestra.run.trial121.stdout:Device: 5h/5d Inode: 930 Links: 1 2026-02-13T02:30:34.530 INFO:teuthology.orchestra.run.trial121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:30:34.530 INFO:teuthology.orchestra.run.trial121.stdout:Access: 2026-02-13 02:29:13.696292039 +0000 2026-02-13T02:30:34.530 INFO:teuthology.orchestra.run.trial121.stdout:Modify: 2026-02-13 02:29:13.692292164 +0000 2026-02-13T02:30:34.530 INFO:teuthology.orchestra.run.trial121.stdout:Change: 2026-02-13 02:29:13.692292164 +0000 2026-02-13T02:30:34.530 INFO:teuthology.orchestra.run.trial121.stdout: Birth: - 2026-02-13T02:30:34.530 DEBUG:teuthology.orchestra.run.trial121:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T02:30:34.577 INFO:teuthology.orchestra.run.trial121.stderr:1+0 records in 2026-02-13T02:30:34.577 INFO:teuthology.orchestra.run.trial121.stderr:1+0 records out 2026-02-13T02:30:34.577 INFO:teuthology.orchestra.run.trial121.stderr:512 bytes copied, 0.000182917 s, 2.8 MB/s 2026-02-13T02:30:34.578 DEBUG:teuthology.orchestra.run.trial121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T02:30:34.627 DEBUG:teuthology.orchestra.run.trial121:> stat /dev/vg_nvme/lv_3 2026-02-13T02:30:34.673 INFO:teuthology.orchestra.run.trial121.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T02:30:34.674 INFO:teuthology.orchestra.run.trial121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:30:34.674 INFO:teuthology.orchestra.run.trial121.stdout:Device: 5h/5d Inode: 965 Links: 1 2026-02-13T02:30:34.674 INFO:teuthology.orchestra.run.trial121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:30:34.674 INFO:teuthology.orchestra.run.trial121.stdout:Access: 2026-02-13 02:29:14.232274962 +0000 2026-02-13T02:30:34.674 INFO:teuthology.orchestra.run.trial121.stdout:Modify: 2026-02-13 02:29:14.040281076 +0000 2026-02-13T02:30:34.674 INFO:teuthology.orchestra.run.trial121.stdout:Change: 2026-02-13 02:29:14.040281076 +0000 2026-02-13T02:30:34.674 INFO:teuthology.orchestra.run.trial121.stdout: Birth: - 2026-02-13T02:30:34.675 DEBUG:teuthology.orchestra.run.trial121:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T02:30:34.720 INFO:teuthology.orchestra.run.trial121.stderr:1+0 records in 2026-02-13T02:30:34.721 INFO:teuthology.orchestra.run.trial121.stderr:1+0 records out 2026-02-13T02:30:34.721 INFO:teuthology.orchestra.run.trial121.stderr:512 bytes copied, 0.000182407 s, 2.8 MB/s 2026-02-13T02:30:34.722 DEBUG:teuthology.orchestra.run.trial121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T02:30:34.771 DEBUG:teuthology.orchestra.run.trial121:> stat /dev/vg_nvme/lv_4 2026-02-13T02:30:34.818 INFO:teuthology.orchestra.run.trial121.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T02:30:34.818 INFO:teuthology.orchestra.run.trial121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:30:34.818 INFO:teuthology.orchestra.run.trial121.stdout:Device: 5h/5d Inode: 976 Links: 1 2026-02-13T02:30:34.818 INFO:teuthology.orchestra.run.trial121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:30:34.818 INFO:teuthology.orchestra.run.trial121.stdout:Access: 2026-02-13 02:29:14.576263999 +0000 2026-02-13T02:30:34.818 INFO:teuthology.orchestra.run.trial121.stdout:Modify: 2026-02-13 02:29:14.396269737 +0000 2026-02-13T02:30:34.818 INFO:teuthology.orchestra.run.trial121.stdout:Change: 2026-02-13 02:29:14.396269737 +0000 2026-02-13T02:30:34.818 INFO:teuthology.orchestra.run.trial121.stdout: Birth: - 2026-02-13T02:30:34.819 DEBUG:teuthology.orchestra.run.trial121:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T02:30:34.865 INFO:teuthology.orchestra.run.trial121.stderr:1+0 records in 2026-02-13T02:30:34.865 INFO:teuthology.orchestra.run.trial121.stderr:1+0 records out 2026-02-13T02:30:34.865 INFO:teuthology.orchestra.run.trial121.stderr:512 bytes copied, 0.000164494 s, 3.1 MB/s 2026-02-13T02:30:34.866 DEBUG:teuthology.orchestra.run.trial121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T02:30:34.915 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-13T02:30:34.915 DEBUG:teuthology.orchestra.run.trial178:> set -ex 2026-02-13T02:30:34.915 DEBUG:teuthology.orchestra.run.trial178:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T02:30:34.921 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T02:30:34.921 DEBUG:teuthology.orchestra.run.trial178:> stat /dev/vg_nvme/lv_1 2026-02-13T02:30:34.969 INFO:teuthology.orchestra.run.trial178.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T02:30:34.969 INFO:teuthology.orchestra.run.trial178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:30:34.969 INFO:teuthology.orchestra.run.trial178.stdout:Device: 5h/5d Inode: 905 Links: 1 2026-02-13T02:30:34.969 INFO:teuthology.orchestra.run.trial178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:30:34.969 INFO:teuthology.orchestra.run.trial178.stdout:Access: 2026-02-13 02:29:12.484486828 +0000 2026-02-13T02:30:34.969 INFO:teuthology.orchestra.run.trial178.stdout:Modify: 2026-02-13 02:29:12.320492056 +0000 2026-02-13T02:30:34.969 INFO:teuthology.orchestra.run.trial178.stdout:Change: 2026-02-13 02:29:12.320492056 +0000 2026-02-13T02:30:34.969 INFO:teuthology.orchestra.run.trial178.stdout: Birth: - 2026-02-13T02:30:34.970 DEBUG:teuthology.orchestra.run.trial178:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T02:30:35.016 INFO:teuthology.orchestra.run.trial178.stderr:1+0 records in 2026-02-13T02:30:35.016 INFO:teuthology.orchestra.run.trial178.stderr:1+0 records out 2026-02-13T02:30:35.016 INFO:teuthology.orchestra.run.trial178.stderr:512 bytes copied, 0.000188909 s, 2.7 MB/s 2026-02-13T02:30:35.017 DEBUG:teuthology.orchestra.run.trial178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T02:30:35.066 DEBUG:teuthology.orchestra.run.trial178:> stat /dev/vg_nvme/lv_2 2026-02-13T02:30:35.113 INFO:teuthology.orchestra.run.trial178.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T02:30:35.113 INFO:teuthology.orchestra.run.trial178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:30:35.113 INFO:teuthology.orchestra.run.trial178.stdout:Device: 5h/5d Inode: 930 Links: 1 2026-02-13T02:30:35.113 INFO:teuthology.orchestra.run.trial178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:30:35.113 INFO:teuthology.orchestra.run.trial178.stdout:Access: 2026-02-13 02:29:12.648481597 +0000 2026-02-13T02:30:35.113 INFO:teuthology.orchestra.run.trial178.stdout:Modify: 2026-02-13 02:29:12.644481723 +0000 2026-02-13T02:30:35.113 INFO:teuthology.orchestra.run.trial178.stdout:Change: 2026-02-13 02:29:12.644481723 +0000 2026-02-13T02:30:35.113 INFO:teuthology.orchestra.run.trial178.stdout: Birth: - 2026-02-13T02:30:35.114 DEBUG:teuthology.orchestra.run.trial178:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T02:30:35.160 INFO:teuthology.orchestra.run.trial178.stderr:1+0 records in 2026-02-13T02:30:35.160 INFO:teuthology.orchestra.run.trial178.stderr:1+0 records out 2026-02-13T02:30:35.160 INFO:teuthology.orchestra.run.trial178.stderr:512 bytes copied, 0.000174703 s, 2.9 MB/s 2026-02-13T02:30:35.161 DEBUG:teuthology.orchestra.run.trial178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T02:30:35.210 DEBUG:teuthology.orchestra.run.trial178:> stat /dev/vg_nvme/lv_3 2026-02-13T02:30:35.256 INFO:teuthology.orchestra.run.trial178.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T02:30:35.257 INFO:teuthology.orchestra.run.trial178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:30:35.257 INFO:teuthology.orchestra.run.trial178.stdout:Device: 5h/5d Inode: 952 Links: 1 2026-02-13T02:30:35.257 INFO:teuthology.orchestra.run.trial178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:30:35.257 INFO:teuthology.orchestra.run.trial178.stdout:Access: 2026-02-13 02:29:13.184464500 +0000 2026-02-13T02:30:35.257 INFO:teuthology.orchestra.run.trial178.stdout:Modify: 2026-02-13 02:29:13.016469861 +0000 2026-02-13T02:30:35.257 INFO:teuthology.orchestra.run.trial178.stdout:Change: 2026-02-13 02:29:13.016469861 +0000 2026-02-13T02:30:35.257 INFO:teuthology.orchestra.run.trial178.stdout: Birth: - 2026-02-13T02:30:35.257 DEBUG:teuthology.orchestra.run.trial178:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T02:30:35.303 INFO:teuthology.orchestra.run.trial178.stderr:1+0 records in 2026-02-13T02:30:35.304 INFO:teuthology.orchestra.run.trial178.stderr:1+0 records out 2026-02-13T02:30:35.304 INFO:teuthology.orchestra.run.trial178.stderr:512 bytes copied, 0.000177177 s, 2.9 MB/s 2026-02-13T02:30:35.305 DEBUG:teuthology.orchestra.run.trial178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T02:30:35.354 DEBUG:teuthology.orchestra.run.trial178:> stat /dev/vg_nvme/lv_4 2026-02-13T02:30:35.401 INFO:teuthology.orchestra.run.trial178.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T02:30:35.401 INFO:teuthology.orchestra.run.trial178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:30:35.401 INFO:teuthology.orchestra.run.trial178.stdout:Device: 5h/5d Inode: 976 Links: 1 2026-02-13T02:30:35.401 INFO:teuthology.orchestra.run.trial178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:30:35.401 INFO:teuthology.orchestra.run.trial178.stdout:Access: 2026-02-13 02:29:13.516453912 +0000 2026-02-13T02:30:35.401 INFO:teuthology.orchestra.run.trial178.stdout:Modify: 2026-02-13 02:29:13.352459142 +0000 2026-02-13T02:30:35.401 INFO:teuthology.orchestra.run.trial178.stdout:Change: 2026-02-13 02:29:13.352459142 +0000 2026-02-13T02:30:35.402 INFO:teuthology.orchestra.run.trial178.stdout: Birth: - 2026-02-13T02:30:35.402 DEBUG:teuthology.orchestra.run.trial178:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T02:30:35.448 INFO:teuthology.orchestra.run.trial178.stderr:1+0 records in 2026-02-13T02:30:35.448 INFO:teuthology.orchestra.run.trial178.stderr:1+0 records out 2026-02-13T02:30:35.448 INFO:teuthology.orchestra.run.trial178.stderr:512 bytes copied, 0.000165365 s, 3.1 MB/s 2026-02-13T02:30:35.449 DEBUG:teuthology.orchestra.run.trial178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T02:30:35.498 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2026-02-13T02:30:35.498 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial121.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial178.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2026-02-13T02:30:35.499 INFO:tasks.ceph:Generating config... 2026-02-13T02:30:35.501 INFO:tasks.ceph:[client] pid file = 2026-02-13T02:30:35.501 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-13T02:30:35.501 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-13T02:30:35.501 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-13T02:30:35.501 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-13T02:30:35.502 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-13T02:30:35.502 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2026-02-13T02:30:35.502 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-13T02:30:35.502 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-13T02:30:35.502 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-13T02:30:35.502 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-13T02:30:35.502 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-13T02:30:35.502 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-13T02:30:35.502 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-13T02:30:35.502 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-13T02:30:35.502 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-13T02:30:35.503 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-13T02:30:35.503 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-13T02:30:35.503 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-13T02:30:35.503 INFO:tasks.ceph:Setting up mon.a... 2026-02-13T02:30:35.503 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-13T02:30:35.521 INFO:teuthology.orchestra.run.trial121.stdout:creating /etc/ceph/ceph.keyring 2026-02-13T02:30:35.524 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-13T02:30:35.585 DEBUG:teuthology.orchestra.run.trial121:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-13T02:30:35.638 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.121'), ('mon.b', '10.20.193.178'), ('mon.c', '[v2:10.20.193.178:3301,v1:10.20.193.178:6790]')] 2026-02-13T02:30:35.638 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.121,10.20.193.178,[v2:10.20.193.178:3301,v1:10.20.193.178:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2026-02-13T02:30:35.639 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:30:35.640 DEBUG:teuthology.orchestra.run.trial121:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-13T02:30:35.682 DEBUG:teuthology.orchestra.run.trial121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.121 --add b 10.20.193.178 --addv c '[v2:10.20.193.178:3301,v1:10.20.193.178:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-13T02:30:35.740 INFO:teuthology.orchestra.run.trial121.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-13T02:30:35.741 INFO:teuthology.orchestra.run.trial121.stdout:monmaptool: generated fsid 58020caa-1bc7-4445-b2fc-3f075ab46105 2026-02-13T02:30:35.741 INFO:teuthology.orchestra.run.trial121.stdout:setting min_mon_release = tentacle 2026-02-13T02:30:35.741 INFO:teuthology.orchestra.run.trial121.stdout:epoch 0 2026-02-13T02:30:35.741 INFO:teuthology.orchestra.run.trial121.stdout:fsid 58020caa-1bc7-4445-b2fc-3f075ab46105 2026-02-13T02:30:35.741 INFO:teuthology.orchestra.run.trial121.stdout:last_changed 2026-02-13T02:30:35.736565+0000 2026-02-13T02:30:35.741 INFO:teuthology.orchestra.run.trial121.stdout:created 2026-02-13T02:30:35.736565+0000 2026-02-13T02:30:35.741 INFO:teuthology.orchestra.run.trial121.stdout:min_mon_release 20 (tentacle) 2026-02-13T02:30:35.741 INFO:teuthology.orchestra.run.trial121.stdout:election_strategy: 1 2026-02-13T02:30:35.741 INFO:teuthology.orchestra.run.trial121.stdout:0: [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] mon.a 2026-02-13T02:30:35.742 INFO:teuthology.orchestra.run.trial121.stdout:1: [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] mon.b 2026-02-13T02:30:35.742 INFO:teuthology.orchestra.run.trial121.stdout:2: [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] mon.c 2026-02-13T02:30:35.742 INFO:teuthology.orchestra.run.trial121.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-13T02:30:35.743 DEBUG:teuthology.orchestra.run.trial121:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-13T02:30:35.790 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 58020caa-1bc7-4445-b2fc-3f075ab46105... 2026-02-13T02:30:35.791 DEBUG:teuthology.orchestra.run.trial121:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-13T02:30:35.831 DEBUG:teuthology.orchestra.run.trial178:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-13T02:30:35.849 INFO:teuthology.orchestra.run.trial121.stdout:[global] 2026-02-13T02:30:35.849 INFO:teuthology.orchestra.run.trial121.stdout: chdir = "" 2026-02-13T02:30:35.850 INFO:teuthology.orchestra.run.trial121.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-13T02:30:35.850 INFO:teuthology.orchestra.run.trial121.stdout: auth supported = cephx 2026-02-13T02:30:35.850 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.850 INFO:teuthology.orchestra.run.trial121.stdout: filestore xattr use omap = true 2026-02-13T02:30:35.850 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.850 INFO:teuthology.orchestra.run.trial121.stdout: mon clock drift allowed = 1.000 2026-02-13T02:30:35.850 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.850 INFO:teuthology.orchestra.run.trial121.stdout: osd crush chooseleaf type = 0 2026-02-13T02:30:35.850 INFO:teuthology.orchestra.run.trial121.stdout: auth debug = true 2026-02-13T02:30:35.850 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.850 INFO:teuthology.orchestra.run.trial121.stdout: ms die on old message = true 2026-02-13T02:30:35.851 INFO:teuthology.orchestra.run.trial121.stdout: ms die on bug = true 2026-02-13T02:30:35.851 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.851 INFO:teuthology.orchestra.run.trial121.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-13T02:30:35.851 INFO:teuthology.orchestra.run.trial121.stdout: mon pg warn max object skew = 0 2026-02-13T02:30:35.851 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.851 INFO:teuthology.orchestra.run.trial121.stdout: # disable pg_autoscaler by default for new pools 2026-02-13T02:30:35.851 INFO:teuthology.orchestra.run.trial121.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-13T02:30:35.851 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.851 INFO:teuthology.orchestra.run.trial121.stdout: osd pool default size = 2 2026-02-13T02:30:35.851 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.851 INFO:teuthology.orchestra.run.trial121.stdout: mon osd allow primary affinity = true 2026-02-13T02:30:35.851 INFO:teuthology.orchestra.run.trial121.stdout: mon osd allow pg remap = true 2026-02-13T02:30:35.852 INFO:teuthology.orchestra.run.trial121.stdout: mon warn on legacy crush tunables = false 2026-02-13T02:30:35.852 INFO:teuthology.orchestra.run.trial121.stdout: mon warn on crush straw calc version zero = false 2026-02-13T02:30:35.852 INFO:teuthology.orchestra.run.trial121.stdout: mon warn on no sortbitwise = false 2026-02-13T02:30:35.852 INFO:teuthology.orchestra.run.trial121.stdout: mon warn on osd down out interval zero = false 2026-02-13T02:30:35.852 INFO:teuthology.orchestra.run.trial121.stdout: mon warn on too few osds = false 2026-02-13T02:30:35.852 INFO:teuthology.orchestra.run.trial121.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-13T02:30:35.852 INFO:teuthology.orchestra.run.trial121.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-13T02:30:35.852 INFO:teuthology.orchestra.run.trial121.stdout: mon_allow_pool_size_one = true 2026-02-13T02:30:35.852 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.852 INFO:teuthology.orchestra.run.trial121.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-13T02:30:35.852 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.853 INFO:teuthology.orchestra.run.trial121.stdout: osd default data pool replay window = 5 2026-02-13T02:30:35.853 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.853 INFO:teuthology.orchestra.run.trial121.stdout: mon allow pool delete = true 2026-02-13T02:30:35.853 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.853 INFO:teuthology.orchestra.run.trial121.stdout: mon cluster log file level = debug 2026-02-13T02:30:35.853 INFO:teuthology.orchestra.run.trial121.stdout: debug asserts on shutdown = true 2026-02-13T02:30:35.853 INFO:teuthology.orchestra.run.trial121.stdout: mon health detail to clog = false 2026-02-13T02:30:35.853 INFO:teuthology.orchestra.run.trial121.stdout: mon host = "10.20.193.121,10.20.193.178,[v2:10.20.193.178:3301,v1:10.20.193.178:6790]" 2026-02-13T02:30:35.853 INFO:teuthology.orchestra.run.trial121.stdout: fsid = 58020caa-1bc7-4445-b2fc-3f075ab46105 2026-02-13T02:30:35.853 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.853 INFO:teuthology.orchestra.run.trial121.stdout:[osd] 2026-02-13T02:30:35.853 INFO:teuthology.orchestra.run.trial121.stdout: osd journal size = 100 2026-02-13T02:30:35.854 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.854 INFO:teuthology.orchestra.run.trial121.stdout: osd scrub load threshold = 5.0 2026-02-13T02:30:35.854 INFO:teuthology.orchestra.run.trial121.stdout: osd scrub max interval = 600 2026-02-13T02:30:35.854 INFO:teuthology.orchestra.run.trial121.stdout: osd mclock profile = high_recovery_ops 2026-02-13T02:30:35.854 INFO:teuthology.orchestra.run.trial121.stdout: osd mclock skip benchmark = true 2026-02-13T02:30:35.854 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.854 INFO:teuthology.orchestra.run.trial121.stdout: osd recover clone overlap = true 2026-02-13T02:30:35.854 INFO:teuthology.orchestra.run.trial121.stdout: osd recovery max chunk = 1048576 2026-02-13T02:30:35.854 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.854 INFO:teuthology.orchestra.run.trial121.stdout: osd debug shutdown = true 2026-02-13T02:30:35.854 INFO:teuthology.orchestra.run.trial121.stdout: osd debug op order = true 2026-02-13T02:30:35.854 INFO:teuthology.orchestra.run.trial121.stdout: osd debug verify stray on activate = true 2026-02-13T02:30:35.855 INFO:teuthology.orchestra.run.trial121.stdout: osd debug trim objects = true 2026-02-13T02:30:35.855 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.855 INFO:teuthology.orchestra.run.trial121.stdout: osd open classes on start = true 2026-02-13T02:30:35.855 INFO:teuthology.orchestra.run.trial121.stdout: osd debug pg log writeout = true 2026-02-13T02:30:35.855 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.855 INFO:teuthology.orchestra.run.trial121.stdout: osd deep scrub update digest min age = 30 2026-02-13T02:30:35.855 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.855 INFO:teuthology.orchestra.run.trial121.stdout: osd map max advance = 10 2026-02-13T02:30:35.855 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.855 INFO:teuthology.orchestra.run.trial121.stdout: journal zero on create = true 2026-02-13T02:30:35.855 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.855 INFO:teuthology.orchestra.run.trial121.stdout: filestore ondisk finisher threads = 3 2026-02-13T02:30:35.855 INFO:teuthology.orchestra.run.trial121.stdout: filestore apply finisher threads = 3 2026-02-13T02:30:35.856 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.856 INFO:teuthology.orchestra.run.trial121.stdout: bdev debug aio = true 2026-02-13T02:30:35.856 INFO:teuthology.orchestra.run.trial121.stdout: osd debug misdirected ops = true 2026-02-13T02:30:35.856 INFO:teuthology.orchestra.run.trial121.stdout: bluestore block size = 96636764160 2026-02-13T02:30:35.856 INFO:teuthology.orchestra.run.trial121.stdout: bluestore fsck on mount = True 2026-02-13T02:30:35.856 INFO:teuthology.orchestra.run.trial121.stdout: debug bluefs = 20 2026-02-13T02:30:35.856 INFO:teuthology.orchestra.run.trial121.stdout: debug bluestore = 20 2026-02-13T02:30:35.856 INFO:teuthology.orchestra.run.trial121.stdout: debug ms = 1 2026-02-13T02:30:35.856 INFO:teuthology.orchestra.run.trial121.stdout: debug osd = 20 2026-02-13T02:30:35.856 INFO:teuthology.orchestra.run.trial121.stdout: debug rocksdb = 10 2026-02-13T02:30:35.856 INFO:teuthology.orchestra.run.trial121.stdout: mon osd backfillfull_ratio = 0.85 2026-02-13T02:30:35.856 INFO:teuthology.orchestra.run.trial121.stdout: mon osd full ratio = 0.9 2026-02-13T02:30:35.856 INFO:teuthology.orchestra.run.trial121.stdout: mon osd nearfull ratio = 0.8 2026-02-13T02:30:35.857 INFO:teuthology.orchestra.run.trial121.stdout: osd failsafe full ratio = 0.95 2026-02-13T02:30:35.857 INFO:teuthology.orchestra.run.trial121.stdout: osd objectstore = bluestore 2026-02-13T02:30:35.857 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.857 INFO:teuthology.orchestra.run.trial121.stdout:[mgr] 2026-02-13T02:30:35.857 INFO:teuthology.orchestra.run.trial121.stdout: debug ms = 1 2026-02-13T02:30:35.857 INFO:teuthology.orchestra.run.trial121.stdout: debug mgr = 20 2026-02-13T02:30:35.857 INFO:teuthology.orchestra.run.trial121.stdout: debug mon = 20 2026-02-13T02:30:35.857 INFO:teuthology.orchestra.run.trial121.stdout: debug auth = 20 2026-02-13T02:30:35.857 INFO:teuthology.orchestra.run.trial121.stdout: mon reweight min pgs per osd = 4 2026-02-13T02:30:35.857 INFO:teuthology.orchestra.run.trial121.stdout: mon reweight min bytes per osd = 10 2026-02-13T02:30:35.857 INFO:teuthology.orchestra.run.trial121.stdout: mgr/telemetry/nag = false 2026-02-13T02:30:35.858 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.858 INFO:teuthology.orchestra.run.trial121.stdout:[mon] 2026-02-13T02:30:35.858 INFO:teuthology.orchestra.run.trial121.stdout: debug ms = 1 2026-02-13T02:30:35.858 INFO:teuthology.orchestra.run.trial121.stdout: debug mon = 20 2026-02-13T02:30:35.858 INFO:teuthology.orchestra.run.trial121.stdout: debug paxos = 20 2026-02-13T02:30:35.858 INFO:teuthology.orchestra.run.trial121.stdout: debug auth = 20 2026-02-13T02:30:35.858 INFO:teuthology.orchestra.run.trial121.stdout: mon data avail warn = 5 2026-02-13T02:30:35.858 INFO:teuthology.orchestra.run.trial121.stdout: mon mgr mkfs grace = 240 2026-02-13T02:30:35.858 INFO:teuthology.orchestra.run.trial121.stdout: mon reweight min pgs per osd = 4 2026-02-13T02:30:35.858 INFO:teuthology.orchestra.run.trial121.stdout: mon osd reporter subtree level = osd 2026-02-13T02:30:35.858 INFO:teuthology.orchestra.run.trial121.stdout: mon osd prime pg temp = true 2026-02-13T02:30:35.859 INFO:teuthology.orchestra.run.trial121.stdout: mon reweight min bytes per osd = 10 2026-02-13T02:30:35.859 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.859 INFO:teuthology.orchestra.run.trial121.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-13T02:30:35.859 INFO:teuthology.orchestra.run.trial121.stdout: auth mon ticket ttl = 660 # 11m 2026-02-13T02:30:35.859 INFO:teuthology.orchestra.run.trial121.stdout: auth service ticket ttl = 240 # 4m 2026-02-13T02:30:35.859 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.859 INFO:teuthology.orchestra.run.trial121.stdout: # don't complain about insecure global_id in the test suite 2026-02-13T02:30:35.859 INFO:teuthology.orchestra.run.trial121.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-13T02:30:35.859 INFO:teuthology.orchestra.run.trial121.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-13T02:30:35.859 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.860 INFO:teuthology.orchestra.run.trial121.stdout: # 1m isn't quite enough 2026-02-13T02:30:35.860 INFO:teuthology.orchestra.run.trial121.stdout: mon_down_mkfs_grace = 2m 2026-02-13T02:30:35.860 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.860 INFO:teuthology.orchestra.run.trial121.stdout: mon_warn_on_filestore_osds = false 2026-02-13T02:30:35.860 INFO:teuthology.orchestra.run.trial121.stdout: mon down mkfs grace = 300 2026-02-13T02:30:35.860 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:30:35.860 INFO:teuthology.orchestra.run.trial121.stdout:[client] 2026-02-13T02:30:35.860 INFO:teuthology.orchestra.run.trial121.stdout: rgw cache enabled = true 2026-02-13T02:30:35.860 INFO:teuthology.orchestra.run.trial121.stdout: rgw enable ops log = true 2026-02-13T02:30:35.860 INFO:teuthology.orchestra.run.trial121.stdout: rgw enable usage log = true 2026-02-13T02:30:35.861 INFO:teuthology.orchestra.run.trial121.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-13T02:30:35.861 INFO:teuthology.orchestra.run.trial121.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-13T02:30:35.861 INFO:teuthology.orchestra.run.trial121.stdout: pid file = "" 2026-02-13T02:30:35.861 INFO:teuthology.orchestra.run.trial121.stdout:[mon.a] 2026-02-13T02:30:35.861 INFO:teuthology.orchestra.run.trial121.stdout:[mon.b] 2026-02-13T02:30:35.861 INFO:teuthology.orchestra.run.trial121.stdout:[mon.c] 2026-02-13T02:30:35.861 INFO:teuthology.orchestra.run.trial121.stdout:[mds.a] 2026-02-13T02:30:35.861 INFO:teuthology.orchestra.run.trial121.stdout:[mds.c] 2026-02-13T02:30:35.861 INFO:teuthology.orchestra.run.trial121.stdout:[mds.b] 2026-02-13T02:30:35.861 INFO:teuthology.orchestra.run.trial121.stdout:[mds.d] 2026-02-13T02:30:35.863 INFO:teuthology.orchestra.run.trial178.stdout:[global] 2026-02-13T02:30:35.864 INFO:teuthology.orchestra.run.trial178.stdout: chdir = "" 2026-02-13T02:30:35.864 INFO:teuthology.orchestra.run.trial178.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-13T02:30:35.864 INFO:teuthology.orchestra.run.trial178.stdout: auth supported = cephx 2026-02-13T02:30:35.864 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.864 INFO:teuthology.orchestra.run.trial178.stdout: filestore xattr use omap = true 2026-02-13T02:30:35.864 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.864 INFO:teuthology.orchestra.run.trial178.stdout: mon clock drift allowed = 1.000 2026-02-13T02:30:35.864 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.864 INFO:teuthology.orchestra.run.trial178.stdout: osd crush chooseleaf type = 0 2026-02-13T02:30:35.864 INFO:teuthology.orchestra.run.trial178.stdout: auth debug = true 2026-02-13T02:30:35.865 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.865 INFO:teuthology.orchestra.run.trial178.stdout: ms die on old message = true 2026-02-13T02:30:35.865 INFO:teuthology.orchestra.run.trial178.stdout: ms die on bug = true 2026-02-13T02:30:35.865 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.865 INFO:teuthology.orchestra.run.trial178.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-13T02:30:35.865 INFO:teuthology.orchestra.run.trial178.stdout: mon pg warn max object skew = 0 2026-02-13T02:30:35.865 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.865 INFO:teuthology.orchestra.run.trial178.stdout: # disable pg_autoscaler by default for new pools 2026-02-13T02:30:35.865 INFO:teuthology.orchestra.run.trial178.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-13T02:30:35.865 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.865 INFO:teuthology.orchestra.run.trial178.stdout: osd pool default size = 2 2026-02-13T02:30:35.865 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.866 INFO:teuthology.orchestra.run.trial178.stdout: mon osd allow primary affinity = true 2026-02-13T02:30:35.866 INFO:teuthology.orchestra.run.trial178.stdout: mon osd allow pg remap = true 2026-02-13T02:30:35.866 INFO:teuthology.orchestra.run.trial178.stdout: mon warn on legacy crush tunables = false 2026-02-13T02:30:35.866 INFO:teuthology.orchestra.run.trial178.stdout: mon warn on crush straw calc version zero = false 2026-02-13T02:30:35.866 INFO:teuthology.orchestra.run.trial178.stdout: mon warn on no sortbitwise = false 2026-02-13T02:30:35.866 INFO:teuthology.orchestra.run.trial178.stdout: mon warn on osd down out interval zero = false 2026-02-13T02:30:35.866 INFO:teuthology.orchestra.run.trial178.stdout: mon warn on too few osds = false 2026-02-13T02:30:35.866 INFO:teuthology.orchestra.run.trial178.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-13T02:30:35.866 INFO:teuthology.orchestra.run.trial178.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-13T02:30:35.866 INFO:teuthology.orchestra.run.trial178.stdout: mon_allow_pool_size_one = true 2026-02-13T02:30:35.866 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.866 INFO:teuthology.orchestra.run.trial178.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-13T02:30:35.867 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.867 INFO:teuthology.orchestra.run.trial178.stdout: osd default data pool replay window = 5 2026-02-13T02:30:35.867 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.867 INFO:teuthology.orchestra.run.trial178.stdout: mon allow pool delete = true 2026-02-13T02:30:35.867 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.867 INFO:teuthology.orchestra.run.trial178.stdout: mon cluster log file level = debug 2026-02-13T02:30:35.867 INFO:teuthology.orchestra.run.trial178.stdout: debug asserts on shutdown = true 2026-02-13T02:30:35.867 INFO:teuthology.orchestra.run.trial178.stdout: mon health detail to clog = false 2026-02-13T02:30:35.867 INFO:teuthology.orchestra.run.trial178.stdout: mon host = "10.20.193.121,10.20.193.178,[v2:10.20.193.178:3301,v1:10.20.193.178:6790]" 2026-02-13T02:30:35.867 INFO:teuthology.orchestra.run.trial178.stdout: fsid = 58020caa-1bc7-4445-b2fc-3f075ab46105 2026-02-13T02:30:35.867 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.867 INFO:teuthology.orchestra.run.trial178.stdout:[osd] 2026-02-13T02:30:35.868 INFO:teuthology.orchestra.run.trial178.stdout: osd journal size = 100 2026-02-13T02:30:35.868 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.868 INFO:teuthology.orchestra.run.trial178.stdout: osd scrub load threshold = 5.0 2026-02-13T02:30:35.868 INFO:teuthology.orchestra.run.trial178.stdout: osd scrub max interval = 600 2026-02-13T02:30:35.868 INFO:teuthology.orchestra.run.trial178.stdout: osd mclock profile = high_recovery_ops 2026-02-13T02:30:35.868 INFO:teuthology.orchestra.run.trial178.stdout: osd mclock skip benchmark = true 2026-02-13T02:30:35.868 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.868 INFO:teuthology.orchestra.run.trial178.stdout: osd recover clone overlap = true 2026-02-13T02:30:35.868 INFO:teuthology.orchestra.run.trial178.stdout: osd recovery max chunk = 1048576 2026-02-13T02:30:35.868 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.868 INFO:teuthology.orchestra.run.trial178.stdout: osd debug shutdown = true 2026-02-13T02:30:35.868 INFO:teuthology.orchestra.run.trial178.stdout: osd debug op order = true 2026-02-13T02:30:35.869 INFO:teuthology.orchestra.run.trial178.stdout: osd debug verify stray on activate = true 2026-02-13T02:30:35.869 INFO:teuthology.orchestra.run.trial178.stdout: osd debug trim objects = true 2026-02-13T02:30:35.869 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.869 INFO:teuthology.orchestra.run.trial178.stdout: osd open classes on start = true 2026-02-13T02:30:35.869 INFO:teuthology.orchestra.run.trial178.stdout: osd debug pg log writeout = true 2026-02-13T02:30:35.869 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.869 INFO:teuthology.orchestra.run.trial178.stdout: osd deep scrub update digest min age = 30 2026-02-13T02:30:35.869 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.869 INFO:teuthology.orchestra.run.trial178.stdout: osd map max advance = 10 2026-02-13T02:30:35.869 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.869 INFO:teuthology.orchestra.run.trial178.stdout: journal zero on create = true 2026-02-13T02:30:35.870 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.870 INFO:teuthology.orchestra.run.trial178.stdout: filestore ondisk finisher threads = 3 2026-02-13T02:30:35.870 INFO:teuthology.orchestra.run.trial178.stdout: filestore apply finisher threads = 3 2026-02-13T02:30:35.870 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.870 INFO:teuthology.orchestra.run.trial178.stdout: bdev debug aio = true 2026-02-13T02:30:35.870 INFO:teuthology.orchestra.run.trial178.stdout: osd debug misdirected ops = true 2026-02-13T02:30:35.870 INFO:teuthology.orchestra.run.trial178.stdout: bluestore block size = 96636764160 2026-02-13T02:30:35.870 INFO:teuthology.orchestra.run.trial178.stdout: bluestore fsck on mount = True 2026-02-13T02:30:35.870 INFO:teuthology.orchestra.run.trial178.stdout: debug bluefs = 20 2026-02-13T02:30:35.870 INFO:teuthology.orchestra.run.trial178.stdout: debug bluestore = 20 2026-02-13T02:30:35.870 INFO:teuthology.orchestra.run.trial178.stdout: debug ms = 1 2026-02-13T02:30:35.871 INFO:teuthology.orchestra.run.trial178.stdout: debug osd = 20 2026-02-13T02:30:35.871 INFO:teuthology.orchestra.run.trial178.stdout: debug rocksdb = 10 2026-02-13T02:30:35.871 INFO:teuthology.orchestra.run.trial178.stdout: mon osd backfillfull_ratio = 0.85 2026-02-13T02:30:35.871 INFO:teuthology.orchestra.run.trial178.stdout: mon osd full ratio = 0.9 2026-02-13T02:30:35.871 INFO:teuthology.orchestra.run.trial178.stdout: mon osd nearfull ratio = 0.8 2026-02-13T02:30:35.871 INFO:teuthology.orchestra.run.trial178.stdout: osd failsafe full ratio = 0.95 2026-02-13T02:30:35.871 INFO:teuthology.orchestra.run.trial178.stdout: osd objectstore = bluestore 2026-02-13T02:30:35.871 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.871 INFO:teuthology.orchestra.run.trial178.stdout:[mgr] 2026-02-13T02:30:35.871 INFO:teuthology.orchestra.run.trial178.stdout: debug ms = 1 2026-02-13T02:30:35.871 INFO:teuthology.orchestra.run.trial178.stdout: debug mgr = 20 2026-02-13T02:30:35.872 INFO:teuthology.orchestra.run.trial178.stdout: debug mon = 20 2026-02-13T02:30:35.872 INFO:teuthology.orchestra.run.trial178.stdout: debug auth = 20 2026-02-13T02:30:35.872 INFO:teuthology.orchestra.run.trial178.stdout: mon reweight min pgs per osd = 4 2026-02-13T02:30:35.872 INFO:teuthology.orchestra.run.trial178.stdout: mon reweight min bytes per osd = 10 2026-02-13T02:30:35.872 INFO:teuthology.orchestra.run.trial178.stdout: mgr/telemetry/nag = false 2026-02-13T02:30:35.872 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.872 INFO:teuthology.orchestra.run.trial178.stdout:[mon] 2026-02-13T02:30:35.872 INFO:teuthology.orchestra.run.trial178.stdout: debug ms = 1 2026-02-13T02:30:35.872 INFO:teuthology.orchestra.run.trial178.stdout: debug mon = 20 2026-02-13T02:30:35.872 INFO:teuthology.orchestra.run.trial178.stdout: debug paxos = 20 2026-02-13T02:30:35.873 INFO:teuthology.orchestra.run.trial178.stdout: debug auth = 20 2026-02-13T02:30:35.873 INFO:teuthology.orchestra.run.trial178.stdout: mon data avail warn = 5 2026-02-13T02:30:35.873 INFO:teuthology.orchestra.run.trial178.stdout: mon mgr mkfs grace = 240 2026-02-13T02:30:35.873 INFO:teuthology.orchestra.run.trial178.stdout: mon reweight min pgs per osd = 4 2026-02-13T02:30:35.873 INFO:teuthology.orchestra.run.trial178.stdout: mon osd reporter subtree level = osd 2026-02-13T02:30:35.873 INFO:teuthology.orchestra.run.trial178.stdout: mon osd prime pg temp = true 2026-02-13T02:30:35.873 INFO:teuthology.orchestra.run.trial178.stdout: mon reweight min bytes per osd = 10 2026-02-13T02:30:35.873 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.873 INFO:teuthology.orchestra.run.trial178.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-13T02:30:35.873 INFO:teuthology.orchestra.run.trial178.stdout: auth mon ticket ttl = 660 # 11m 2026-02-13T02:30:35.873 INFO:teuthology.orchestra.run.trial178.stdout: auth service ticket ttl = 240 # 4m 2026-02-13T02:30:35.874 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.874 INFO:teuthology.orchestra.run.trial178.stdout: # don't complain about insecure global_id in the test suite 2026-02-13T02:30:35.874 INFO:teuthology.orchestra.run.trial178.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-13T02:30:35.874 INFO:teuthology.orchestra.run.trial178.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-13T02:30:35.874 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.874 INFO:teuthology.orchestra.run.trial178.stdout: # 1m isn't quite enough 2026-02-13T02:30:35.874 INFO:teuthology.orchestra.run.trial178.stdout: mon_down_mkfs_grace = 2m 2026-02-13T02:30:35.874 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.874 INFO:teuthology.orchestra.run.trial178.stdout: mon_warn_on_filestore_osds = false 2026-02-13T02:30:35.874 INFO:teuthology.orchestra.run.trial178.stdout: mon down mkfs grace = 300 2026-02-13T02:30:35.874 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-13T02:30:35.875 INFO:teuthology.orchestra.run.trial178.stdout:[client] 2026-02-13T02:30:35.875 INFO:teuthology.orchestra.run.trial178.stdout: rgw cache enabled = true 2026-02-13T02:30:35.875 INFO:teuthology.orchestra.run.trial178.stdout: rgw enable ops log = true 2026-02-13T02:30:35.875 INFO:teuthology.orchestra.run.trial178.stdout: rgw enable usage log = true 2026-02-13T02:30:35.875 INFO:teuthology.orchestra.run.trial178.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-13T02:30:35.875 INFO:teuthology.orchestra.run.trial178.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-13T02:30:35.875 INFO:teuthology.orchestra.run.trial178.stdout: pid file = "" 2026-02-13T02:30:35.875 INFO:teuthology.orchestra.run.trial178.stdout:[mon.a] 2026-02-13T02:30:35.875 INFO:teuthology.orchestra.run.trial178.stdout:[mon.b] 2026-02-13T02:30:35.875 INFO:teuthology.orchestra.run.trial178.stdout:[mon.c] 2026-02-13T02:30:35.876 INFO:teuthology.orchestra.run.trial178.stdout:[mds.a] 2026-02-13T02:30:35.876 INFO:teuthology.orchestra.run.trial178.stdout:[mds.c] 2026-02-13T02:30:35.876 INFO:teuthology.orchestra.run.trial178.stdout:[mds.b] 2026-02-13T02:30:35.876 INFO:teuthology.orchestra.run.trial178.stdout:[mds.d] 2026-02-13T02:30:35.876 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-13T02:30:35.876 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-13T02:30:35.928 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-13T02:30:35.928 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:30:35.928 DEBUG:teuthology.orchestra.run.trial121:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-13T02:30:35.974 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:30:35.974 DEBUG:teuthology.orchestra.run.trial121:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-13T02:30:36.022 INFO:tasks.ceph:Sending monmap to node ubuntu@trial121.front.sepia.ceph.com 2026-02-13T02:30:36.022 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:30:36.022 DEBUG:teuthology.orchestra.run.trial121:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-13T02:30:36.022 DEBUG:teuthology.orchestra.run.trial121:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-13T02:30:36.079 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:30:36.079 DEBUG:teuthology.orchestra.run.trial121:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-13T02:30:36.126 INFO:tasks.ceph:Sending monmap to node ubuntu@trial178.front.sepia.ceph.com 2026-02-13T02:30:36.126 DEBUG:teuthology.orchestra.run.trial178:> set -ex 2026-02-13T02:30:36.126 DEBUG:teuthology.orchestra.run.trial178:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-13T02:30:36.127 DEBUG:teuthology.orchestra.run.trial178:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-13T02:30:36.142 DEBUG:teuthology.orchestra.run.trial178:> set -ex 2026-02-13T02:30:36.143 DEBUG:teuthology.orchestra.run.trial178:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-13T02:30:36.189 INFO:tasks.ceph:Setting up mon nodes... 2026-02-13T02:30:36.189 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-13T02:30:36.190 DEBUG:teuthology.orchestra.run.trial121:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2026-02-13T02:30:36.212 INFO:teuthology.orchestra.run.trial121.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2026-02-13T02:30:36.214 DEBUG:teuthology.orchestra.run.trial178:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-13T02:30:36.255 INFO:teuthology.orchestra.run.trial178.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-13T02:30:36.258 INFO:tasks.ceph:Setting up mds nodes... 2026-02-13T02:30:36.258 DEBUG:teuthology.orchestra.run.trial121:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2026-02-13T02:30:36.281 INFO:teuthology.orchestra.run.trial121.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2026-02-13T02:30:36.283 DEBUG:teuthology.orchestra.run.trial121:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2026-02-13T02:30:36.334 DEBUG:teuthology.orchestra.run.trial121:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2026-02-13T02:30:36.399 INFO:teuthology.orchestra.run.trial121.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2026-02-13T02:30:36.401 DEBUG:teuthology.orchestra.run.trial121:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2026-02-13T02:30:36.450 DEBUG:teuthology.orchestra.run.trial178:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2026-02-13T02:30:36.475 INFO:teuthology.orchestra.run.trial178.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2026-02-13T02:30:36.478 DEBUG:teuthology.orchestra.run.trial178:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2026-02-13T02:30:36.529 DEBUG:teuthology.orchestra.run.trial178:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2026-02-13T02:30:36.598 INFO:teuthology.orchestra.run.trial178.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2026-02-13T02:30:36.601 DEBUG:teuthology.orchestra.run.trial178:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2026-02-13T02:30:36.649 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-13T02:30:36.649 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-13T02:30:36.667 INFO:teuthology.orchestra.run.trial121.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-13T02:30:36.674 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2026-02-13T02:30:36.734 INFO:teuthology.orchestra.run.trial121.stdout:creating /etc/ceph/ceph.client.2.keyring 2026-02-13T02:30:36.741 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-13T02:30:36.758 INFO:teuthology.orchestra.run.trial178.stdout:creating /etc/ceph/ceph.client.1.keyring 2026-02-13T02:30:36.766 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2026-02-13T02:30:36.826 INFO:teuthology.orchestra.run.trial178.stdout:creating /etc/ceph/ceph.client.3.keyring 2026-02-13T02:30:36.833 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-13T02:30:36.833 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial121.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial178.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2026-02-13T02:30:36.833 DEBUG:teuthology.orchestra.run.trial121:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-13T02:30:36.843 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-13T02:30:36.843 INFO:tasks.ceph:role: osd.0 2026-02-13T02:30:36.843 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial121.front.sepia.ceph.com 2026-02-13T02:30:36.843 DEBUG:teuthology.orchestra.run.trial121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-13T02:30:36.895 INFO:teuthology.orchestra.run.trial121.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T02:30:36.895 INFO:teuthology.orchestra.run.trial121.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T02:30:36.895 INFO:teuthology.orchestra.run.trial121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T02:30:36.895 INFO:teuthology.orchestra.run.trial121.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-13T02:30:36.895 INFO:teuthology.orchestra.run.trial121.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T02:30:36.895 INFO:teuthology.orchestra.run.trial121.stdout: = sunit=0 swidth=0 blks 2026-02-13T02:30:36.895 INFO:teuthology.orchestra.run.trial121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T02:30:36.896 INFO:teuthology.orchestra.run.trial121.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T02:30:36.896 INFO:teuthology.orchestra.run.trial121.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T02:30:36.896 INFO:teuthology.orchestra.run.trial121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T02:30:37.473 INFO:teuthology.orchestra.run.trial121.stdout:Discarding blocks...Done. 2026-02-13T02:30:37.474 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial121.front.sepia.ceph.com -o noatime 2026-02-13T02:30:37.475 DEBUG:teuthology.orchestra.run.trial121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-13T02:30:37.530 DEBUG:teuthology.orchestra.run.trial121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-13T02:30:37.580 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:30:37.580 INFO:teuthology.orchestra.run.trial121.stderr:sudo: /sbin/restorecon: command not found 2026-02-13T02:30:37.581 DEBUG:teuthology.orchestra.run.trial121:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-13T02:30:37.634 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-13T02:30:37.634 INFO:tasks.ceph:role: osd.1 2026-02-13T02:30:37.634 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial121.front.sepia.ceph.com 2026-02-13T02:30:37.634 DEBUG:teuthology.orchestra.run.trial121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-13T02:30:37.684 INFO:teuthology.orchestra.run.trial121.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T02:30:37.684 INFO:teuthology.orchestra.run.trial121.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T02:30:37.684 INFO:teuthology.orchestra.run.trial121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T02:30:37.684 INFO:teuthology.orchestra.run.trial121.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-13T02:30:37.684 INFO:teuthology.orchestra.run.trial121.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T02:30:37.684 INFO:teuthology.orchestra.run.trial121.stdout: = sunit=0 swidth=0 blks 2026-02-13T02:30:37.684 INFO:teuthology.orchestra.run.trial121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T02:30:37.684 INFO:teuthology.orchestra.run.trial121.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T02:30:37.685 INFO:teuthology.orchestra.run.trial121.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T02:30:37.685 INFO:teuthology.orchestra.run.trial121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T02:30:38.248 INFO:teuthology.orchestra.run.trial121.stdout:Discarding blocks...Done. 2026-02-13T02:30:38.250 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial121.front.sepia.ceph.com -o noatime 2026-02-13T02:30:38.250 DEBUG:teuthology.orchestra.run.trial121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-13T02:30:38.303 DEBUG:teuthology.orchestra.run.trial121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-13T02:30:38.351 INFO:teuthology.orchestra.run.trial121.stderr:sudo: /sbin/restorecon: command not found 2026-02-13T02:30:38.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:30:38.353 DEBUG:teuthology.orchestra.run.trial121:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-13T02:30:38.402 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-13T02:30:38.402 INFO:tasks.ceph:role: osd.2 2026-02-13T02:30:38.402 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial121.front.sepia.ceph.com 2026-02-13T02:30:38.402 DEBUG:teuthology.orchestra.run.trial121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-13T02:30:38.455 INFO:teuthology.orchestra.run.trial121.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T02:30:38.456 INFO:teuthology.orchestra.run.trial121.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T02:30:38.456 INFO:teuthology.orchestra.run.trial121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T02:30:38.456 INFO:teuthology.orchestra.run.trial121.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-13T02:30:38.456 INFO:teuthology.orchestra.run.trial121.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T02:30:38.456 INFO:teuthology.orchestra.run.trial121.stdout: = sunit=0 swidth=0 blks 2026-02-13T02:30:38.456 INFO:teuthology.orchestra.run.trial121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T02:30:38.456 INFO:teuthology.orchestra.run.trial121.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T02:30:38.456 INFO:teuthology.orchestra.run.trial121.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T02:30:38.456 INFO:teuthology.orchestra.run.trial121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T02:30:39.018 INFO:teuthology.orchestra.run.trial121.stdout:Discarding blocks...Done. 2026-02-13T02:30:39.020 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial121.front.sepia.ceph.com -o noatime 2026-02-13T02:30:39.020 DEBUG:teuthology.orchestra.run.trial121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-13T02:30:39.079 DEBUG:teuthology.orchestra.run.trial121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-13T02:30:39.128 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:30:39.128 INFO:teuthology.orchestra.run.trial121.stderr:sudo: /sbin/restorecon: command not found 2026-02-13T02:30:39.129 DEBUG:teuthology.orchestra.run.trial121:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-13T02:30:39.182 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-13T02:30:39.182 INFO:tasks.ceph:role: osd.3 2026-02-13T02:30:39.182 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial121.front.sepia.ceph.com 2026-02-13T02:30:39.182 DEBUG:teuthology.orchestra.run.trial121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-13T02:30:39.231 INFO:teuthology.orchestra.run.trial121.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T02:30:39.232 INFO:teuthology.orchestra.run.trial121.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T02:30:39.232 INFO:teuthology.orchestra.run.trial121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T02:30:39.232 INFO:teuthology.orchestra.run.trial121.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-13T02:30:39.232 INFO:teuthology.orchestra.run.trial121.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T02:30:39.232 INFO:teuthology.orchestra.run.trial121.stdout: = sunit=0 swidth=0 blks 2026-02-13T02:30:39.232 INFO:teuthology.orchestra.run.trial121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T02:30:39.232 INFO:teuthology.orchestra.run.trial121.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T02:30:39.232 INFO:teuthology.orchestra.run.trial121.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T02:30:39.232 INFO:teuthology.orchestra.run.trial121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T02:30:39.793 INFO:teuthology.orchestra.run.trial121.stdout:Discarding blocks...Done. 2026-02-13T02:30:39.795 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial121.front.sepia.ceph.com -o noatime 2026-02-13T02:30:39.795 DEBUG:teuthology.orchestra.run.trial121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2026-02-13T02:30:39.851 DEBUG:teuthology.orchestra.run.trial121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-13T02:30:39.899 INFO:teuthology.orchestra.run.trial121.stderr:sudo: /sbin/restorecon: command not found 2026-02-13T02:30:39.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:30:39.901 DEBUG:teuthology.orchestra.run.trial121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T02:30:39.963 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:39.956+0000 7fa7e3c6ba40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-13T02:30:39.964 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:39.956+0000 7fa7e3c6ba40 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-13T02:30:39.964 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:39.956+0000 7fa7e3c6ba40 -1 bdev(0x5592784b5800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-13T02:30:39.965 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:39.956+0000 7fa7e3c6ba40 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-13T02:30:40.819 DEBUG:teuthology.orchestra.run.trial121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-13T02:30:40.871 DEBUG:teuthology.orchestra.run.trial121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T02:30:40.935 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:40.928+0000 7f24d1c10a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-13T02:30:40.935 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:40.928+0000 7f24d1c10a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-13T02:30:40.936 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:40.928+0000 7f24d1c10a40 -1 bdev(0x55bf6fb61800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-13T02:30:40.936 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:40.928+0000 7f24d1c10a40 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-13T02:30:41.827 DEBUG:teuthology.orchestra.run.trial121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-13T02:30:41.878 DEBUG:teuthology.orchestra.run.trial121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T02:30:41.943 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:41.936+0000 7f1afca36a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-13T02:30:41.944 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:41.936+0000 7f1afca36a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-13T02:30:41.944 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:41.936+0000 7f1afca36a40 -1 bdev(0x55ab7fb1b800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-13T02:30:41.944 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:41.936+0000 7f1afca36a40 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-13T02:30:42.920 DEBUG:teuthology.orchestra.run.trial121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-13T02:30:42.971 DEBUG:teuthology.orchestra.run.trial121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T02:30:43.035 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:43.028+0000 7f206e0f6a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-13T02:30:43.036 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:43.028+0000 7f206e0f6a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-13T02:30:43.036 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:43.028+0000 7f206e0f6a40 -1 bdev(0x5645a42d9800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-13T02:30:43.036 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:43.028+0000 7f206e0f6a40 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-13T02:30:43.884 DEBUG:teuthology.orchestra.run.trial121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-13T02:30:43.935 DEBUG:teuthology.orchestra.run.trial178:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-13T02:30:43.945 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2026-02-13T02:30:43.945 INFO:tasks.ceph:role: osd.4 2026-02-13T02:30:43.945 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial178.front.sepia.ceph.com 2026-02-13T02:30:43.945 DEBUG:teuthology.orchestra.run.trial178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-13T02:30:43.999 INFO:teuthology.orchestra.run.trial178.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T02:30:43.999 INFO:teuthology.orchestra.run.trial178.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T02:30:43.999 INFO:teuthology.orchestra.run.trial178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T02:30:43.999 INFO:teuthology.orchestra.run.trial178.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-13T02:30:43.999 INFO:teuthology.orchestra.run.trial178.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T02:30:43.999 INFO:teuthology.orchestra.run.trial178.stdout: = sunit=0 swidth=0 blks 2026-02-13T02:30:43.999 INFO:teuthology.orchestra.run.trial178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T02:30:43.999 INFO:teuthology.orchestra.run.trial178.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T02:30:44.000 INFO:teuthology.orchestra.run.trial178.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T02:30:44.000 INFO:teuthology.orchestra.run.trial178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T02:30:44.574 INFO:teuthology.orchestra.run.trial178.stdout:Discarding blocks...Done. 2026-02-13T02:30:44.576 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial178.front.sepia.ceph.com -o noatime 2026-02-13T02:30:44.576 DEBUG:teuthology.orchestra.run.trial178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2026-02-13T02:30:44.634 DEBUG:teuthology.orchestra.run.trial178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-13T02:30:44.683 INFO:teuthology.orchestra.run.trial178.stderr:sudo: /sbin/restorecon: command not found 2026-02-13T02:30:44.683 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:30:44.684 DEBUG:teuthology.orchestra.run.trial178:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-13T02:30:44.733 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2026-02-13T02:30:44.733 INFO:tasks.ceph:role: osd.5 2026-02-13T02:30:44.733 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial178.front.sepia.ceph.com 2026-02-13T02:30:44.734 DEBUG:teuthology.orchestra.run.trial178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-13T02:30:44.787 INFO:teuthology.orchestra.run.trial178.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T02:30:44.788 INFO:teuthology.orchestra.run.trial178.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T02:30:44.788 INFO:teuthology.orchestra.run.trial178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T02:30:44.788 INFO:teuthology.orchestra.run.trial178.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-13T02:30:44.788 INFO:teuthology.orchestra.run.trial178.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T02:30:44.788 INFO:teuthology.orchestra.run.trial178.stdout: = sunit=0 swidth=0 blks 2026-02-13T02:30:44.788 INFO:teuthology.orchestra.run.trial178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T02:30:44.788 INFO:teuthology.orchestra.run.trial178.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T02:30:44.788 INFO:teuthology.orchestra.run.trial178.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T02:30:44.788 INFO:teuthology.orchestra.run.trial178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T02:30:45.351 INFO:teuthology.orchestra.run.trial178.stdout:Discarding blocks...Done. 2026-02-13T02:30:45.352 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial178.front.sepia.ceph.com -o noatime 2026-02-13T02:30:45.353 DEBUG:teuthology.orchestra.run.trial178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2026-02-13T02:30:45.405 DEBUG:teuthology.orchestra.run.trial178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-13T02:30:45.455 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:30:45.455 INFO:teuthology.orchestra.run.trial178.stderr:sudo: /sbin/restorecon: command not found 2026-02-13T02:30:45.456 DEBUG:teuthology.orchestra.run.trial178:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2026-02-13T02:30:45.505 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2026-02-13T02:30:45.505 INFO:tasks.ceph:role: osd.6 2026-02-13T02:30:45.505 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial178.front.sepia.ceph.com 2026-02-13T02:30:45.506 DEBUG:teuthology.orchestra.run.trial178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-13T02:30:45.558 INFO:teuthology.orchestra.run.trial178.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T02:30:45.558 INFO:teuthology.orchestra.run.trial178.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T02:30:45.558 INFO:teuthology.orchestra.run.trial178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T02:30:45.559 INFO:teuthology.orchestra.run.trial178.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-13T02:30:45.559 INFO:teuthology.orchestra.run.trial178.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T02:30:45.559 INFO:teuthology.orchestra.run.trial178.stdout: = sunit=0 swidth=0 blks 2026-02-13T02:30:45.559 INFO:teuthology.orchestra.run.trial178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T02:30:45.559 INFO:teuthology.orchestra.run.trial178.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T02:30:45.559 INFO:teuthology.orchestra.run.trial178.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T02:30:45.559 INFO:teuthology.orchestra.run.trial178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T02:30:46.123 INFO:teuthology.orchestra.run.trial178.stdout:Discarding blocks...Done. 2026-02-13T02:30:46.125 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial178.front.sepia.ceph.com -o noatime 2026-02-13T02:30:46.125 DEBUG:teuthology.orchestra.run.trial178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2026-02-13T02:30:46.182 DEBUG:teuthology.orchestra.run.trial178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2026-02-13T02:30:46.230 INFO:teuthology.orchestra.run.trial178.stderr:sudo: /sbin/restorecon: command not found 2026-02-13T02:30:46.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:30:46.232 DEBUG:teuthology.orchestra.run.trial178:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2026-02-13T02:30:46.281 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2026-02-13T02:30:46.281 INFO:tasks.ceph:role: osd.7 2026-02-13T02:30:46.281 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial178.front.sepia.ceph.com 2026-02-13T02:30:46.282 DEBUG:teuthology.orchestra.run.trial178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-13T02:30:46.334 INFO:teuthology.orchestra.run.trial178.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T02:30:46.335 INFO:teuthology.orchestra.run.trial178.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T02:30:46.335 INFO:teuthology.orchestra.run.trial178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T02:30:46.335 INFO:teuthology.orchestra.run.trial178.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-13T02:30:46.335 INFO:teuthology.orchestra.run.trial178.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T02:30:46.335 INFO:teuthology.orchestra.run.trial178.stdout: = sunit=0 swidth=0 blks 2026-02-13T02:30:46.335 INFO:teuthology.orchestra.run.trial178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T02:30:46.335 INFO:teuthology.orchestra.run.trial178.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T02:30:46.335 INFO:teuthology.orchestra.run.trial178.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T02:30:46.335 INFO:teuthology.orchestra.run.trial178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T02:30:46.897 INFO:teuthology.orchestra.run.trial178.stdout:Discarding blocks...Done. 2026-02-13T02:30:46.899 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial178.front.sepia.ceph.com -o noatime 2026-02-13T02:30:46.900 DEBUG:teuthology.orchestra.run.trial178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2026-02-13T02:30:46.954 DEBUG:teuthology.orchestra.run.trial178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2026-02-13T02:30:47.003 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:30:47.003 INFO:teuthology.orchestra.run.trial178.stderr:sudo: /sbin/restorecon: command not found 2026-02-13T02:30:47.004 DEBUG:teuthology.orchestra.run.trial178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T02:30:47.067 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:30:47.059+0000 7f3b4d15aa40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-13T02:30:47.068 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:30:47.059+0000 7f3b4d15aa40 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-13T02:30:47.068 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:30:47.059+0000 7f3b4d15aa40 -1 bdev(0x564fecbd1800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-13T02:30:47.068 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:30:47.059+0000 7f3b4d15aa40 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-13T02:30:47.979 DEBUG:teuthology.orchestra.run.trial178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-13T02:30:48.030 DEBUG:teuthology.orchestra.run.trial178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T02:30:48.094 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:30:48.087+0000 7f487db0ea40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-13T02:30:48.095 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:30:48.087+0000 7f487db0ea40 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-13T02:30:48.095 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:30:48.087+0000 7f487db0ea40 -1 bdev(0x55cce1df1800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-13T02:30:48.095 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:30:48.087+0000 7f487db0ea40 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-13T02:30:48.969 DEBUG:teuthology.orchestra.run.trial178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-13T02:30:49.018 DEBUG:teuthology.orchestra.run.trial178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T02:30:49.082 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:30:49.075+0000 7fe8e7c95a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2026-02-13T02:30:49.083 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:30:49.075+0000 7fe8e7c95a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2026-02-13T02:30:49.083 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:30:49.075+0000 7fe8e7c95a40 -1 bdev(0x55942e437800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2026-02-13T02:30:49.083 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:30:49.075+0000 7fe8e7c95a40 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2026-02-13T02:30:49.959 DEBUG:teuthology.orchestra.run.trial178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2026-02-13T02:30:50.010 DEBUG:teuthology.orchestra.run.trial178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T02:30:50.074 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:30:50.067+0000 7fe4f96f9a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2026-02-13T02:30:50.075 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:30:50.067+0000 7fe4f96f9a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2026-02-13T02:30:50.075 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:30:50.067+0000 7fe4f96f9a40 -1 bdev(0x55c93806f800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2026-02-13T02:30:50.075 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:30:50.067+0000 7fe4f96f9a40 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2026-02-13T02:30:50.949 DEBUG:teuthology.orchestra.run.trial178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2026-02-13T02:30:50.998 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-13T02:30:50.998 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:30:50.998 DEBUG:teuthology.orchestra.run.trial121:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2026-02-13T02:30:51.010 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:30:51.011 DEBUG:teuthology.orchestra.run.trial121:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2026-02-13T02:30:51.063 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:30:51.063 DEBUG:teuthology.orchestra.run.trial121:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2026-02-13T02:30:51.115 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:30:51.115 DEBUG:teuthology.orchestra.run.trial121:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-13T02:30:51.167 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:30:51.167 DEBUG:teuthology.orchestra.run.trial121:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-13T02:30:51.219 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:30:51.219 DEBUG:teuthology.orchestra.run.trial121:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-13T02:30:51.271 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:30:51.271 DEBUG:teuthology.orchestra.run.trial121:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-13T02:30:51.322 DEBUG:teuthology.orchestra.run.trial178:> set -ex 2026-02-13T02:30:51.322 DEBUG:teuthology.orchestra.run.trial178:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-13T02:30:51.334 DEBUG:teuthology.orchestra.run.trial178:> set -ex 2026-02-13T02:30:51.334 DEBUG:teuthology.orchestra.run.trial178:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2026-02-13T02:30:51.386 DEBUG:teuthology.orchestra.run.trial178:> set -ex 2026-02-13T02:30:51.386 DEBUG:teuthology.orchestra.run.trial178:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2026-02-13T02:30:51.438 DEBUG:teuthology.orchestra.run.trial178:> set -ex 2026-02-13T02:30:51.438 DEBUG:teuthology.orchestra.run.trial178:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-13T02:30:51.490 DEBUG:teuthology.orchestra.run.trial178:> set -ex 2026-02-13T02:30:51.490 DEBUG:teuthology.orchestra.run.trial178:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-13T02:30:51.542 DEBUG:teuthology.orchestra.run.trial178:> set -ex 2026-02-13T02:30:51.542 DEBUG:teuthology.orchestra.run.trial178:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2026-02-13T02:30:51.593 DEBUG:teuthology.orchestra.run.trial178:> set -ex 2026-02-13T02:30:51.593 DEBUG:teuthology.orchestra.run.trial178:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2026-02-13T02:30:51.642 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:30:51.642 DEBUG:teuthology.orchestra.run.trial121:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-13T02:30:51.648 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:30:51.648 DEBUG:teuthology.orchestra.run.trial121:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2026-02-13T02:30:51.694 DEBUG:teuthology.orchestra.run.trial178:> set -ex 2026-02-13T02:30:51.694 DEBUG:teuthology.orchestra.run.trial178:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2026-02-13T02:30:51.699 DEBUG:teuthology.orchestra.run.trial178:> set -ex 2026-02-13T02:30:51.699 DEBUG:teuthology.orchestra.run.trial178:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2026-02-13T02:30:51.745 INFO:tasks.ceph:Adding keys to all mons... 2026-02-13T02:30:51.745 DEBUG:teuthology.orchestra.run.trial121:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-13T02:30:51.747 DEBUG:teuthology.orchestra.run.trial178:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-13T02:30:51.787 INFO:teuthology.orchestra.run.trial121.stdout:[mgr.y] 2026-02-13T02:30:51.787 INFO:teuthology.orchestra.run.trial121.stdout: key = AQDMjI5pHlhrDBAASbObfeAmtjKnIyiU29I/MA== 2026-02-13T02:30:51.788 INFO:teuthology.orchestra.run.trial121.stdout:[mds.a] 2026-02-13T02:30:51.788 INFO:teuthology.orchestra.run.trial121.stdout: key = AQDMjI5pt06MEBAA31wyEku06MCRVIroRfHvdA== 2026-02-13T02:30:51.788 INFO:teuthology.orchestra.run.trial121.stdout:[mds.c] 2026-02-13T02:30:51.788 INFO:teuthology.orchestra.run.trial121.stdout: key = AQDMjI5pB4iWFxAAP6UXNX6Uyi0XdIM//O7i7Q== 2026-02-13T02:30:51.788 INFO:teuthology.orchestra.run.trial121.stdout:[osd.0] 2026-02-13T02:30:51.788 INFO:teuthology.orchestra.run.trial121.stdout: key = AQDPjI5pVzg4ORAAOtK9MDB7/KIj2p8G18lD6g== 2026-02-13T02:30:51.788 INFO:teuthology.orchestra.run.trial121.stdout:[osd.1] 2026-02-13T02:30:51.788 INFO:teuthology.orchestra.run.trial121.stdout: key = AQDQjI5pJB2CNxAA+4WrtoRbYQBBiE349rSnTA== 2026-02-13T02:30:51.788 INFO:teuthology.orchestra.run.trial121.stdout:[osd.2] 2026-02-13T02:30:51.788 INFO:teuthology.orchestra.run.trial121.stdout: key = AQDRjI5pqHj+NxAABgJlBptY/QYZkS8RJ4KWlA== 2026-02-13T02:30:51.788 INFO:teuthology.orchestra.run.trial121.stdout:[osd.3] 2026-02-13T02:30:51.789 INFO:teuthology.orchestra.run.trial121.stdout: key = AQDTjI5pYw3iARAAoxg3n2WLXZTL65BL/3RBww== 2026-02-13T02:30:51.789 INFO:teuthology.orchestra.run.trial121.stdout:[mgr.x] 2026-02-13T02:30:51.789 INFO:teuthology.orchestra.run.trial121.stdout: key = AQDMjI5pW0EWDxAAXd33/Lc2BX4620FSwbAIuA== 2026-02-13T02:30:51.789 INFO:teuthology.orchestra.run.trial121.stdout:[mds.b] 2026-02-13T02:30:51.789 INFO:teuthology.orchestra.run.trial121.stdout: key = AQDMjI5p+tU4HBAA20Te3hA3YXcKH0dgxigQPA== 2026-02-13T02:30:51.789 INFO:teuthology.orchestra.run.trial121.stdout:[mds.d] 2026-02-13T02:30:51.789 INFO:teuthology.orchestra.run.trial121.stdout: key = AQDMjI5pziqMIxAA1D6OZ01p43UYlh0y4LbdkQ== 2026-02-13T02:30:51.789 INFO:teuthology.orchestra.run.trial121.stdout:[osd.4] 2026-02-13T02:30:51.789 INFO:teuthology.orchestra.run.trial121.stdout: key = AQDXjI5pF6rdAxAA9yoPz3oy8JQug9QcTlo77w== 2026-02-13T02:30:51.789 INFO:teuthology.orchestra.run.trial121.stdout:[osd.5] 2026-02-13T02:30:51.789 INFO:teuthology.orchestra.run.trial121.stdout: key = AQDYjI5pZL57BRAAw1Vnx5eJ6jbpAUUWh94C1Q== 2026-02-13T02:30:51.789 INFO:teuthology.orchestra.run.trial121.stdout:[osd.6] 2026-02-13T02:30:51.790 INFO:teuthology.orchestra.run.trial121.stdout: key = AQDZjI5piebEBBAAjvTWL9FX+IcMGOMrDH1oHw== 2026-02-13T02:30:51.790 INFO:teuthology.orchestra.run.trial121.stdout:[osd.7] 2026-02-13T02:30:51.790 INFO:teuthology.orchestra.run.trial121.stdout: key = AQDajI5pjRBGBBAAxTunbJ5hSx+8WF4ruoXCjg== 2026-02-13T02:30:51.790 INFO:teuthology.orchestra.run.trial121.stdout:[client.0] 2026-02-13T02:30:51.790 INFO:teuthology.orchestra.run.trial121.stdout: key = AQDMjI5pFvaNJxAASvaOE9/vv7cw554mqboz6g== 2026-02-13T02:30:51.790 INFO:teuthology.orchestra.run.trial121.stdout:[client.2] 2026-02-13T02:30:51.790 INFO:teuthology.orchestra.run.trial121.stdout: key = AQDMjI5p0PuKKxAAHUvdaxt2Q+Ol2fjofUZRbw== 2026-02-13T02:30:51.790 INFO:teuthology.orchestra.run.trial121.stdout:[client.1] 2026-02-13T02:30:51.790 INFO:teuthology.orchestra.run.trial121.stdout: key = AQDMjI5pz1IVLRAA3bAGNeHnUrK55uo1upUg8A== 2026-02-13T02:30:51.790 INFO:teuthology.orchestra.run.trial121.stdout:[client.3] 2026-02-13T02:30:51.790 INFO:teuthology.orchestra.run.trial121.stdout: key = AQDMjI5pL8cbMRAAW7idiGhNyCI5GGJORFyyRw== 2026-02-13T02:30:51.792 INFO:teuthology.orchestra.run.trial178.stdout:[mgr.y] 2026-02-13T02:30:51.792 INFO:teuthology.orchestra.run.trial178.stdout: key = AQDMjI5pHlhrDBAASbObfeAmtjKnIyiU29I/MA== 2026-02-13T02:30:51.792 INFO:teuthology.orchestra.run.trial178.stdout:[mds.a] 2026-02-13T02:30:51.792 INFO:teuthology.orchestra.run.trial178.stdout: key = AQDMjI5pt06MEBAA31wyEku06MCRVIroRfHvdA== 2026-02-13T02:30:51.792 INFO:teuthology.orchestra.run.trial178.stdout:[mds.c] 2026-02-13T02:30:51.792 INFO:teuthology.orchestra.run.trial178.stdout: key = AQDMjI5pB4iWFxAAP6UXNX6Uyi0XdIM//O7i7Q== 2026-02-13T02:30:51.792 INFO:teuthology.orchestra.run.trial178.stdout:[osd.0] 2026-02-13T02:30:51.792 INFO:teuthology.orchestra.run.trial178.stdout: key = AQDPjI5pVzg4ORAAOtK9MDB7/KIj2p8G18lD6g== 2026-02-13T02:30:51.793 INFO:teuthology.orchestra.run.trial178.stdout:[osd.1] 2026-02-13T02:30:51.793 INFO:teuthology.orchestra.run.trial178.stdout: key = AQDQjI5pJB2CNxAA+4WrtoRbYQBBiE349rSnTA== 2026-02-13T02:30:51.793 INFO:teuthology.orchestra.run.trial178.stdout:[osd.2] 2026-02-13T02:30:51.793 INFO:teuthology.orchestra.run.trial178.stdout: key = AQDRjI5pqHj+NxAABgJlBptY/QYZkS8RJ4KWlA== 2026-02-13T02:30:51.793 INFO:teuthology.orchestra.run.trial178.stdout:[osd.3] 2026-02-13T02:30:51.793 INFO:teuthology.orchestra.run.trial178.stdout: key = AQDTjI5pYw3iARAAoxg3n2WLXZTL65BL/3RBww== 2026-02-13T02:30:51.793 INFO:teuthology.orchestra.run.trial178.stdout:[mgr.x] 2026-02-13T02:30:51.793 INFO:teuthology.orchestra.run.trial178.stdout: key = AQDMjI5pW0EWDxAAXd33/Lc2BX4620FSwbAIuA== 2026-02-13T02:30:51.793 INFO:teuthology.orchestra.run.trial178.stdout:[mds.b] 2026-02-13T02:30:51.793 INFO:teuthology.orchestra.run.trial178.stdout: key = AQDMjI5p+tU4HBAA20Te3hA3YXcKH0dgxigQPA== 2026-02-13T02:30:51.793 INFO:teuthology.orchestra.run.trial178.stdout:[mds.d] 2026-02-13T02:30:51.794 INFO:teuthology.orchestra.run.trial178.stdout: key = AQDMjI5pziqMIxAA1D6OZ01p43UYlh0y4LbdkQ== 2026-02-13T02:30:51.794 INFO:teuthology.orchestra.run.trial178.stdout:[osd.4] 2026-02-13T02:30:51.794 INFO:teuthology.orchestra.run.trial178.stdout: key = AQDXjI5pF6rdAxAA9yoPz3oy8JQug9QcTlo77w== 2026-02-13T02:30:51.794 INFO:teuthology.orchestra.run.trial178.stdout:[osd.5] 2026-02-13T02:30:51.794 INFO:teuthology.orchestra.run.trial178.stdout: key = AQDYjI5pZL57BRAAw1Vnx5eJ6jbpAUUWh94C1Q== 2026-02-13T02:30:51.794 INFO:teuthology.orchestra.run.trial178.stdout:[osd.6] 2026-02-13T02:30:51.794 INFO:teuthology.orchestra.run.trial178.stdout: key = AQDZjI5piebEBBAAjvTWL9FX+IcMGOMrDH1oHw== 2026-02-13T02:30:51.794 INFO:teuthology.orchestra.run.trial178.stdout:[osd.7] 2026-02-13T02:30:51.794 INFO:teuthology.orchestra.run.trial178.stdout: key = AQDajI5pjRBGBBAAxTunbJ5hSx+8WF4ruoXCjg== 2026-02-13T02:30:51.794 INFO:teuthology.orchestra.run.trial178.stdout:[client.0] 2026-02-13T02:30:51.794 INFO:teuthology.orchestra.run.trial178.stdout: key = AQDMjI5pFvaNJxAASvaOE9/vv7cw554mqboz6g== 2026-02-13T02:30:51.794 INFO:teuthology.orchestra.run.trial178.stdout:[client.2] 2026-02-13T02:30:51.795 INFO:teuthology.orchestra.run.trial178.stdout: key = AQDMjI5p0PuKKxAAHUvdaxt2Q+Ol2fjofUZRbw== 2026-02-13T02:30:51.795 INFO:teuthology.orchestra.run.trial178.stdout:[client.1] 2026-02-13T02:30:51.795 INFO:teuthology.orchestra.run.trial178.stdout: key = AQDMjI5pz1IVLRAA3bAGNeHnUrK55uo1upUg8A== 2026-02-13T02:30:51.795 INFO:teuthology.orchestra.run.trial178.stdout:[client.3] 2026-02-13T02:30:51.795 INFO:teuthology.orchestra.run.trial178.stdout: key = AQDMjI5pL8cbMRAAW7idiGhNyCI5GGJORFyyRw== 2026-02-13T02:30:51.796 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-13T02:30:51.840 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-13T02:30:51.863 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2026-02-13T02:30:51.907 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2026-02-13T02:30:51.931 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2026-02-13T02:30:51.975 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2026-02-13T02:30:52.000 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T02:30:52.039 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T02:30:52.062 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T02:30:52.103 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T02:30:52.126 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T02:30:52.167 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T02:30:52.190 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T02:30:52.231 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T02:30:52.253 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-13T02:30:52.295 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-13T02:30:52.318 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2026-02-13T02:30:52.359 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2026-02-13T02:30:52.383 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2026-02-13T02:30:52.423 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2026-02-13T02:30:52.447 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T02:30:52.487 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T02:30:52.510 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T02:30:52.551 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T02:30:52.574 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T02:30:52.616 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T02:30:52.638 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T02:30:52.679 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T02:30:52.703 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-13T02:30:52.743 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-13T02:30:52.767 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-13T02:30:52.807 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-13T02:30:52.831 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-13T02:30:52.872 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-13T02:30:52.894 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-13T02:30:52.935 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-13T02:30:52.958 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-13T02:30:52.958 DEBUG:teuthology.orchestra.run.trial121:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-13T02:30:53.006 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-13T02:30:53.075 DEBUG:teuthology.orchestra.run.trial121:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-13T02:30:53.126 DEBUG:teuthology.orchestra.run.trial178:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-13T02:30:53.135 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-13T02:30:53.207 DEBUG:teuthology.orchestra.run.trial178:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-13T02:30:53.257 DEBUG:teuthology.orchestra.run.trial178:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-13T02:30:53.309 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-13T02:30:53.379 DEBUG:teuthology.orchestra.run.trial178:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-13T02:30:53.429 DEBUG:teuthology.orchestra.run.trial121:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-13T02:30:53.431 DEBUG:teuthology.orchestra.run.trial178:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-13T02:30:53.473 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-13T02:30:53.473 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-13T02:30:53.473 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-13T02:30:53.475 INFO:tasks.ceph.mon.a:Started 2026-02-13T02:30:53.475 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-13T02:30:53.476 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-13T02:30:53.514 INFO:tasks.ceph.mon.b:Started 2026-02-13T02:30:53.514 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-13T02:30:53.515 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-13T02:30:53.516 INFO:tasks.ceph.mon.c:Started 2026-02-13T02:30:53.517 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-13T02:30:53.517 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-13T02:30:53.517 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2026-02-13T02:30:53.519 INFO:tasks.ceph.mgr.y:Started 2026-02-13T02:30:53.519 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-13T02:30:53.520 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-13T02:30:53.521 INFO:tasks.ceph.mgr.x:Started 2026-02-13T02:30:53.522 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2026-02-13T02:30:53.522 DEBUG:teuthology.orchestra.run.trial121:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2026-02-13T02:30:53.524 INFO:tasks.ceph:setting config [client] debug_client = 20 2026-02-13T02:30:53.524 DEBUG:teuthology.orchestra.run.trial121:> sudo ceph --cluster ceph config set client debug_client 20 2026-02-13T02:30:53.571 INFO:tasks.ceph:setting config [client] debug_ms = 1 2026-02-13T02:30:53.571 DEBUG:teuthology.orchestra.run.trial121:> sudo ceph --cluster ceph config set client debug_ms 1 2026-02-13T02:30:53.615 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2026-02-13T02:30:53.615 DEBUG:teuthology.orchestra.run.trial121:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2026-02-13T02:30:53.663 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2026-02-13T02:30:53.663 DEBUG:teuthology.orchestra.run.trial121:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2026-02-13T02:30:53.707 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2026-02-13T02:30:53.707 DEBUG:teuthology.orchestra.run.trial121:> sudo ceph --cluster ceph config set mds debug_mds 20 2026-02-13T02:30:53.751 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2026-02-13T02:30:53.751 DEBUG:teuthology.orchestra.run.trial121:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2026-02-13T02:30:53.795 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2026-02-13T02:30:53.795 DEBUG:teuthology.orchestra.run.trial121:> sudo ceph --cluster ceph config set mds debug_ms 2 2026-02-13T02:30:53.839 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2026-02-13T02:30:53.839 DEBUG:teuthology.orchestra.run.trial121:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2026-02-13T02:30:53.887 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2026-02-13T02:30:53.887 DEBUG:teuthology.orchestra.run.trial121:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2026-02-13T02:30:53.931 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2026-02-13T02:30:53.931 DEBUG:teuthology.orchestra.run.trial121:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2026-02-13T02:30:53.975 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2026-02-13T02:30:53.975 DEBUG:teuthology.orchestra.run.trial121:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2026-02-13T02:30:54.023 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2026-02-13T02:30:54.023 DEBUG:teuthology.orchestra.run.trial121:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2026-02-13T02:30:54.067 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2026-02-13T02:30:54.067 DEBUG:teuthology.orchestra.run.trial121:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2026-02-13T02:30:54.111 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2026-02-13T02:30:54.111 DEBUG:teuthology.orchestra.run.trial121:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2026-02-13T02:30:54.155 INFO:tasks.ceph:setting config [mgr] client_mount_timeout = 30 2026-02-13T02:30:54.155 DEBUG:teuthology.orchestra.run.trial121:> sudo ceph --cluster ceph config set mgr client_mount_timeout 30 2026-02-13T02:30:54.199 INFO:tasks.ceph:setting config [mgr] debug_client = 20 2026-02-13T02:30:54.199 DEBUG:teuthology.orchestra.run.trial121:> sudo ceph --cluster ceph config set mgr debug_client 20 2026-02-13T02:30:54.247 INFO:tasks.ceph:setting config [mgr] debug_mgr = 20 2026-02-13T02:30:54.247 DEBUG:teuthology.orchestra.run.trial121:> sudo ceph --cluster ceph config set mgr debug_mgr 20 2026-02-13T02:30:54.291 INFO:tasks.ceph:setting config [mgr] debug_ms = 1 2026-02-13T02:30:54.291 DEBUG:teuthology.orchestra.run.trial121:> sudo ceph --cluster ceph config set mgr debug_ms 1 2026-02-13T02:30:54.335 INFO:tasks.ceph:setting config [mgr] mon_warn_on_pool_no_app = False 2026-02-13T02:30:54.335 DEBUG:teuthology.orchestra.run.trial121:> sudo ceph --cluster ceph config set mgr mon_warn_on_pool_no_app False 2026-02-13T02:30:54.379 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2026-02-13T02:30:54.379 DEBUG:teuthology.orchestra.run.trial121:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2026-02-13T02:30:54.423 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2026-02-13T02:30:54.423 DEBUG:teuthology.orchestra.run.trial121:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2026-02-13T02:30:54.467 DEBUG:tasks.ceph:set 22 configs 2026-02-13T02:30:54.467 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='trial121') 2026-02-13T02:30:59.582 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:30:59.572+0000 7f2020227280 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T02:30:59.584 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:30:59.575+0000 7f89213dd280 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T02:30:59.622 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:30:59.612+0000 7f2020227280 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T02:30:59.624 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:30:59.616+0000 7f2020227280 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T02:30:59.631 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='trial121') 2026-02-13T02:30:59.637 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:30:59.628+0000 7f2020227280 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T02:30:59.637 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:30:59.627+0000 7f89213dd280 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T02:30:59.639 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:30:59.631+0000 7f89213dd280 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T02:30:59.651 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:30:59.643+0000 7f89213dd280 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T02:30:59.679 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='trial121') 2026-02-13T02:30:59.689 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:30:59.680+0000 7f2020227280 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T02:30:59.702 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:30:59.695+0000 7f89213dd280 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T02:30:59.710 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.700+0000 7fb0c4734640 1 -- 10.20.193.121:0/2732080177 shutdown_connections 2026-02-13T02:30:59.710 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.700+0000 7fb0c4734640 1 --2- 10.20.193.121:0/2732080177 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fb09c026820 0x7fb0bc145df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:30:59.711 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.700+0000 7fb0c4734640 1 --2- 10.20.193.121:0/2732080177 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fb09c025de0 0x7fb0bc140e20 unknown :-1 s=CLOSED pgs=55 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:30:59.711 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.700+0000 7fb0c4734640 1 --2- 10.20.193.121:0/2732080177 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fb09c003c10 0x7fb0bc13e900 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:30:59.711 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.700+0000 7fb0c4734640 1 -- 10.20.193.121:0/2732080177 >> 10.20.193.121:0/2732080177 conn(0x7fb0bc057b80 msgr2=0x7fb0bc0b9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:30:59.711 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.700+0000 7fb0c4734640 1 -- 10.20.193.121:0/2732080177 shutdown_connections 2026-02-13T02:30:59.711 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.700+0000 7fb0c4734640 1 -- 10.20.193.121:0/2732080177 wait complete. 2026-02-13T02:30:59.720 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial121') 2026-02-13T02:30:59.723 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.712+0000 7f5332aa6640 1 -- 10.20.193.121:0/2076209159 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f5310003c20 msgr2=0x7f5310024740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:30:59.723 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.712+0000 7f5332aa6640 1 --2- 10.20.193.121:0/2076209159 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f5310003c20 0x7f5310024740 secure :-1 s=READY pgs=57 gs=29 cs=0 l=1 c_cookie=8505587585539403112 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f531c004780 tx=0x7f531c01e170 comp rx=0 tx=0).stop 2026-02-13T02:30:59.723 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f5332aa6640 1 -- 10.20.193.121:0/2076209159 shutdown_connections 2026-02-13T02:30:59.723 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f5332aa6640 1 --2- 10.20.193.121:0/2076209159 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f5310003c20 0x7f5310024740 unknown :-1 s=CLOSED pgs=57 gs=29 cs=0 l=1 c_cookie=8505587585539403112 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:30:59.723 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f5332aa6640 1 -- 10.20.193.121:0/2076209159 >> 10.20.193.121:0/2076209159 conn(0x7f532c057b80 msgr2=0x7f532c09ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:30:59.723 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f5332aa6640 1 -- 10.20.193.121:0/2076209159 shutdown_connections 2026-02-13T02:30:59.723 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f5332aa6640 1 -- 10.20.193.121:0/2076209159 wait complete. 2026-02-13T02:30:59.724 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f5332aa6640 1 Processor -- start 2026-02-13T02:30:59.724 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f5332aa6640 1 -- start start 2026-02-13T02:30:59.727 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f5332aa6640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f5310003c20 0x7f532c1467e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:30:59.727 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f5332aa6640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f5310024c80 0x7f532c15de10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:30:59.727 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f5332aa6640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f5310026810 0x7f532c13e0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:30:59.727 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f5332aa6640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7f532c05e880 con 0x7f5310003c20 2026-02-13T02:30:59.727 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f5332aa6640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7f532c05e700 con 0x7f5310026810 2026-02-13T02:30:59.727 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f5332aa6640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7f532c05ea00 con 0x7f5310024c80 2026-02-13T02:30:59.727 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f533081b640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f5310003c20 0x7f532c1467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:30:59.727 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f533081b640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f5310003c20 0x7f532c1467e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:38614/0 (socket says 10.20.193.121:38614) 2026-02-13T02:30:59.728 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f533081b640 1 -- 10.20.193.121:0/421753204 learned_addr learned my addr 10.20.193.121:0/421753204 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:30:59.728 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f533101c640 1 --2- 10.20.193.121:0/421753204 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f5310026810 0x7f532c13e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:30:59.728 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f5323fff640 1 --2- 10.20.193.121:0/421753204 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f5310024c80 0x7f532c15de10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:30:59.728 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f533081b640 1 -- 10.20.193.121:0/421753204 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f5310024c80 msgr2=0x7f532c15de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:30:59.728 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f533081b640 1 --2- 10.20.193.121:0/421753204 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f5310024c80 0x7f532c15de10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:30:59.728 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f533081b640 1 -- 10.20.193.121:0/421753204 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f5310026810 msgr2=0x7f532c13e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:30:59.728 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f533081b640 1 --2- 10.20.193.121:0/421753204 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f5310026810 0x7f532c13e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:30:59.728 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f533081b640 1 -- 10.20.193.121:0/421753204 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f532c140f40 con 0x7f5310003c20 2026-02-13T02:30:59.728 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f5323fff640 1 --2- 10.20.193.121:0/421753204 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f5310024c80 0x7f532c15de10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:30:59.728 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f533081b640 1 --2- 10.20.193.121:0/421753204 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f5310003c20 0x7f532c1467e0 secure :-1 s=READY pgs=58 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f531c002410 tx=0x7f531c005940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:30:59.728 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f53217fa640 1 -- 10.20.193.121:0/421753204 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f531c0bb070 con 0x7f5310003c20 2026-02-13T02:30:59.728 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f53217fa640 1 -- 10.20.193.121:0/421753204 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f531c0adae0 con 0x7f5310003c20 2026-02-13T02:30:59.729 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f53217fa640 1 -- 10.20.193.121:0/421753204 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f531c0b2040 con 0x7f5310003c20 2026-02-13T02:30:59.729 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f5332aa6640 1 -- 10.20.193.121:0/421753204 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f532c1406a0 con 0x7f5310003c20 2026-02-13T02:30:59.729 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f5332aa6640 1 -- 10.20.193.121:0/421753204 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f532c140c60 con 0x7f5310003c20 2026-02-13T02:30:59.729 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f53217fa640 1 -- 10.20.193.121:0/421753204 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f531c0b5070 con 0x7f5310003c20 2026-02-13T02:30:59.729 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f53217fa640 1 -- 10.20.193.121:0/421753204 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f531c0c0760 con 0x7f5310003c20 2026-02-13T02:30:59.729 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.716+0000 7f5332aa6640 1 -- 10.20.193.121:0/421753204 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f532c09ba40 con 0x7f5310003c20 2026-02-13T02:30:59.729 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.720+0000 7f53217fa640 1 -- 10.20.193.121:0/421753204 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f531c0c5080 con 0x7f5310003c20 2026-02-13T02:30:59.756 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.748+0000 7f5332aa6640 1 -- 10.20.193.121:0/421753204 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f532c143fb0 con 0x7f5310003c20 2026-02-13T02:30:59.756 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:30:59.748+0000 7f2020227280 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T02:30:59.757 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.748+0000 7f53217fa640 1 -- 10.20.193.121:0/421753204 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v20)=0 v20) ==== 123+0+0 (secure 0 0 0) 0x7f531c016cd0 con 0x7f5310003c20 2026-02-13T02:30:59.758 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:30:59.748+0000 7f2020227280 -1 mgr[py] Loading module status in main interpreter 2026-02-13T02:30:59.759 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.748+0000 7f5332aa6640 1 -- 10.20.193.121:0/421753204 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f5310003c20 msgr2=0x7f532c1467e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:30:59.759 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.748+0000 7f5332aa6640 1 --2- 10.20.193.121:0/421753204 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f5310003c20 0x7f532c1467e0 secure :-1 s=READY pgs=58 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f531c002410 tx=0x7f531c005940 comp rx=0 tx=0).stop 2026-02-13T02:30:59.759 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.748+0000 7f5332aa6640 1 -- 10.20.193.121:0/421753204 shutdown_connections 2026-02-13T02:30:59.759 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.748+0000 7f5332aa6640 1 --2- 10.20.193.121:0/421753204 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f5310026810 0x7f532c13e0b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:30:59.759 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.748+0000 7f5332aa6640 1 --2- 10.20.193.121:0/421753204 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f5310024c80 0x7f532c15de10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:30:59.759 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.748+0000 7f5332aa6640 1 --2- 10.20.193.121:0/421753204 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f5310003c20 0x7f532c1467e0 unknown :-1 s=CLOSED pgs=58 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:30:59.759 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.748+0000 7f5332aa6640 1 -- 10.20.193.121:0/421753204 >> 10.20.193.121:0/421753204 conn(0x7f532c057b80 msgr2=0x7f532c09ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:30:59.759 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.748+0000 7f5332aa6640 1 -- 10.20.193.121:0/421753204 shutdown_connections 2026-02-13T02:30:59.760 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.748+0000 7f5332aa6640 1 -- 10.20.193.121:0/421753204 wait complete. 2026-02-13T02:30:59.760 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:30:59.752+0000 7f2020227280 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T02:30:59.768 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:30:59.759+0000 7f89213dd280 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T02:30:59.769 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial121') 2026-02-13T02:30:59.769 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='trial121') 2026-02-13T02:30:59.769 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='trial121') 2026-02-13T02:30:59.770 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:30:59.763+0000 7f89213dd280 -1 mgr[py] Loading module status in main interpreter 2026-02-13T02:30:59.770 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:30:59.760+0000 7f2020227280 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T02:30:59.770 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:30:59.760+0000 7f2020227280 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T02:30:59.771 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:30:59.763+0000 7f89213dd280 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T02:30:59.780 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:30:59.771+0000 7f89213dd280 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T02:30:59.781 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:30:59.775+0000 7f89213dd280 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T02:30:59.854 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:30:59.844+0000 7f2020227280 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T02:30:59.855 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89d0d98640 1 -- 10.20.193.121:0/4044436320 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f89b80053a0 msgr2=0x7f89b8065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:30:59.855 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89d0d98640 1 --2- 10.20.193.121:0/4044436320 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f89b80053a0 0x7f89b8065a90 secure :-1 s=READY pgs=60 gs=30 cs=0 l=1 c_cookie=9442495554888391324 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89cc09c540 tx=0x7f89bc01e020 comp rx=0 tx=0).stop 2026-02-13T02:30:59.855 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89d0d98640 1 -- 10.20.193.121:0/4044436320 shutdown_connections 2026-02-13T02:30:59.855 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89d0d98640 1 --2- 10.20.193.121:0/4044436320 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f89b80053a0 0x7f89b8065a90 unknown :-1 s=CLOSED pgs=60 gs=30 cs=0 l=1 c_cookie=9442495554888391324 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:30:59.855 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89d0d98640 1 -- 10.20.193.121:0/4044436320 >> 10.20.193.121:0/4044436320 conn(0x7f89cc057b80 msgr2=0x7f89cc09ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:30:59.855 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89d0d98640 1 -- 10.20.193.121:0/4044436320 shutdown_connections 2026-02-13T02:30:59.855 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89d0d98640 1 -- 10.20.193.121:0/4044436320 wait complete. 2026-02-13T02:30:59.856 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89d0d98640 1 Processor -- start 2026-02-13T02:30:59.856 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89d0d98640 1 -- start start 2026-02-13T02:30:59.859 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89d0d98640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f89b80053a0 0x7f89cc15fbe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:30:59.859 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89d0d98640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f89cc15e470 0x7f89cc12ae70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:30:59.859 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89d0d98640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f89cc147a00 0x7f89cc12b3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:30:59.859 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89d0d98640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7f89cc05e4f0 con 0x7f89b80053a0 2026-02-13T02:30:59.859 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89d0d98640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7f89cc1699f0 con 0x7f89cc15e470 2026-02-13T02:30:59.859 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89d0d98640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7f89cc05e670 con 0x7f89cc147a00 2026-02-13T02:30:59.859 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89ca575640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f89b80053a0 0x7f89cc15fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:30:59.859 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89ca575640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f89b80053a0 0x7f89cc15fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:38624/0 (socket says 10.20.193.121:38624) 2026-02-13T02:30:59.859 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89ca575640 1 -- 10.20.193.121:0/3540069283 learned_addr learned my addr 10.20.193.121:0/3540069283 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:30:59.860 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89c9d74640 1 --2- 10.20.193.121:0/3540069283 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f89cc15e470 0x7f89cc12ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:30:59.860 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89cad76640 1 --2- 10.20.193.121:0/3540069283 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f89cc147a00 0x7f89cc12b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:30:59.860 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89ca575640 1 -- 10.20.193.121:0/3540069283 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f89cc147a00 msgr2=0x7f89cc12b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:30:59.860 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89ca575640 1 --2- 10.20.193.121:0/3540069283 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f89cc147a00 0x7f89cc12b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:30:59.860 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89ca575640 1 -- 10.20.193.121:0/3540069283 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f89cc15e470 msgr2=0x7f89cc12ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:30:59.860 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89ca575640 1 --2- 10.20.193.121:0/3540069283 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f89cc15e470 0x7f89cc12ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:30:59.860 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89ca575640 1 -- 10.20.193.121:0/3540069283 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89cc1286a0 con 0x7f89b80053a0 2026-02-13T02:30:59.860 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89cad76640 1 --2- 10.20.193.121:0/3540069283 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f89cc147a00 0x7f89cc12b3b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:30:59.860 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89ca575640 1 --2- 10.20.193.121:0/3540069283 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f89b80053a0 0x7f89cc15fbe0 secure :-1 s=READY pgs=61 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89c0002410 tx=0x7f89c0012c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:30:59.860 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89b2ffd640 1 -- 10.20.193.121:0/3540069283 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89c0023020 con 0x7f89b80053a0 2026-02-13T02:30:59.860 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89b2ffd640 1 -- 10.20.193.121:0/3540069283 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89c0011d90 con 0x7f89b80053a0 2026-02-13T02:30:59.860 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89b2ffd640 1 -- 10.20.193.121:0/3540069283 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89c001f6e0 con 0x7f89b80053a0 2026-02-13T02:30:59.861 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89d0d98640 1 -- 10.20.193.121:0/3540069283 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89cc128980 con 0x7f89b80053a0 2026-02-13T02:30:59.861 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89d0d98640 1 -- 10.20.193.121:0/3540069283 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89cc128f40 con 0x7f89b80053a0 2026-02-13T02:30:59.861 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89b2ffd640 1 -- 10.20.193.121:0/3540069283 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f89c001f880 con 0x7f89b80053a0 2026-02-13T02:30:59.861 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89b2ffd640 1 -- 10.20.193.121:0/3540069283 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f89c001e3c0 con 0x7f89b80053a0 2026-02-13T02:30:59.861 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.848+0000 7f89d0d98640 1 -- 10.20.193.121:0/3540069283 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89cc09b9b0 con 0x7f89b80053a0 2026-02-13T02:30:59.861 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.852+0000 7f89b2ffd640 1 -- 10.20.193.121:0/3540069283 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f89c002d020 con 0x7f89b80053a0 2026-02-13T02:30:59.863 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:30:59.859+0000 7f89213dd280 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T02:30:59.888 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.880+0000 7f89d0d98640 1 -- 10.20.193.121:0/3540069283 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f89cc168d70 con 0x7f89b80053a0 2026-02-13T02:30:59.890 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.880+0000 7f89b2ffd640 1 -- 10.20.193.121:0/3540069283 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v21)=0 v21) ==== 117+0+0 (secure 0 0 0) 0x7f89c0028400 con 0x7f89b80053a0 2026-02-13T02:30:59.891 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.884+0000 7f89d0d98640 1 -- 10.20.193.121:0/3540069283 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f89b80053a0 msgr2=0x7f89cc15fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:30:59.891 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.884+0000 7f89d0d98640 1 --2- 10.20.193.121:0/3540069283 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f89b80053a0 0x7f89cc15fbe0 secure :-1 s=READY pgs=61 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89c0002410 tx=0x7f89c0012c20 comp rx=0 tx=0).stop 2026-02-13T02:30:59.891 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.884+0000 7f89d0d98640 1 -- 10.20.193.121:0/3540069283 shutdown_connections 2026-02-13T02:30:59.891 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.884+0000 7f89d0d98640 1 --2- 10.20.193.121:0/3540069283 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f89cc147a00 0x7f89cc12b3b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:30:59.891 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.884+0000 7f89d0d98640 1 --2- 10.20.193.121:0/3540069283 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f89cc15e470 0x7f89cc12ae70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:30:59.891 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.884+0000 7f89d0d98640 1 --2- 10.20.193.121:0/3540069283 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f89b80053a0 0x7f89cc15fbe0 unknown :-1 s=CLOSED pgs=61 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:30:59.891 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.884+0000 7f89d0d98640 1 -- 10.20.193.121:0/3540069283 >> 10.20.193.121:0/3540069283 conn(0x7f89cc057b80 msgr2=0x7f89cc12c830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:30:59.891 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.884+0000 7f89d0d98640 1 -- 10.20.193.121:0/3540069283 shutdown_connections 2026-02-13T02:30:59.892 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:30:59.884+0000 7f89d0d98640 1 -- 10.20.193.121:0/3540069283 wait complete. 2026-02-13T02:30:59.902 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='trial121') 2026-02-13T02:30:59.902 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='trial121') 2026-02-13T02:30:59.902 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='trial121') 2026-02-13T02:30:59.903 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='trial121') 2026-02-13T02:30:59.903 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='trial121') 2026-02-13T02:30:59.903 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial121') 2026-02-13T02:30:59.903 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial121') 2026-02-13T02:30:59.988 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:30:59.980+0000 7f2020227280 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T02:30:59.988 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:30:59.980+0000 7f2020227280 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T02:30:59.991 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:30:59.984+0000 7f2020227280 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T02:30:59.993 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:30:59.984+0000 7f2020227280 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T02:30:59.996 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:30:59.988+0000 7f2020227280 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T02:30:59.996 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:30:59.991+0000 7f89213dd280 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T02:30:59.997 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:30:59.991+0000 7f89213dd280 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T02:30:59.998 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:30:59.992+0000 7f2020227280 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T02:31:00.000 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:30:59.995+0000 7f89213dd280 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T02:31:00.002 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:30:59.999+0000 7f89213dd280 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T02:31:00.005 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:30:59.999+0000 7f89213dd280 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T02:31:00.006 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:30:59.996+0000 7f2020227280 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T02:31:00.007 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:31:00.003+0000 7f89213dd280 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T02:31:00.015 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:31:00.011+0000 7f89213dd280 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T02:31:00.022 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:31:00.016+0000 7f2020227280 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T02:31:00.032 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:31:00.027+0000 7f89213dd280 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T02:31:00.032 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:31:00.024+0000 7f2020227280 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T02:31:00.033 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:31:00.024+0000 7f2020227280 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T02:31:00.041 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:31:00.039+0000 7f89213dd280 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T02:31:00.042 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:31:00.039+0000 7f89213dd280 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T02:31:00.050 INFO:tasks.ceph.mgr.y.trial121.stderr:ERROR:root:Module 'jmespath' is not installed. 2026-02-13T02:31:00.059 INFO:tasks.ceph.mgr.x.trial178.stderr:ERROR:root:Module 'jmespath' is not installed. 2026-02-13T02:31:00.072 INFO:tasks.ceph.mgr.y.trial121.stderr:ERROR:dashboard.controllers.nvmeof:Failed to import NVMeoFClient and related components: cannot import name 'NVMeoFClient' from 'dashboard.services.nvmeof_client' (/usr/share/ceph/mgr/dashboard/services/nvmeof_client.py) 2026-02-13T02:31:00.077 INFO:tasks.ceph.mgr.y.trial121.stderr:ERROR:sso:Module 'jmespath' is not installed. 2026-02-13T02:31:00.081 INFO:tasks.ceph.mgr.x.trial178.stderr:ERROR:dashboard.controllers.nvmeof:Failed to import NVMeoFClient and related components: cannot import name 'NVMeoFClient' from 'dashboard.services.nvmeof_client' (/usr/share/ceph/mgr/dashboard/services/nvmeof_client.py) 2026-02-13T02:31:00.087 INFO:tasks.ceph.mgr.x.trial178.stderr:ERROR:sso:Module 'jmespath' is not installed. 2026-02-13T02:31:00.122 INFO:tasks.ceph.mgr.y.trial121.stderr:ERROR:root:Module 'xmltodict' is not installed. 2026-02-13T02:31:00.128 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:31:00.120+0000 7f2020227280 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T02:31:00.130 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:31:00.120+0000 7f2020227280 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T02:31:00.132 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:31:00.124+0000 7f2020227280 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T02:31:00.133 INFO:tasks.ceph.mgr.x.trial178.stderr:ERROR:root:Module 'xmltodict' is not installed. 2026-02-13T02:31:00.139 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:31:00.135+0000 7f89213dd280 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T02:31:00.141 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:31:00.139+0000 7f89213dd280 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T02:31:00.143 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:31:00.139+0000 7f89213dd280 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T02:31:00.160 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:31:00.152+0000 7f2020227280 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T02:31:00.164 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:31:00.156+0000 7f2020227280 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T02:31:00.165 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:31:00.156+0000 7f2020227280 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T02:31:00.167 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:31:00.160+0000 7f2020227280 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T02:31:00.171 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:31:00.164+0000 7f2020227280 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T02:31:00.172 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:31:00.167+0000 7f89213dd280 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T02:31:00.173 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.164+0000 7fb58756a640 1 -- 10.20.193.121:0/2916743981 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fb5680048d0 msgr2=0x7fb568004d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:00.173 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.164+0000 7fb58756a640 1 --2- 10.20.193.121:0/2916743981 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fb5680048d0 0x7fb568004d40 secure :-1 s=READY pgs=63 gs=30 cs=0 l=1 c_cookie=11251675462302888844 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb574006340 tx=0x7fb57401ddc0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.173 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.164+0000 7fb585ae0640 1 -- 10.20.193.121:0/2916743981 reap_dead start 2026-02-13T02:31:00.174 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.164+0000 7fb58756a640 1 -- 10.20.193.121:0/2916743981 shutdown_connections 2026-02-13T02:31:00.174 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.164+0000 7fb58756a640 1 -- 10.20.193.121:0/2916743981 >> 10.20.193.121:0/2916743981 conn(0x7fb5800a16e0 msgr2=0x7fb5800bbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:00.174 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.164+0000 7fb58756a640 1 -- 10.20.193.121:0/2916743981 shutdown_connections 2026-02-13T02:31:00.174 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.164+0000 7fb58756a640 1 -- 10.20.193.121:0/2916743981 wait complete. 2026-02-13T02:31:00.174 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.164+0000 7fb58756a640 1 Processor -- start 2026-02-13T02:31:00.174 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb58756a640 1 -- start start 2026-02-13T02:31:00.177 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb58756a640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fb5680048d0 0x7fb580144260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:00.177 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb58756a640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fb580143d30 0x7fb580149a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:00.177 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb58756a640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fb5800bd610 0x7fb5800bda90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:00.177 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb58756a640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb580168c70 con 0x7fb580143d30 2026-02-13T02:31:00.177 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb58756a640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb5800582e0 con 0x7fb5680048d0 2026-02-13T02:31:00.177 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb58756a640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7fb580168df0 con 0x7fb5800bd610 2026-02-13T02:31:00.177 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb584ade640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fb580143d30 0x7fb580149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:00.177 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb584ade640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fb580143d30 0x7fb580149a70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:38652/0 (socket says 10.20.193.121:38652) 2026-02-13T02:31:00.178 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb584ade640 1 -- 10.20.193.121:0/3001410941 learned_addr learned my addr 10.20.193.121:0/3001410941 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:00.178 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb5852df640 1 --2- 10.20.193.121:0/3001410941 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fb5680048d0 0x7fb580144260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:00.178 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb585ae0640 1 --2- 10.20.193.121:0/3001410941 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fb5800bd610 0x7fb5800bda90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:00.178 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb584ade640 1 -- 10.20.193.121:0/3001410941 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fb5800bd610 msgr2=0x7fb5800bda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:00.178 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb584ade640 1 --2- 10.20.193.121:0/3001410941 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fb5800bd610 0x7fb5800bda90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.178 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb584ade640 1 -- 10.20.193.121:0/3001410941 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fb5680048d0 msgr2=0x7fb580144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:00.178 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb584ade640 1 --2- 10.20.193.121:0/3001410941 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fb5680048d0 0x7fb580144260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.178 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb584ade640 1 -- 10.20.193.121:0/3001410941 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb58012cd90 con 0x7fb580143d30 2026-02-13T02:31:00.178 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb5852df640 1 --2- 10.20.193.121:0/3001410941 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fb5680048d0 0x7fb580144260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:31:00.178 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb584ade640 1 --2- 10.20.193.121:0/3001410941 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fb580143d30 0x7fb580149a70 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb57401e7f0 tx=0x7fb574002f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:00.178 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb56dffb640 1 -- 10.20.193.121:0/3001410941 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5740ac040 con 0x7fb580143d30 2026-02-13T02:31:00.178 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb56dffb640 1 -- 10.20.193.121:0/3001410941 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb574003130 con 0x7fb580143d30 2026-02-13T02:31:00.179 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb56dffb640 1 -- 10.20.193.121:0/3001410941 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb574003540 con 0x7fb580143d30 2026-02-13T02:31:00.179 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb58756a640 1 -- 10.20.193.121:0/3001410941 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5801451b0 con 0x7fb580143d30 2026-02-13T02:31:00.179 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb58756a640 1 -- 10.20.193.121:0/3001410941 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb580145770 con 0x7fb580143d30 2026-02-13T02:31:00.179 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb56dffb640 1 -- 10.20.193.121:0/3001410941 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7fb5740036e0 con 0x7fb580143d30 2026-02-13T02:31:00.179 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb56dffb640 1 -- 10.20.193.121:0/3001410941 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7fb5740b7070 con 0x7fb580143d30 2026-02-13T02:31:00.179 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb58756a640 1 -- 10.20.193.121:0/3001410941 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb580056140 con 0x7fb580143d30 2026-02-13T02:31:00.180 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.168+0000 7fb56dffb640 1 -- 10.20.193.121:0/3001410941 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7fb5740c8030 con 0x7fb580143d30 2026-02-13T02:31:00.180 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:31:00.171+0000 7f89213dd280 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T02:31:00.180 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:31:00.175+0000 7f89213dd280 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T02:31:00.180 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:31:00.175+0000 7f89213dd280 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T02:31:00.183 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:31:00.179+0000 7f89213dd280 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T02:31:00.215 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648b04e640 1 -- 10.20.193.121:0/1249833346 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f646c003ab0 msgr2=0x7f646c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:00.215 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648b04e640 1 --2- 10.20.193.121:0/1249833346 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f646c003ab0 0x7f646c003ec0 secure :-1 s=READY pgs=66 gs=30 cs=0 l=1 c_cookie=9035725472353202131 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6474003b10 tx=0x7f647401e990 comp rx=0 tx=0).stop 2026-02-13T02:31:00.215 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648b04e640 1 -- 10.20.193.121:0/1249833346 shutdown_connections 2026-02-13T02:31:00.215 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648b04e640 1 --2- 10.20.193.121:0/1249833346 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f646c003ab0 0x7f646c003ec0 unknown :-1 s=CLOSED pgs=66 gs=30 cs=0 l=1 c_cookie=9035725472353202131 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.216 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648b04e640 1 -- 10.20.193.121:0/1249833346 >> 10.20.193.121:0/1249833346 conn(0x7f6484057870 msgr2=0x7f6484056140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:00.216 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648b04e640 1 -- 10.20.193.121:0/1249833346 shutdown_connections 2026-02-13T02:31:00.216 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648b04e640 1 -- 10.20.193.121:0/1249833346 wait complete. 2026-02-13T02:31:00.218 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648b04e640 1 Processor -- start 2026-02-13T02:31:00.218 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648b04e640 1 -- start start 2026-02-13T02:31:00.218 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648b04e640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f646c003ab0 0x7f64841597e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:00.219 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648b04e640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f64840a4580 0x7f648412dfe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:00.219 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648b04e640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f648412d130 0x7f648414c430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:00.219 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648b04e640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7f64840be510 con 0x7f64840a4580 2026-02-13T02:31:00.219 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648b04e640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7f64840be390 con 0x7f648412d130 2026-02-13T02:31:00.219 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648b04e640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7f64840be690 con 0x7f646c003ab0 2026-02-13T02:31:00.219 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648984b640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f64840a4580 0x7f648412dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:00.219 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648984b640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f64840a4580 0x7f648412dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:38674/0 (socket says 10.20.193.121:38674) 2026-02-13T02:31:00.219 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648984b640 1 -- 10.20.193.121:0/2875096467 learned_addr learned my addr 10.20.193.121:0/2875096467 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:00.219 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648a04c640 1 --2- 10.20.193.121:0/2875096467 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f646c003ab0 0x7f64841597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:00.219 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648a84d640 1 --2- 10.20.193.121:0/2875096467 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f648412d130 0x7f648414c430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:00.219 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648984b640 1 -- 10.20.193.121:0/2875096467 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f646c003ab0 msgr2=0x7f64841597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:00.220 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648984b640 1 --2- 10.20.193.121:0/2875096467 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f646c003ab0 0x7f64841597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.220 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648984b640 1 -- 10.20.193.121:0/2875096467 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f648412d130 msgr2=0x7f648414c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:00.220 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648984b640 1 --2- 10.20.193.121:0/2875096467 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f648412d130 0x7f648414c430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.220 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648984b640 1 -- 10.20.193.121:0/2875096467 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6484159f50 con 0x7f64840a4580 2026-02-13T02:31:00.220 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648a04c640 1 --2- 10.20.193.121:0/2875096467 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f646c003ab0 0x7f64841597e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:31:00.220 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648984b640 1 --2- 10.20.193.121:0/2875096467 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f64840a4580 0x7f648412dfe0 secure :-1 s=READY pgs=67 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6478006fd0 tx=0x7f6478013740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:00.220 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f646affd640 1 -- 10.20.193.121:0/2875096467 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f64780040d0 con 0x7f64840a4580 2026-02-13T02:31:00.220 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648b04e640 1 -- 10.20.193.121:0/2875096467 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f648415a230 con 0x7f64840a4580 2026-02-13T02:31:00.220 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f646affd640 1 -- 10.20.193.121:0/2875096467 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6478004270 con 0x7f64840a4580 2026-02-13T02:31:00.220 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f646affd640 1 -- 10.20.193.121:0/2875096467 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f64780046c0 con 0x7f64840a4580 2026-02-13T02:31:00.220 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f648b04e640 1 -- 10.20.193.121:0/2875096467 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f648412cc10 con 0x7f64840a4580 2026-02-13T02:31:00.220 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f646affd640 1 -- 10.20.193.121:0/2875096467 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f6478012450 con 0x7f64840a4580 2026-02-13T02:31:00.221 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.208+0000 7f646affd640 1 -- 10.20.193.121:0/2875096467 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f6478019070 con 0x7f64840a4580 2026-02-13T02:31:00.221 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.212+0000 7f648b04e640 1 -- 10.20.193.121:0/2875096467 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f644c005340 con 0x7f64840a4580 2026-02-13T02:31:00.221 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.212+0000 7f646affd640 1 -- 10.20.193.121:0/2875096467 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f6478013e20 con 0x7f64840a4580 2026-02-13T02:31:00.232 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.224+0000 7fb58756a640 1 -- 10.20.193.121:0/3001410941 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fb580144d20 con 0x7fb580143d30 2026-02-13T02:31:00.234 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.224+0000 7fb56dffb640 1 -- 10.20.193.121:0/3001410941 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v22)=0 v22) ==== 120+0+0 (secure 0 0 0) 0x7fb574017b60 con 0x7fb580143d30 2026-02-13T02:31:00.237 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.228+0000 7fb54f7fe640 1 -- 10.20.193.121:0/3001410941 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fb580143d30 msgr2=0x7fb580149a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:00.237 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.228+0000 7fb54f7fe640 1 --2- 10.20.193.121:0/3001410941 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fb580143d30 0x7fb580149a70 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb57401e7f0 tx=0x7fb574002f70 comp rx=0 tx=0).stop 2026-02-13T02:31:00.238 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.228+0000 7fb54f7fe640 1 -- 10.20.193.121:0/3001410941 shutdown_connections 2026-02-13T02:31:00.238 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.228+0000 7fb54f7fe640 1 --2- 10.20.193.121:0/3001410941 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fb5800bd610 0x7fb5800bda90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.238 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.228+0000 7fb54f7fe640 1 --2- 10.20.193.121:0/3001410941 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fb580143d30 0x7fb580149a70 unknown :-1 s=CLOSED pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.238 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.228+0000 7fb54f7fe640 1 --2- 10.20.193.121:0/3001410941 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fb5680048d0 0x7fb580144260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.238 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.228+0000 7fb54f7fe640 1 -- 10.20.193.121:0/3001410941 >> 10.20.193.121:0/3001410941 conn(0x7fb5800a16e0 msgr2=0x7fb5800bb140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:00.238 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.228+0000 7fb54f7fe640 1 -- 10.20.193.121:0/3001410941 shutdown_connections 2026-02-13T02:31:00.238 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.228+0000 7fb54f7fe640 1 -- 10.20.193.121:0/3001410941 wait complete. 2026-02-13T02:31:00.251 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial121') 2026-02-13T02:31:00.276 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.268+0000 7f648b04e640 1 -- 10.20.193.121:0/2875096467 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f644c005630 con 0x7f64840a4580 2026-02-13T02:31:00.277 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.268+0000 7f646affd640 1 -- 10.20.193.121:0/2875096467 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v23)=0 v23) ==== 120+0+0 (secure 0 0 0) 0x7f6478004860 con 0x7f64840a4580 2026-02-13T02:31:00.278 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.268+0000 7f648b04e640 1 -- 10.20.193.121:0/2875096467 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f64840a4580 msgr2=0x7f648412dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:00.278 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.268+0000 7f648b04e640 1 --2- 10.20.193.121:0/2875096467 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f64840a4580 0x7f648412dfe0 secure :-1 s=READY pgs=67 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6478006fd0 tx=0x7f6478013740 comp rx=0 tx=0).stop 2026-02-13T02:31:00.279 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.268+0000 7f648b04e640 1 -- 10.20.193.121:0/2875096467 shutdown_connections 2026-02-13T02:31:00.279 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.268+0000 7f648b04e640 1 --2- 10.20.193.121:0/2875096467 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f648412d130 0x7f648414c430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.279 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.268+0000 7f648b04e640 1 --2- 10.20.193.121:0/2875096467 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f64840a4580 0x7f648412dfe0 unknown :-1 s=CLOSED pgs=67 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.279 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.268+0000 7f648b04e640 1 --2- 10.20.193.121:0/2875096467 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f646c003ab0 0x7f64841597e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.279 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.268+0000 7f648b04e640 1 -- 10.20.193.121:0/2875096467 >> 10.20.193.121:0/2875096467 conn(0x7f6484057870 msgr2=0x7f648414dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:00.279 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.268+0000 7f648b04e640 1 -- 10.20.193.121:0/2875096467 shutdown_connections 2026-02-13T02:31:00.279 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.268+0000 7f648b04e640 1 -- 10.20.193.121:0/2875096467 wait complete. 2026-02-13T02:31:00.288 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='trial121') 2026-02-13T02:31:00.288 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='trial121') 2026-02-13T02:31:00.288 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='trial121') 2026-02-13T02:31:00.288 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='trial121') 2026-02-13T02:31:00.288 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='trial121') 2026-02-13T02:31:00.288 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='trial121') 2026-02-13T02:31:00.288 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial121') 2026-02-13T02:31:00.289 DEBUG:teuthology.orchestra.run.trial121:> sudo ceph --cluster ceph config dump 2026-02-13T02:31:00.294 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:31:00.284+0000 7f2020227280 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T02:31:00.302 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-13T02:31:00.299+0000 7f89213dd280 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T02:31:00.347 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:setting log level based on debug_mgr: DEBUG (20/20) 2026-02-13T02:31:00.360 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:Starting 2026-02-13T02:31:00.361 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:Waking up [active, now 2026-02-13_02:31:00] 2026-02-13T02:31:00.361 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:Running 2026-02-13T02:31:00.361 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:setting log level based on debug_mgr: DEBUG (20/20) 2026-02-13T02:31:00.361 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:Optimize plan auto_2026-02-13_02:31:00, mode upmap, max misplaced 0.050000 2026-02-13T02:31:00.361 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:unknown 0.000000 degraded 0.000000 inactive 0.000000 misplaced 0 2026-02-13T02:31:00.361 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:do_upmap 2026-02-13T02:31:00.361 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option warn_recent_interval = 1209600 2026-02-13T02:31:00.361 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option retain_interval = 31536000 2026-02-13T02:31:00.361 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option log_level = 2026-02-13T02:31:00.362 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-13T02:31:00.362 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-13T02:31:00.362 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-13T02:31:00.362 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-13T02:31:00.362 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:setting log level based on debug_mgr: DEBUG (20/20) 2026-02-13T02:31:00.362 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:No pools available 2026-02-13T02:31:00.362 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:Sleeping for 60 2026-02-13T02:31:00.362 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:Starting 2026-02-13T02:31:00.362 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:setting log level based on debug_mgr: DEBUG (20/20) 2026-02-13T02:31:00.362 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: enable_monitoring = True 2026-02-13T02:31:00.362 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: scrape_frequency = 86400 2026-02-13T02:31:00.363 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: pool_name = device_health_metrics 2026-02-13T02:31:00.363 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: retention_period = 15552000 2026-02-13T02:31:00.363 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mark_out_threshold = 2419200 2026-02-13T02:31:00.363 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: warn_threshold = 7257600 2026-02-13T02:31:00.363 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: self_heal = True 2026-02-13T02:31:00.363 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: sleep_interval = 600 2026-02-13T02:31:00.363 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: log_level = 2026-02-13T02:31:00.363 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: log_to_file = False 2026-02-13T02:31:00.363 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-13T02:31:00.363 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: log_to_cluster = False 2026-02-13T02:31:00.363 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-13T02:31:00.363 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:Sleeping for 2 seconds 2026-02-13T02:31:00.364 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:setting log level based on debug_mgr: DEBUG (20/20) 2026-02-13T02:31:00.364 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:setting log level based on debug_mgr: DEBUG (20/20) 2026-02-13T02:31:00.364 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:ident set(), fault set() 2026-02-13T02:31:00.364 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:setting log level based on debug_mgr: DEBUG (20/20) 2026-02-13T02:31:00.364 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: native option mon_target_pg_per_osd = 100 2026-02-13T02:31:00.364 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: native option mon_max_pg_per_osd = 10000 2026-02-13T02:31:00.364 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option sleep_interval = 60 2026-02-13T02:31:00.364 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option threshold = 3.0 2026-02-13T02:31:00.364 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option log_level = 2026-02-13T02:31:00.364 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:setting log level based on debug_mgr: DEBUG (20/20) 2026-02-13T02:31:00.364 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-13T02:31:00.365 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-13T02:31:00.365 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-13T02:31:00.365 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-13T02:31:00.365 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:_maybe_adjust 2026-02-13T02:31:00.365 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:pool: {} 2026-02-13T02:31:00.365 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: max_completed_events = 50 2026-02-13T02:31:00.365 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:setting log level based on debug_mgr: DEBUG (20/20) 2026-02-13T02:31:00.365 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: sleep_interval = 5 2026-02-13T02:31:00.365 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: enabled = True 2026-02-13T02:31:00.365 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: allow_pg_recovery_event = False 2026-02-13T02:31:00.365 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: log_level = 2026-02-13T02:31:00.366 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: log_to_file = False 2026-02-13T02:31:00.366 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-13T02:31:00.366 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: log_to_cluster = False 2026-02-13T02:31:00.366 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-13T02:31:00.366 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:Loading... 2026-02-13T02:31:00.366 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:No stored events to load 2026-02-13T02:31:00.366 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:Loaded [] historic events 2026-02-13T02:31:00.366 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:Loaded OSDMap, ready. 2026-02-13T02:31:00.366 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:recovery thread starting 2026-02-13T02:31:00.366 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:starting setup 2026-02-13T02:31:00.366 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:setting log level based on debug_mgr: DEBUG (20/20) 2026-02-13T02:31:00.367 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:setting log level based on debug_mgr: DEBUG (20/20) 2026-02-13T02:31:00.367 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: url = https://telemetry.ceph.com/report 2026-02-13T02:31:00.367 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: device_url = https://telemetry.ceph.com/device 2026-02-13T02:31:00.367 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: enabled = False 2026-02-13T02:31:00.367 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: last_opt_revision = 1 2026-02-13T02:31:00.367 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: leaderboard = False 2026-02-13T02:31:00.367 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: leaderboard_description = None 2026-02-13T02:31:00.367 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: description = None 2026-02-13T02:31:00.367 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: contact = None 2026-02-13T02:31:00.367 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: organization = None 2026-02-13T02:31:00.367 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: proxy = None 2026-02-13T02:31:00.368 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: interval = 24 2026-02-13T02:31:00.368 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: channel_basic = True 2026-02-13T02:31:00.368 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: channel_ident = False 2026-02-13T02:31:00.368 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: channel_crash = True 2026-02-13T02:31:00.368 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: channel_device = True 2026-02-13T02:31:00.368 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: channel_perf = False 2026-02-13T02:31:00.368 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: log_level = 2026-02-13T02:31:00.368 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: log_to_file = False 2026-02-13T02:31:00.368 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-13T02:31:00.368 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: log_to_cluster = False 2026-02-13T02:31:00.368 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-13T02:31:00.368 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:setting log level based on debug_mgr: DEBUG (20/20) 2026-02-13T02:31:00.369 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option max_concurrent_clones = 4 2026-02-13T02:31:00.369 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option snapshot_clone_delay = 0 2026-02-13T02:31:00.369 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option periodic_async_work = False 2026-02-13T02:31:00.369 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option snapshot_clone_no_wait = True 2026-02-13T02:31:00.369 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option pause_purging = False 2026-02-13T02:31:00.369 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option pause_cloning = False 2026-02-13T02:31:00.369 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option log_level = 2026-02-13T02:31:00.369 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-13T02:31:00.369 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-13T02:31:00.369 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-13T02:31:00.369 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-13T02:31:00.370 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: refresh_images 2026-02-13T02:31:00.370 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:MirrorSnapshotScheduleHandler: load_schedules 2026-02-13T02:31:00.370 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: no schedules 2026-02-13T02:31:00.370 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: queue is initialized 2026-02-13T02:31:00.370 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:MirrorSnapshotScheduleHandler: starting 2026-02-13T02:31:00.370 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:PerfHandler: starting 2026-02-13T02:31:00.370 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:sequence=0, tasks_by_sequence={}, tasks_by_id={} 2026-02-13T02:31:00.370 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:TaskHandler: starting 2026-02-13T02:31:00.370 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:TrashPurgeScheduleHandler: refresh_pools 2026-02-13T02:31:00.370 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:TrashPurgeScheduleHandler: load_schedules 2026-02-13T02:31:00.370 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:TrashPurgeScheduleHandler: no schedules 2026-02-13T02:31:00.371 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:TrashPurgeScheduleHandler: queue is initialized 2026-02-13T02:31:00.371 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:TrashPurgeScheduleHandler: starting 2026-02-13T02:31:00.371 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:setup complete 2026-02-13T02:31:00.372 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.348+0000 7f77e5bd9640 1 -- 10.20.193.121:0/2712401104 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f77e0056850 msgr2=0x7f77e0168cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:00.372 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.348+0000 7f77e5bd9640 1 --2- 10.20.193.121:0/2712401104 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f77e0056850 0x7f77e0168cd0 secure :-1 s=READY pgs=74 gs=2 cs=0 l=1 c_cookie=10563466204690357437 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77e00a54e0 tx=0x7f77d401dad0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.373 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.348+0000 7f77e5bd9640 1 -- 10.20.193.121:0/2712401104 shutdown_connections 2026-02-13T02:31:00.373 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.348+0000 7f77e5bd9640 1 --2- 10.20.193.121:0/2712401104 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f77e0056850 0x7f77e0168cd0 unknown :-1 s=CLOSED pgs=74 gs=2 cs=0 l=1 c_cookie=10563466204690357437 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.373 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.348+0000 7f77e5bd9640 1 --2- 10.20.193.121:0/2712401104 >> v2:10.20.193.178:3300/0 conn(0x7f77e01684a0 0x7f77e0058080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.373 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.348+0000 7f77e5bd9640 1 -- 10.20.193.121:0/2712401104 >> 10.20.193.121:0/2712401104 conn(0x7f77e00a16e0 msgr2=0x7f77e00bbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:00.373 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.348+0000 7f77e5bd9640 1 -- 10.20.193.121:0/2712401104 shutdown_connections 2026-02-13T02:31:00.373 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.348+0000 7f77e5bd9640 1 -- 10.20.193.121:0/2712401104 wait complete. 2026-02-13T02:31:00.373 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.348+0000 7f77e5bd9640 1 Processor -- start 2026-02-13T02:31:00.373 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.348+0000 7f77e5bd9640 1 -- start start 2026-02-13T02:31:00.374 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:spawning 4 to execute more jobs concurrently 2026-02-13T02:31:00.374 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:spawning new thread with name cloner.1770949860.3544087.0 2026-02-13T02:31:00.375 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:thread [cloner.1770949860.3544087.0] starting 2026-02-13T02:31:00.375 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-13T02:31:00.375 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:mgr_util:locked 2026-02-13T02:31:00.375 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-13T02:31:00.375 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:spawning new thread with name cloner.1770949860.3546364.1 2026-02-13T02:31:00.376 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77e5bd9640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f77e0056850 0x7f77e01435b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:00.376 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77e5bd9640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f77e01684a0 0x7f77e01451f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:00.376 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77e5bd9640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f77e0168870 0x7f77e0169cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:00.376 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77e5bd9640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7f77e00bd790 con 0x7f77e01684a0 2026-02-13T02:31:00.376 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77e5bd9640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7f77e00bd610 con 0x7f77e0056850 2026-02-13T02:31:00.376 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77e5bd9640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7f77e00bd910 con 0x7f77e0168870 2026-02-13T02:31:00.377 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:thread [cloner.1770949860.3546364.1] starting 2026-02-13T02:31:00.377 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77deffd640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f77e01684a0 0x7f77e01451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:00.377 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77deffd640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f77e01684a0 0x7f77e01451f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:38750/0 (socket says 10.20.193.121:38750) 2026-02-13T02:31:00.377 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77deffd640 1 -- 10.20.193.121:0/2300724412 learned_addr learned my addr 10.20.193.121:0/2300724412 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:00.378 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:spawning new thread with name cloner.1770949860.3547513.2 2026-02-13T02:31:00.378 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77df7fe640 1 --2- 10.20.193.121:0/2300724412 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f77e0056850 0x7f77e01435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:00.378 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77dffff640 1 --2- 10.20.193.121:0/2300724412 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f77e0168870 0x7f77e0169cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:00.379 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-13T02:31:00.379 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:thread [cloner.1770949860.3547513.2] starting 2026-02-13T02:31:00.379 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77deffd640 1 -- 10.20.193.121:0/2300724412 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f77e0168870 msgr2=0x7f77e0169cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:00.379 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77deffd640 1 --2- 10.20.193.121:0/2300724412 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f77e0168870 0x7f77e0169cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.380 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77deffd640 1 -- 10.20.193.121:0/2300724412 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f77e0056850 msgr2=0x7f77e01435b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:00.380 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77deffd640 1 --2- 10.20.193.121:0/2300724412 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f77e0056850 0x7f77e01435b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.380 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77deffd640 1 -- 10.20.193.121:0/2300724412 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e0131970 con 0x7f77e01684a0 2026-02-13T02:31:00.380 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:mgr_util:locked 2026-02-13T02:31:00.380 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:spawning new thread with name cloner.1770949860.3549042.3 2026-02-13T02:31:00.381 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77deffd640 1 --2- 10.20.193.121:0/2300724412 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f77e01684a0 0x7f77e01451f0 secure :-1 s=READY pgs=76 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77d000c4f0 tx=0x7f77d000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:00.381 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-13T02:31:00.382 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77bbfff640 1 -- 10.20.193.121:0/2300724412 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f77d0017070 con 0x7f77e01684a0 2026-02-13T02:31:00.382 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77bbfff640 1 -- 10.20.193.121:0/2300724412 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77d00036f0 con 0x7f77e01684a0 2026-02-13T02:31:00.382 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77e5bd9640 1 -- 10.20.193.121:0/2300724412 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e0131c50 con 0x7f77e01684a0 2026-02-13T02:31:00.382 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77bbfff640 1 -- 10.20.193.121:0/2300724412 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f77d0005590 con 0x7f77e01684a0 2026-02-13T02:31:00.382 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77e5bd9640 1 -- 10.20.193.121:0/2300724412 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e0132210 con 0x7f77e01684a0 2026-02-13T02:31:00.383 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-13T02:31:00.383 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:thread [cloner.1770949860.3549042.3] starting 2026-02-13T02:31:00.383 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:user is not opted-in 2026-02-13T02:31:00.383 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:mgr_util:locked 2026-02-13T02:31:00.383 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77e5bd9640 1 -- 10.20.193.121:0/2300724412 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77e014e640 con 0x7f77e01684a0 2026-02-13T02:31:00.384 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77bbfff640 1 -- 10.20.193.121:0/2300724412 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 2) ==== 50154+0+0 (secure 0 0 0) 0x7f77d0003b20 con 0x7f77e01684a0 2026-02-13T02:31:00.384 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-13T02:31:00.384 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:tick thread cloner.tick starting 2026-02-13T02:31:00.385 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:Waiting for mgr to warm up 2026-02-13T02:31:00.385 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-13T02:31:00.385 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:spawning 4 to execute more jobs concurrently 2026-02-13T02:31:00.385 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77bbfff640 1 -- 10.20.193.121:0/2300724412 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f77d004ed90 con 0x7f77e01684a0 2026-02-13T02:31:00.386 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-13T02:31:00.386 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:spawning new thread with name purgejob.1770949860.355857.0 2026-02-13T02:31:00.386 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:mgr_util:locked 2026-02-13T02:31:00.386 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:thread [purgejob.1770949860.355857.0] starting 2026-02-13T02:31:00.386 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-13T02:31:00.387 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:spawning new thread with name purgejob.1770949860.356089.1 2026-02-13T02:31:00.387 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-13T02:31:00.387 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:mgr_util:locked 2026-02-13T02:31:00.387 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:mgr_util:locked 2026-02-13T02:31:00.387 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:thread [purgejob.1770949860.356089.1] starting 2026-02-13T02:31:00.387 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:spawning new thread with name purgejob.1770949860.356363.2 2026-02-13T02:31:00.387 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-13T02:31:00.387 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.352+0000 7f77bbfff640 1 -- 10.20.193.121:0/2300724412 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f77d0033f00 con 0x7f77e01684a0 2026-02-13T02:31:00.389 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-13T02:31:00.389 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:thread [purgejob.1770949860.356363.2] starting 2026-02-13T02:31:00.389 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:mgr_util:locked 2026-02-13T02:31:00.389 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:spawning new thread with name purgejob.1770949860.3565989.3 2026-02-13T02:31:00.389 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-13T02:31:00.389 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-13T02:31:00.389 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:thread [purgejob.1770949860.3565989.3] starting 2026-02-13T02:31:00.389 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:mgr_util:locked 2026-02-13T02:31:00.389 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-13T02:31:00.389 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:tick thread purgejob.tick starting 2026-02-13T02:31:00.389 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-13T02:31:00.389 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-13T02:31:00.390 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:mgr_util:locked 2026-02-13T02:31:00.390 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-13T02:31:00.390 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:mgr_util:locked 2026-02-13T02:31:00.390 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.380+0000 7f77e5bd9640 1 -- 10.20.193.121:0/2300724412 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f77e0168cd0 con 0x7f77e01684a0 2026-02-13T02:31:00.390 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.380+0000 7f77bbfff640 1 -- 10.20.193.121:0/2300724412 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v23) ==== 59+0+1472 (secure 0 0 0) 0x7f77e014e640 con 0x7f77e01684a0 2026-02-13T02:31:00.390 INFO:teuthology.orchestra.run.trial121.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-13T02:31:00.391 INFO:teuthology.orchestra.run.trial121.stdout:mon advanced mon_op_complaint_time 120 2026-02-13T02:31:00.391 INFO:teuthology.orchestra.run.trial121.stdout:mgr advanced client_mount_timeout 30 2026-02-13T02:31:00.391 INFO:teuthology.orchestra.run.trial121.stdout:mgr advanced debug_client 20/20 2026-02-13T02:31:00.391 INFO:teuthology.orchestra.run.trial121.stdout:mgr advanced debug_mgr 20/20 2026-02-13T02:31:00.391 INFO:teuthology.orchestra.run.trial121.stdout:mgr advanced debug_ms 1/1 2026-02-13T02:31:00.391 INFO:teuthology.orchestra.run.trial121.stdout:mgr dev mon_warn_on_pool_no_app false 2026-02-13T02:31:00.391 INFO:teuthology.orchestra.run.trial121.stdout:osd advanced osd_op_complaint_time 180.000000 2026-02-13T02:31:00.391 INFO:teuthology.orchestra.run.trial121.stdout:mds advanced debug_mds 20/20 2026-02-13T02:31:00.391 INFO:teuthology.orchestra.run.trial121.stdout:mds advanced debug_mds_balancer 20/20 2026-02-13T02:31:00.391 INFO:teuthology.orchestra.run.trial121.stdout:mds advanced debug_ms 2/2 2026-02-13T02:31:00.391 INFO:teuthology.orchestra.run.trial121.stdout:mds dev mds_debug_frag true 2026-02-13T02:31:00.391 INFO:teuthology.orchestra.run.trial121.stdout:mds dev mds_debug_scatterstat true 2026-02-13T02:31:00.391 INFO:teuthology.orchestra.run.trial121.stdout:mds advanced mds_op_complaint_time 180.000000 2026-02-13T02:31:00.391 INFO:teuthology.orchestra.run.trial121.stdout:mds dev mds_verify_scatter true 2026-02-13T02:31:00.391 INFO:teuthology.orchestra.run.trial121.stdout:mds advanced osd_op_complaint_time 180.000000 2026-02-13T02:31:00.392 INFO:teuthology.orchestra.run.trial121.stdout:mds advanced rados_mon_op_timeout 900 2026-02-13T02:31:00.392 INFO:teuthology.orchestra.run.trial121.stdout:mds advanced rados_osd_op_timeout 900 2026-02-13T02:31:00.392 INFO:teuthology.orchestra.run.trial121.stdout:client advanced client_mount_timeout 600 2026-02-13T02:31:00.392 INFO:teuthology.orchestra.run.trial121.stdout:client advanced debug_client 20/20 2026-02-13T02:31:00.392 INFO:teuthology.orchestra.run.trial121.stdout:client advanced debug_ms 1/1 2026-02-13T02:31:00.392 INFO:teuthology.orchestra.run.trial121.stdout:client advanced rados_mon_op_timeout 900 2026-02-13T02:31:00.392 INFO:teuthology.orchestra.run.trial121.stdout:client advanced rados_osd_op_timeout 900 2026-02-13T02:31:00.393 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.380+0000 7f77e5bd9640 1 -- 10.20.193.121:0/2300724412 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f77e01684a0 msgr2=0x7f77e01451f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:00.393 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.380+0000 7f77e5bd9640 1 --2- 10.20.193.121:0/2300724412 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f77e01684a0 0x7f77e01451f0 secure :-1 s=READY pgs=76 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77d000c4f0 tx=0x7f77d000c9b0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.393 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.380+0000 7f77e5bd9640 1 -- 10.20.193.121:0/2300724412 shutdown_connections 2026-02-13T02:31:00.393 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.380+0000 7f77e5bd9640 1 --2- 10.20.193.121:0/2300724412 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f77e0168870 0x7f77e0169cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.393 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.380+0000 7f77e5bd9640 1 --2- 10.20.193.121:0/2300724412 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f77e01684a0 0x7f77e01451f0 unknown :-1 s=CLOSED pgs=76 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.393 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.380+0000 7f77e5bd9640 1 --2- 10.20.193.121:0/2300724412 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f77e0056850 0x7f77e01435b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.393 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.380+0000 7f77e5bd9640 1 -- 10.20.193.121:0/2300724412 >> 10.20.193.121:0/2300724412 conn(0x7f77e00a16e0 msgr2=0x7f77e00a2420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:00.393 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.380+0000 7f77e5bd9640 1 -- 10.20.193.121:0/2300724412 shutdown_connections 2026-02-13T02:31:00.393 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.380+0000 7f77e5bd9640 1 -- 10.20.193.121:0/2300724412 wait complete. 2026-02-13T02:31:00.399 INFO:tasks.ceph:Setting crush tunables to default 2026-02-13T02:31:00.399 DEBUG:teuthology.orchestra.run.trial121:> sudo ceph --cluster ceph osd crush tunables default 2026-02-13T02:31:00.461 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f19ae7640 1 -- 10.20.193.121:0/3534965570 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f3ef80040d0 msgr2=0x7f3ef80048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:00.461 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f19ae7640 1 --2- 10.20.193.121:0/3534965570 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f3ef80040d0 0x7f3ef80048d0 secure :-1 s=READY pgs=78 gs=4 cs=0 l=1 c_cookie=7682532823073916439 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f04005fd0 tx=0x7f3f0401d310 comp rx=0 tx=0).stop 2026-02-13T02:31:00.461 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f13fff640 1 -- 10.20.193.121:0/3534965570 reap_dead start 2026-02-13T02:31:00.461 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f19ae7640 1 -- 10.20.193.121:0/3534965570 shutdown_connections 2026-02-13T02:31:00.461 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f19ae7640 1 -- 10.20.193.121:0/3534965570 >> 10.20.193.121:0/3534965570 conn(0x7f3f14057b80 msgr2=0x7f3f1409ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:00.462 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f19ae7640 1 -- 10.20.193.121:0/3534965570 shutdown_connections 2026-02-13T02:31:00.462 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f19ae7640 1 -- 10.20.193.121:0/3534965570 wait complete. 2026-02-13T02:31:00.465 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f19ae7640 1 Processor -- start 2026-02-13T02:31:00.465 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f19ae7640 1 -- start start 2026-02-13T02:31:00.465 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f19ae7640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f3ef80040d0 0x7f3f141225a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:00.465 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f19ae7640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f3f1405c480 0x7f3f1412d780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:00.465 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f19ae7640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f3f141614b0 0x7f3f14161920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:00.465 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f19ae7640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1405e880 con 0x7f3f1405c480 2026-02-13T02:31:00.465 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f19ae7640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1405e700 con 0x7f3ef80040d0 2026-02-13T02:31:00.466 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f19ae7640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7f3f1405ea00 con 0x7f3f141614b0 2026-02-13T02:31:00.466 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f12ffd640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f3f1405c480 0x7f3f1412d780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:00.466 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f12ffd640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f3f1405c480 0x7f3f1412d780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:38754/0 (socket says 10.20.193.121:38754) 2026-02-13T02:31:00.466 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f12ffd640 1 -- 10.20.193.121:0/288019340 learned_addr learned my addr 10.20.193.121:0/288019340 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:00.466 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f137fe640 1 --2- 10.20.193.121:0/288019340 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f3ef80040d0 0x7f3f141225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:00.466 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f13fff640 1 --2- 10.20.193.121:0/288019340 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f3f141614b0 0x7f3f14161920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:00.466 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f12ffd640 1 -- 10.20.193.121:0/288019340 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f3f141614b0 msgr2=0x7f3f14161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:00.466 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f12ffd640 1 --2- 10.20.193.121:0/288019340 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f3f141614b0 0x7f3f14161920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.466 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f12ffd640 1 -- 10.20.193.121:0/288019340 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f3ef80040d0 msgr2=0x7f3f141225a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:00.466 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f12ffd640 1 --2- 10.20.193.121:0/288019340 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f3ef80040d0 0x7f3f141225a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.467 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f12ffd640 1 -- 10.20.193.121:0/288019340 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1411e5e0 con 0x7f3f1405c480 2026-02-13T02:31:00.467 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.452+0000 7f3f12ffd640 1 --2- 10.20.193.121:0/288019340 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f3f1405c480 0x7f3f1412d780 secure :-1 s=READY pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f040af040 tx=0x7f3f04005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:00.467 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.456+0000 7f3eeffff640 1 -- 10.20.193.121:0/288019340 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f040b1040 con 0x7f3f1405c480 2026-02-13T02:31:00.467 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.456+0000 7f3eeffff640 1 -- 10.20.193.121:0/288019340 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f040ac7d0 con 0x7f3f1405c480 2026-02-13T02:31:00.467 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.456+0000 7f3f19ae7640 1 -- 10.20.193.121:0/288019340 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f1411e860 con 0x7f3f1405c480 2026-02-13T02:31:00.467 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.456+0000 7f3eeffff640 1 -- 10.20.193.121:0/288019340 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f040acbc0 con 0x7f3f1405c480 2026-02-13T02:31:00.467 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.456+0000 7f3f19ae7640 1 -- 10.20.193.121:0/288019340 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f1411ee20 con 0x7f3f1405c480 2026-02-13T02:31:00.467 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.456+0000 7f3eeffff640 1 -- 10.20.193.121:0/288019340 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 2) ==== 50154+0+0 (secure 0 0 0) 0x7f3f040026e0 con 0x7f3f1405c480 2026-02-13T02:31:00.467 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.456+0000 7f3eeffff640 1 -- 10.20.193.121:0/288019340 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f3f040eaca0 con 0x7f3f1405c480 2026-02-13T02:31:00.467 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.456+0000 7f3f19ae7640 1 -- 10.20.193.121:0/288019340 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f140b9ad0 con 0x7f3f1405c480 2026-02-13T02:31:00.467 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.456+0000 7f3eeffff640 1 -- 10.20.193.121:0/288019340 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f3f1411e5e0 con 0x7f3f1405c480 2026-02-13T02:31:00.493 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.484+0000 7f3f19ae7640 1 -- 10.20.193.121:0/288019340 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f3f140a0a40 con 0x7f3f1405c480 2026-02-13T02:31:00.495 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.488+0000 7f3eeffff640 1 -- 10.20.193.121:0/288019340 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f3f040ba020 con 0x7f3f1405c480 2026-02-13T02:31:00.495 INFO:teuthology.orchestra.run.trial121.stderr:adjusted tunables profile to default 2026-02-13T02:31:00.496 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.488+0000 7f3f19ae7640 1 -- 10.20.193.121:0/288019340 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f3f1405c480 msgr2=0x7f3f1412d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:00.496 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.488+0000 7f3f19ae7640 1 --2- 10.20.193.121:0/288019340 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f3f1405c480 0x7f3f1412d780 secure :-1 s=READY pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f040af040 tx=0x7f3f04005de0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.496 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.488+0000 7f3f19ae7640 1 -- 10.20.193.121:0/288019340 shutdown_connections 2026-02-13T02:31:00.496 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.488+0000 7f3f19ae7640 1 --2- 10.20.193.121:0/288019340 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f3f141614b0 0x7f3f14161920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.496 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.488+0000 7f3f19ae7640 1 --2- 10.20.193.121:0/288019340 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f3f1405c480 0x7f3f1412d780 unknown :-1 s=CLOSED pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.496 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.488+0000 7f3f19ae7640 1 --2- 10.20.193.121:0/288019340 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f3ef80040d0 0x7f3f141225a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.496 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.488+0000 7f3f19ae7640 1 -- 10.20.193.121:0/288019340 >> 10.20.193.121:0/288019340 conn(0x7f3f14057b80 msgr2=0x7f3f14130220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:00.496 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.488+0000 7f3f19ae7640 1 -- 10.20.193.121:0/288019340 shutdown_connections 2026-02-13T02:31:00.496 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:00.488+0000 7f3f19ae7640 1 -- 10.20.193.121:0/288019340 wait complete. 2026-02-13T02:31:00.506 INFO:tasks.ceph:check_enable_crimson: False 2026-02-13T02:31:00.506 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-13T02:31:00.507 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:31:00.507 DEBUG:teuthology.orchestra.run.trial121:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-13T02:31:00.518 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:31:00.518 DEBUG:teuthology.orchestra.run.trial121:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-13T02:31:00.567 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:31:00.567 DEBUG:teuthology.orchestra.run.trial121:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-13T02:31:00.618 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:31:00.618 DEBUG:teuthology.orchestra.run.trial121:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-13T02:31:00.666 DEBUG:teuthology.orchestra.run.trial178:> set -ex 2026-02-13T02:31:00.666 DEBUG:teuthology.orchestra.run.trial178:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-13T02:31:00.678 DEBUG:teuthology.orchestra.run.trial178:> set -ex 2026-02-13T02:31:00.678 DEBUG:teuthology.orchestra.run.trial178:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-13T02:31:00.729 DEBUG:teuthology.orchestra.run.trial178:> set -ex 2026-02-13T02:31:00.729 DEBUG:teuthology.orchestra.run.trial178:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2026-02-13T02:31:00.778 DEBUG:teuthology.orchestra.run.trial178:> set -ex 2026-02-13T02:31:00.778 DEBUG:teuthology.orchestra.run.trial178:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2026-02-13T02:31:00.830 DEBUG:teuthology.orchestra.run.trial178:> sudo ceph --cluster ceph osd new 1bbcd75b-e678-4cb7-b625-1475960a9cb7 0 2026-02-13T02:31:00.936 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.931+0000 7f61c2bbf640 1 -- 10.20.193.178:0/1715761275 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f61bc15b8c0 msgr2=0x7f61bc0b7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:00.937 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.931+0000 7f61c2bbf640 1 --2- 10.20.193.178:0/1715761275 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f61bc15b8c0 0x7f61bc0b7b90 secure :-1 s=READY pgs=46 gs=3 cs=0 l=1 c_cookie=13764944448280594587 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61ac005eb0 tx=0x7f61ac01c9a0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.937 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.931+0000 7f61c2bbf640 1 -- 10.20.193.178:0/1715761275 shutdown_connections 2026-02-13T02:31:00.937 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.931+0000 7f61c2bbf640 1 --2- 10.20.193.178:0/1715761275 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f61bc15b8c0 0x7f61bc0b7b90 unknown :-1 s=CLOSED pgs=46 gs=3 cs=0 l=1 c_cookie=13764944448280594587 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.937 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.931+0000 7f61c2bbf640 1 -- 10.20.193.178:0/1715761275 >> 10.20.193.178:0/1715761275 conn(0x7f61bc058ac0 msgr2=0x7f61bc0a09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:00.937 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.931+0000 7f61c2bbf640 1 -- 10.20.193.178:0/1715761275 shutdown_connections 2026-02-13T02:31:00.937 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.931+0000 7f61c2bbf640 1 -- 10.20.193.178:0/1715761275 wait complete. 2026-02-13T02:31:00.940 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.931+0000 7f61c2bbf640 1 Processor -- start 2026-02-13T02:31:00.940 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.931+0000 7f61c2bbf640 1 -- start start 2026-02-13T02:31:00.940 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61c2bbf640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f61bc0b80d0 0x7f61bc17ae00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:00.940 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61c2bbf640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f61bc15b8c0 0x7f61bc15ad30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:00.940 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61c2bbf640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f61bc168d50 0x7f61bc05bf80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:00.940 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61c2bbf640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc054950 con 0x7f61bc0b80d0 2026-02-13T02:31:00.940 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61c2bbf640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc0547d0 con 0x7f61bc168d50 2026-02-13T02:31:00.940 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61c2bbf640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7f61bc1cd7e0 con 0x7f61bc15b8c0 2026-02-13T02:31:00.940 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61b3fff640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f61bc15b8c0 0x7f61bc15ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:00.941 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61b3fff640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f61bc15b8c0 0x7f61bc15ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.178:3301/0 says I am v2:10.20.193.178:34564/0 (socket says 10.20.193.178:34564) 2026-02-13T02:31:00.941 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61b3fff640 1 -- 10.20.193.178:0/1882688134 learned_addr learned my addr 10.20.193.178:0/1882688134 (peer_addr_for_me v2:10.20.193.178:0/0) 2026-02-13T02:31:00.941 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61c1135640 1 --2- 10.20.193.178:0/1882688134 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f61bc168d50 0x7f61bc05bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:00.941 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61b3fff640 1 -- 10.20.193.178:0/1882688134 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f61bc168d50 msgr2=0x7f61bc05bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:00.941 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61b3fff640 1 --2- 10.20.193.178:0/1882688134 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f61bc168d50 0x7f61bc05bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.941 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61b3fff640 1 -- 10.20.193.178:0/1882688134 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f61bc0b80d0 msgr2=0x7f61bc17ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:00.941 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61b3fff640 1 --2- 10.20.193.178:0/1882688134 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f61bc0b80d0 0x7f61bc17ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.941 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61b3fff640 1 -- 10.20.193.178:0/1882688134 --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61bc05c4c0 con 0x7f61bc15b8c0 2026-02-13T02:31:00.941 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61b3fff640 1 --2- 10.20.193.178:0/1882688134 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f61bc15b8c0 0x7f61bc15ad30 secure :-1 s=READY pgs=15 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61a400c760 tx=0x7f61a400cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:00.941 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61b17fa640 1 -- 10.20.193.178:0/1882688134 <== mon.2 v2:10.20.193.178:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61a4006af0 con 0x7f61bc15b8c0 2026-02-13T02:31:00.941 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61b17fa640 1 -- 10.20.193.178:0/1882688134 <== mon.2 v2:10.20.193.178:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61a4006d80 con 0x7f61bc15b8c0 2026-02-13T02:31:00.941 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61b17fa640 1 -- 10.20.193.178:0/1882688134 <== mon.2 v2:10.20.193.178:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61a40072b0 con 0x7f61bc15b8c0 2026-02-13T02:31:00.942 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61c2bbf640 1 -- 10.20.193.178:0/1882688134 --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61bc05d160 con 0x7f61bc15b8c0 2026-02-13T02:31:00.942 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61c2bbf640 1 -- 10.20.193.178:0/1882688134 --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f61bc05b780 con 0x7f61bc15b8c0 2026-02-13T02:31:00.942 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61c2bbf640 1 -- 10.20.193.178:0/1882688134 --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61bc0b7b90 con 0x7f61bc15b8c0 2026-02-13T02:31:00.942 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61b17fa640 1 -- 10.20.193.178:0/1882688134 <== mon.2 v2:10.20.193.178:3301/0 4 ==== mgrmap(e 2) ==== 50154+0+0 (secure 0 0 0) 0x7f61a4023060 con 0x7f61bc15b8c0 2026-02-13T02:31:00.942 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61b17fa640 1 -- 10.20.193.178:0/1882688134 <== mon.2 v2:10.20.193.178:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 720+0+0 (secure 0 0 0) 0x7f61a404fa00 con 0x7f61bc15b8c0 2026-02-13T02:31:00.942 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.935+0000 7f61b17fa640 1 -- 10.20.193.178:0/1882688134 <== mon.2 v2:10.20.193.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f61a4016a00 con 0x7f61bc15b8c0 2026-02-13T02:31:00.973 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.967+0000 7f61c2bbf640 1 -- 10.20.193.178:0/1882688134 --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1bbcd75b-e678-4cb7-b625-1475960a9cb7", "id": 0} v 0) -- 0x7f61bc168a20 con 0x7f61bc15b8c0 2026-02-13T02:31:00.975 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.971+0000 7f61b17fa640 1 -- 10.20.193.178:0/1882688134 <== mon.2 v2:10.20.193.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1bbcd75b-e678-4cb7-b625-1475960a9cb7", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f61a4014bb0 con 0x7f61bc15b8c0 2026-02-13T02:31:00.976 INFO:teuthology.orchestra.run.trial178.stdout:0 2026-02-13T02:31:00.977 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.971+0000 7f61c2bbf640 1 -- 10.20.193.178:0/1882688134 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f61bc15b8c0 msgr2=0x7f61bc15ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:00.977 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.971+0000 7f61c2bbf640 1 --2- 10.20.193.178:0/1882688134 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f61bc15b8c0 0x7f61bc15ad30 secure :-1 s=READY pgs=15 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61a400c760 tx=0x7f61a400cc20 comp rx=0 tx=0).stop 2026-02-13T02:31:00.977 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.971+0000 7f61c2bbf640 1 -- 10.20.193.178:0/1882688134 shutdown_connections 2026-02-13T02:31:00.977 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.971+0000 7f61c2bbf640 1 --2- 10.20.193.178:0/1882688134 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f61bc168d50 0x7f61bc05bf80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.977 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.971+0000 7f61c2bbf640 1 --2- 10.20.193.178:0/1882688134 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f61bc15b8c0 0x7f61bc15ad30 unknown :-1 s=CLOSED pgs=15 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.977 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.971+0000 7f61c2bbf640 1 --2- 10.20.193.178:0/1882688134 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f61bc0b80d0 0x7f61bc17ae00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:00.977 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.971+0000 7f61c2bbf640 1 -- 10.20.193.178:0/1882688134 >> 10.20.193.178:0/1882688134 conn(0x7f61bc058ac0 msgr2=0x7f61bc163f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:00.977 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.971+0000 7f61c2bbf640 1 -- 10.20.193.178:0/1882688134 shutdown_connections 2026-02-13T02:31:00.978 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:00.971+0000 7f61c2bbf640 1 -- 10.20.193.178:0/1882688134 wait complete. 2026-02-13T02:31:00.987 DEBUG:teuthology.orchestra.run.trial178:> sudo ceph --cluster ceph osd new 8e4f3373-8bf0-4119-9e36-38ae77f57ad1 1 2026-02-13T02:31:01.050 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc2f0e640 1 -- 10.20.193.178:0/4164637995 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7effbc056680 msgr2=0x7effbc09de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.050 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc2f0e640 1 --2- 10.20.193.178:0/4164637995 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7effbc056680 0x7effbc09de20 secure :-1 s=READY pgs=16 gs=3 cs=0 l=1 c_cookie=9493004363963458917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7effb800a750 tx=0x7effb801dbd0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.050 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc2f0e640 1 -- 10.20.193.178:0/4164637995 shutdown_connections 2026-02-13T02:31:01.050 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc2f0e640 1 --2- 10.20.193.178:0/4164637995 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7effbc056680 0x7effbc09de20 unknown :-1 s=CLOSED pgs=16 gs=3 cs=0 l=1 c_cookie=9493004363963458917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.051 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc2f0e640 1 --2- 10.20.193.178:0/4164637995 >> v2:10.20.193.178:3300/0 conn(0x7effbc058080 0x7effbc056140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.051 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc2f0e640 1 -- 10.20.193.178:0/4164637995 >> 10.20.193.178:0/4164637995 conn(0x7effbc0a16e0 msgr2=0x7effbc0bbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:01.051 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc2f0e640 1 -- 10.20.193.178:0/4164637995 shutdown_connections 2026-02-13T02:31:01.051 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc2f0e640 1 -- 10.20.193.178:0/4164637995 wait complete. 2026-02-13T02:31:01.053 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc2f0e640 1 Processor -- start 2026-02-13T02:31:01.053 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc2f0e640 1 -- start start 2026-02-13T02:31:01.054 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc2f0e640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7effbc056680 0x7effbc14edd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.054 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc2f0e640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7effbc058080 0x7effbc1333f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.054 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc2f0e640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7effbc1684a0 0x7effbc14bde0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.054 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc2f0e640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7effbc0be590 con 0x7effbc1684a0 2026-02-13T02:31:01.054 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc2f0e640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7effbc0be410 con 0x7effbc056680 2026-02-13T02:31:01.054 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc2f0e640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7effbc0be710 con 0x7effbc058080 2026-02-13T02:31:01.054 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc0c83640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7effbc056680 0x7effbc14edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:01.054 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc0c83640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7effbc056680 0x7effbc14edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.178:3300/0 says I am v2:10.20.193.178:37952/0 (socket says 10.20.193.178:37952) 2026-02-13T02:31:01.054 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc0c83640 1 -- 10.20.193.178:0/2132042384 learned_addr learned my addr 10.20.193.178:0/2132042384 (peer_addr_for_me v2:10.20.193.178:0/0) 2026-02-13T02:31:01.054 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effb3fff640 1 --2- 10.20.193.178:0/2132042384 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7effbc058080 0x7effbc1333f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:01.054 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc0c83640 1 -- 10.20.193.178:0/2132042384 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7effbc058080 msgr2=0x7effbc1333f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.054 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc0c83640 1 --2- 10.20.193.178:0/2132042384 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7effbc058080 0x7effbc1333f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.055 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc0c83640 1 -- 10.20.193.178:0/2132042384 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7effbc1684a0 msgr2=0x7effbc14bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.055 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc0c83640 1 --2- 10.20.193.178:0/2132042384 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7effbc1684a0 0x7effbc14bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.055 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc0c83640 1 -- 10.20.193.178:0/2132042384 --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effbc14ae40 con 0x7effbc056680 2026-02-13T02:31:01.055 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc0c83640 1 --2- 10.20.193.178:0/2132042384 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7effbc056680 0x7effbc14edd0 secure :-1 s=READY pgs=48 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7effac00c500 tx=0x7effac00c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:01.055 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effb17fa640 1 -- 10.20.193.178:0/2132042384 <== mon.1 v2:10.20.193.178:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7effac006af0 con 0x7effbc056680 2026-02-13T02:31:01.055 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effb17fa640 1 -- 10.20.193.178:0/2132042384 <== mon.1 v2:10.20.193.178:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7effac006c90 con 0x7effbc056680 2026-02-13T02:31:01.055 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc2f0e640 1 -- 10.20.193.178:0/2132042384 --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effbc136cc0 con 0x7effbc056680 2026-02-13T02:31:01.055 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effb17fa640 1 -- 10.20.193.178:0/2132042384 <== mon.1 v2:10.20.193.178:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7effac007290 con 0x7effbc056680 2026-02-13T02:31:01.055 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc2f0e640 1 -- 10.20.193.178:0/2132042384 --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effbc132bf0 con 0x7effbc056680 2026-02-13T02:31:01.055 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effb17fa640 1 -- 10.20.193.178:0/2132042384 <== mon.1 v2:10.20.193.178:3300/0 4 ==== mgrmap(e 2) ==== 50154+0+0 (secure 0 0 0) 0x7effac007430 con 0x7effbc056680 2026-02-13T02:31:01.055 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effc2f0e640 1 -- 10.20.193.178:0/2132042384 --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effbc09de20 con 0x7effbc056680 2026-02-13T02:31:01.056 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effb17fa640 1 -- 10.20.193.178:0/2132042384 <== mon.1 v2:10.20.193.178:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 835+0+0 (secure 0 0 0) 0x7effac04f170 con 0x7effbc056680 2026-02-13T02:31:01.056 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.047+0000 7effb17fa640 1 -- 10.20.193.178:0/2132042384 <== mon.1 v2:10.20.193.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7effbc14ae40 con 0x7effbc056680 2026-02-13T02:31:01.086 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.083+0000 7effc2f0e640 1 -- 10.20.193.178:0/2132042384 --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8e4f3373-8bf0-4119-9e36-38ae77f57ad1", "id": 1} v 0) -- 0x7effbc14f7c0 con 0x7effbc056680 2026-02-13T02:31:01.089 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.083+0000 7effb17fa640 1 -- 10.20.193.178:0/2132042384 <== mon.1 v2:10.20.193.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8e4f3373-8bf0-4119-9e36-38ae77f57ad1", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7effac010d60 con 0x7effbc056680 2026-02-13T02:31:01.089 INFO:teuthology.orchestra.run.trial178.stdout:1 2026-02-13T02:31:01.090 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.083+0000 7effc2f0e640 1 -- 10.20.193.178:0/2132042384 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7effbc056680 msgr2=0x7effbc14edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.090 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.083+0000 7effc2f0e640 1 --2- 10.20.193.178:0/2132042384 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7effbc056680 0x7effbc14edd0 secure :-1 s=READY pgs=48 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7effac00c500 tx=0x7effac00c900 comp rx=0 tx=0).stop 2026-02-13T02:31:01.090 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.083+0000 7effc2f0e640 1 -- 10.20.193.178:0/2132042384 shutdown_connections 2026-02-13T02:31:01.090 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.083+0000 7effc2f0e640 1 --2- 10.20.193.178:0/2132042384 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7effbc1684a0 0x7effbc14bde0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.090 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.083+0000 7effc2f0e640 1 --2- 10.20.193.178:0/2132042384 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7effbc058080 0x7effbc1333f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.090 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.083+0000 7effc2f0e640 1 --2- 10.20.193.178:0/2132042384 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7effbc056680 0x7effbc14edd0 unknown :-1 s=CLOSED pgs=48 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.090 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.083+0000 7effc2f0e640 1 -- 10.20.193.178:0/2132042384 >> 10.20.193.178:0/2132042384 conn(0x7effbc0a16e0 msgr2=0x7effbc14fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:01.090 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.083+0000 7effc2f0e640 1 -- 10.20.193.178:0/2132042384 shutdown_connections 2026-02-13T02:31:01.091 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.083+0000 7effc2f0e640 1 -- 10.20.193.178:0/2132042384 wait complete. 2026-02-13T02:31:01.098 DEBUG:teuthology.orchestra.run.trial178:> sudo ceph --cluster ceph osd new f88cfbd7-657c-42c3-848e-d41286534244 2 2026-02-13T02:31:01.166 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.159+0000 7fcc906cc640 1 -- 10.20.193.178:0/3596771460 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fcc88056850 msgr2=0x7fcc8809de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.166 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.159+0000 7fcc906cc640 1 --2- 10.20.193.178:0/3596771460 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fcc88056850 0x7fcc8809de20 secure :-1 s=READY pgs=17 gs=3 cs=0 l=1 c_cookie=6716145659734702950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc8400af10 tx=0x7fcc8401db30 comp rx=0 tx=0).stop 2026-02-13T02:31:01.166 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc906cc640 1 -- 10.20.193.178:0/3596771460 shutdown_connections 2026-02-13T02:31:01.166 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc906cc640 1 --2- 10.20.193.178:0/3596771460 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fcc88056850 0x7fcc8809de20 unknown :-1 s=CLOSED pgs=17 gs=3 cs=0 l=1 c_cookie=6716145659734702950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.166 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc906cc640 1 -- 10.20.193.178:0/3596771460 >> 10.20.193.178:0/3596771460 conn(0x7fcc880a16e0 msgr2=0x7fcc880bbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:01.167 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc906cc640 1 -- 10.20.193.178:0/3596771460 shutdown_connections 2026-02-13T02:31:01.167 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc906cc640 1 -- 10.20.193.178:0/3596771460 wait complete. 2026-02-13T02:31:01.167 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc906cc640 1 Processor -- start 2026-02-13T02:31:01.167 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc906cc640 1 -- start start 2026-02-13T02:31:01.169 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc906cc640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fcc88056850 0x7fcc8814dd40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.169 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc906cc640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fcc88058080 0x7fcc88137870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.169 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc906cc640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fcc881684a0 0x7fcc88134970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.170 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc906cc640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcc881d0980 con 0x7fcc88056850 2026-02-13T02:31:01.170 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc906cc640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7fcc881d0800 con 0x7fcc88058080 2026-02-13T02:31:01.170 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc906cc640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7fcc881d0b00 con 0x7fcc881684a0 2026-02-13T02:31:01.170 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc8ec42640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fcc881684a0 0x7fcc88134970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:01.170 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc8dc40640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fcc88058080 0x7fcc88137870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:01.170 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc8ec42640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fcc881684a0 0x7fcc88134970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.178:3301/0 says I am v2:10.20.193.178:34604/0 (socket says 10.20.193.178:34604) 2026-02-13T02:31:01.170 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc8ec42640 1 -- 10.20.193.178:0/3496928230 learned_addr learned my addr 10.20.193.178:0/3496928230 (peer_addr_for_me v2:10.20.193.178:0/0) 2026-02-13T02:31:01.170 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc8e441640 1 --2- 10.20.193.178:0/3496928230 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fcc88056850 0x7fcc8814dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:01.170 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc8ec42640 1 -- 10.20.193.178:0/3496928230 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fcc88058080 msgr2=0x7fcc88137870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.170 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc8ec42640 1 --2- 10.20.193.178:0/3496928230 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fcc88058080 0x7fcc88137870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.170 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc8ec42640 1 -- 10.20.193.178:0/3496928230 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fcc88056850 msgr2=0x7fcc8814dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.170 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc8ec42640 1 --2- 10.20.193.178:0/3496928230 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fcc88056850 0x7fcc8814dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.171 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc8ec42640 1 -- 10.20.193.178:0/3496928230 --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc88134470 con 0x7fcc881684a0 2026-02-13T02:31:01.171 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc8ec42640 1 --2- 10.20.193.178:0/3496928230 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fcc881684a0 0x7fcc88134970 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc8401e3d0 tx=0x7fcc8400a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:01.171 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc6effd640 1 -- 10.20.193.178:0/3496928230 <== mon.2 v2:10.20.193.178:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc84008500 con 0x7fcc881684a0 2026-02-13T02:31:01.171 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc6effd640 1 -- 10.20.193.178:0/3496928230 <== mon.2 v2:10.20.193.178:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc840086a0 con 0x7fcc881684a0 2026-02-13T02:31:01.171 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc906cc640 1 -- 10.20.193.178:0/3496928230 --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc88137fc0 con 0x7fcc881684a0 2026-02-13T02:31:01.171 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc6effd640 1 -- 10.20.193.178:0/3496928230 <== mon.2 v2:10.20.193.178:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc84008ab0 con 0x7fcc881684a0 2026-02-13T02:31:01.171 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc906cc640 1 -- 10.20.193.178:0/3496928230 --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc88138580 con 0x7fcc881684a0 2026-02-13T02:31:01.171 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc6effd640 1 -- 10.20.193.178:0/3496928230 <== mon.2 v2:10.20.193.178:3301/0 4 ==== mgrmap(e 2) ==== 50154+0+0 (secure 0 0 0) 0x7fcc840b6070 con 0x7fcc881684a0 2026-02-13T02:31:01.171 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc906cc640 1 -- 10.20.193.178:0/3496928230 --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc88134280 con 0x7fcc881684a0 2026-02-13T02:31:01.171 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc6effd640 1 -- 10.20.193.178:0/3496928230 <== mon.2 v2:10.20.193.178:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 950+0+0 (secure 0 0 0) 0x7fcc840ea6a0 con 0x7fcc881684a0 2026-02-13T02:31:01.171 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.163+0000 7fcc6effd640 1 -- 10.20.193.178:0/3496928230 <== mon.2 v2:10.20.193.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7fcc84017720 con 0x7fcc881684a0 2026-02-13T02:31:01.201 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.195+0000 7fcc906cc640 1 -- 10.20.193.178:0/3496928230 --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f88cfbd7-657c-42c3-848e-d41286534244", "id": 2} v 0) -- 0x7fcc8809de20 con 0x7fcc881684a0 2026-02-13T02:31:01.204 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.199+0000 7fcc6effd640 1 -- 10.20.193.178:0/3496928230 <== mon.2 v2:10.20.193.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f88cfbd7-657c-42c3-848e-d41286534244", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fcc840b3df0 con 0x7fcc881684a0 2026-02-13T02:31:01.204 INFO:teuthology.orchestra.run.trial178.stdout:2 2026-02-13T02:31:01.205 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.199+0000 7fcc906cc640 1 -- 10.20.193.178:0/3496928230 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fcc881684a0 msgr2=0x7fcc88134970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.205 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.199+0000 7fcc906cc640 1 --2- 10.20.193.178:0/3496928230 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fcc881684a0 0x7fcc88134970 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc8401e3d0 tx=0x7fcc8400a3f0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.205 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.199+0000 7fcc906cc640 1 -- 10.20.193.178:0/3496928230 shutdown_connections 2026-02-13T02:31:01.205 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.199+0000 7fcc906cc640 1 --2- 10.20.193.178:0/3496928230 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fcc881684a0 0x7fcc88134970 unknown :-1 s=CLOSED pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.205 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.199+0000 7fcc906cc640 1 --2- 10.20.193.178:0/3496928230 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fcc88058080 0x7fcc88137870 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.205 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.199+0000 7fcc906cc640 1 --2- 10.20.193.178:0/3496928230 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fcc88056850 0x7fcc8814dd40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.206 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.199+0000 7fcc906cc640 1 -- 10.20.193.178:0/3496928230 >> 10.20.193.178:0/3496928230 conn(0x7fcc880a16e0 msgr2=0x7fcc880bd630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:01.206 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.199+0000 7fcc906cc640 1 -- 10.20.193.178:0/3496928230 shutdown_connections 2026-02-13T02:31:01.206 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.199+0000 7fcc906cc640 1 -- 10.20.193.178:0/3496928230 wait complete. 2026-02-13T02:31:01.216 DEBUG:teuthology.orchestra.run.trial178:> sudo ceph --cluster ceph osd new e4972ad7-8b35-4f37-99b5-37c7eebb40c3 3 2026-02-13T02:31:01.279 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bc71dc640 1 -- 10.20.193.178:0/3819314465 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f7bc009bfe0 msgr2=0x7f7bc0099910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.280 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bc71dc640 1 --2- 10.20.193.178:0/3819314465 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f7bc009bfe0 0x7f7bc0099910 secure :-1 s=READY pgs=51 gs=3 cs=0 l=1 c_cookie=18192826287327100782 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ba8005eb0 tx=0x7f7ba801c9a0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.280 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bc71dc640 1 -- 10.20.193.178:0/3819314465 shutdown_connections 2026-02-13T02:31:01.280 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bc71dc640 1 --2- 10.20.193.178:0/3819314465 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f7bc009bfe0 0x7f7bc0099910 unknown :-1 s=CLOSED pgs=51 gs=3 cs=0 l=1 c_cookie=18192826287327100782 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.280 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bc71dc640 1 -- 10.20.193.178:0/3819314465 >> 10.20.193.178:0/3819314465 conn(0x7f7bc0057b80 msgr2=0x7f7bc009ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:01.280 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bc71dc640 1 -- 10.20.193.178:0/3819314465 shutdown_connections 2026-02-13T02:31:01.280 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bc71dc640 1 -- 10.20.193.178:0/3819314465 wait complete. 2026-02-13T02:31:01.280 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bc71dc640 1 Processor -- start 2026-02-13T02:31:01.280 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bc71dc640 1 -- start start 2026-02-13T02:31:01.283 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bc71dc640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f7bc0099e50 0x7f7bc011f560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.283 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bc71dc640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f7bc009bc10 0x7f7bc0123560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.283 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bc71dc640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f7bc009bfe0 0x7f7bc0135940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.283 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bc71dc640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc01ce6a0 con 0x7f7bc0099e50 2026-02-13T02:31:01.283 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bc71dc640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc01ce520 con 0x7f7bc009bc10 2026-02-13T02:31:01.283 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bc71dc640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7f7bc01ce820 con 0x7f7bc009bfe0 2026-02-13T02:31:01.284 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bb7fff640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f7bc009bc10 0x7f7bc0123560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:01.284 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bb7fff640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f7bc009bc10 0x7f7bc0123560 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.178:3300/0 says I am v2:10.20.193.178:37992/0 (socket says 10.20.193.178:37992) 2026-02-13T02:31:01.284 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bb7fff640 1 -- 10.20.193.178:0/3486783279 learned_addr learned my addr 10.20.193.178:0/3486783279 (peer_addr_for_me v2:10.20.193.178:0/0) 2026-02-13T02:31:01.284 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bc5752640 1 --2- 10.20.193.178:0/3486783279 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f7bc009bfe0 0x7f7bc0135940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:01.284 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bc4f51640 1 --2- 10.20.193.178:0/3486783279 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f7bc0099e50 0x7f7bc011f560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:01.284 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bb7fff640 1 -- 10.20.193.178:0/3486783279 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f7bc009bfe0 msgr2=0x7f7bc0135940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.284 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bb7fff640 1 --2- 10.20.193.178:0/3486783279 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f7bc009bfe0 0x7f7bc0135940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.284 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bb7fff640 1 -- 10.20.193.178:0/3486783279 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f7bc0099e50 msgr2=0x7f7bc011f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.284 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bb7fff640 1 --2- 10.20.193.178:0/3486783279 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f7bc0099e50 0x7f7bc011f560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.284 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bb7fff640 1 -- 10.20.193.178:0/3486783279 --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bc011fbb0 con 0x7f7bc009bc10 2026-02-13T02:31:01.284 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bb7fff640 1 --2- 10.20.193.178:0/3486783279 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f7bc009bc10 0x7f7bc0123560 secure :-1 s=READY pgs=52 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ba801cf10 tx=0x7f7ba80a5800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:01.285 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bb57fa640 1 -- 10.20.193.178:0/3486783279 <== mon.1 v2:10.20.193.178:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ba80bc070 con 0x7f7bc009bc10 2026-02-13T02:31:01.285 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bb57fa640 1 -- 10.20.193.178:0/3486783279 <== mon.1 v2:10.20.193.178:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ba80a5cd0 con 0x7f7bc009bc10 2026-02-13T02:31:01.285 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bc71dc640 1 -- 10.20.193.178:0/3486783279 --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bc011fe90 con 0x7f7bc009bc10 2026-02-13T02:31:01.285 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bb57fa640 1 -- 10.20.193.178:0/3486783279 <== mon.1 v2:10.20.193.178:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ba8002940 con 0x7f7bc009bc10 2026-02-13T02:31:01.285 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bc71dc640 1 -- 10.20.193.178:0/3486783279 --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bc0120450 con 0x7f7bc009bc10 2026-02-13T02:31:01.285 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bc71dc640 1 -- 10.20.193.178:0/3486783279 --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bc0099910 con 0x7f7bc009bc10 2026-02-13T02:31:01.285 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bb57fa640 1 -- 10.20.193.178:0/3486783279 <== mon.1 v2:10.20.193.178:3300/0 4 ==== mgrmap(e 2) ==== 50154+0+0 (secure 0 0 0) 0x7f7ba80ae470 con 0x7f7bc009bc10 2026-02-13T02:31:01.285 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.275+0000 7f7bb57fa640 1 -- 10.20.193.178:0/3486783279 <== mon.1 v2:10.20.193.178:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1065+0+0 (secure 0 0 0) 0x7f7ba80b4070 con 0x7f7bc009bc10 2026-02-13T02:31:01.285 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.279+0000 7f7bb57fa640 1 -- 10.20.193.178:0/3486783279 <== mon.1 v2:10.20.193.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f7ba8016590 con 0x7f7bc009bc10 2026-02-13T02:31:01.316 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.310+0000 7f7bc71dc640 1 -- 10.20.193.178:0/3486783279 --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e4972ad7-8b35-4f37-99b5-37c7eebb40c3", "id": 3} v 0) -- 0x7f7bc005ad10 con 0x7f7bc009bc10 2026-02-13T02:31:01.318 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.314+0000 7f7bb57fa640 1 -- 10.20.193.178:0/3486783279 <== mon.1 v2:10.20.193.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e4972ad7-8b35-4f37-99b5-37c7eebb40c3", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f7ba80a8a00 con 0x7f7bc009bc10 2026-02-13T02:31:01.319 INFO:teuthology.orchestra.run.trial178.stdout:3 2026-02-13T02:31:01.319 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.314+0000 7f7bc71dc640 1 -- 10.20.193.178:0/3486783279 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f7bc009bc10 msgr2=0x7f7bc0123560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.320 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.314+0000 7f7bc71dc640 1 --2- 10.20.193.178:0/3486783279 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f7bc009bc10 0x7f7bc0123560 secure :-1 s=READY pgs=52 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ba801cf10 tx=0x7f7ba80a5800 comp rx=0 tx=0).stop 2026-02-13T02:31:01.320 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.314+0000 7f7bc71dc640 1 -- 10.20.193.178:0/3486783279 shutdown_connections 2026-02-13T02:31:01.320 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.314+0000 7f7bc71dc640 1 --2- 10.20.193.178:0/3486783279 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f7bc009bfe0 0x7f7bc0135940 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.320 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.314+0000 7f7bc71dc640 1 --2- 10.20.193.178:0/3486783279 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f7bc009bc10 0x7f7bc0123560 unknown :-1 s=CLOSED pgs=52 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.320 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.314+0000 7f7bc71dc640 1 --2- 10.20.193.178:0/3486783279 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f7bc0099e50 0x7f7bc011f560 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.320 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.314+0000 7f7bc71dc640 1 -- 10.20.193.178:0/3486783279 >> 10.20.193.178:0/3486783279 conn(0x7f7bc0057b80 msgr2=0x7f7bc0169d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:01.320 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.314+0000 7f7bc71dc640 1 -- 10.20.193.178:0/3486783279 shutdown_connections 2026-02-13T02:31:01.320 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.314+0000 7f7bc71dc640 1 -- 10.20.193.178:0/3486783279 wait complete. 2026-02-13T02:31:01.332 DEBUG:teuthology.orchestra.run.trial178:> sudo ceph --cluster ceph osd new c12b1fa7-7ebd-4fd3-a785-f8e02e0cf3c4 4 2026-02-13T02:31:01.333 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:31:01.324+0000 7f1f4a3b1640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-13T02:31:01.333 INFO:tasks.ceph.mgr.y.trial121.stderr:2026-02-13T02:31:01.324+0000 7f1f4a3b1640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-13T02:31:01.398 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.390+0000 7f0c3c8fe640 1 -- 10.20.193.178:0/1818545754 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f0c38056850 msgr2=0x7f0c3809de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.398 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.390+0000 7f0c3c8fe640 1 --2- 10.20.193.178:0/1818545754 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f0c38056850 0x7f0c3809de20 secure :-1 s=READY pgs=54 gs=3 cs=0 l=1 c_cookie=4856436209128264122 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c28005c90 tx=0x7f0c2801db10 comp rx=0 tx=0).stop 2026-02-13T02:31:01.398 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.390+0000 7f0c3c8fe640 1 -- 10.20.193.178:0/1818545754 shutdown_connections 2026-02-13T02:31:01.398 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.390+0000 7f0c3c8fe640 1 --2- 10.20.193.178:0/1818545754 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f0c38056850 0x7f0c3809de20 unknown :-1 s=CLOSED pgs=54 gs=3 cs=0 l=1 c_cookie=4856436209128264122 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.398 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.390+0000 7f0c3c8fe640 1 -- 10.20.193.178:0/1818545754 >> 10.20.193.178:0/1818545754 conn(0x7f0c380a16e0 msgr2=0x7f0c380bbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:01.398 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c3c8fe640 1 -- 10.20.193.178:0/1818545754 shutdown_connections 2026-02-13T02:31:01.399 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c3c8fe640 1 -- 10.20.193.178:0/1818545754 wait complete. 2026-02-13T02:31:01.401 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c3c8fe640 1 Processor -- start 2026-02-13T02:31:01.401 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c3c8fe640 1 -- start start 2026-02-13T02:31:01.401 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c3c8fe640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f0c38056850 0x7f0c38144db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.402 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c3c8fe640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f0c38058080 0x7f0c3814b090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.402 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c3c8fe640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f0c381684a0 0x7f0c3814b5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.402 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c3c8fe640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0c381d08e0 con 0x7f0c38058080 2026-02-13T02:31:01.402 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c3c8fe640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0c381d0760 con 0x7f0c381684a0 2026-02-13T02:31:01.402 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c3c8fe640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7f0c381d0a60 con 0x7f0c38056850 2026-02-13T02:31:01.402 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c36575640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f0c38056850 0x7f0c38144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:01.402 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c36575640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f0c38056850 0x7f0c38144db0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.178:3301/0 says I am v2:10.20.193.178:34622/0 (socket says 10.20.193.178:34622) 2026-02-13T02:31:01.402 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c36575640 1 -- 10.20.193.178:0/1764214549 learned_addr learned my addr 10.20.193.178:0/1764214549 (peer_addr_for_me v2:10.20.193.178:0/0) 2026-02-13T02:31:01.402 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c36d76640 1 --2- 10.20.193.178:0/1764214549 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f0c381684a0 0x7f0c3814b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:01.402 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c36575640 1 -- 10.20.193.178:0/1764214549 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f0c381684a0 msgr2=0x7f0c3814b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.403 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c35d74640 1 --2- 10.20.193.178:0/1764214549 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f0c38058080 0x7f0c3814b090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:01.403 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c36575640 1 --2- 10.20.193.178:0/1764214549 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f0c381684a0 0x7f0c3814b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.403 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c36575640 1 -- 10.20.193.178:0/1764214549 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f0c38058080 msgr2=0x7f0c3814b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.403 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c36575640 1 --2- 10.20.193.178:0/1764214549 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f0c38058080 0x7f0c3814b090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.403 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c36575640 1 -- 10.20.193.178:0/1764214549 --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c38134120 con 0x7f0c38056850 2026-02-13T02:31:01.403 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c35d74640 1 --2- 10.20.193.178:0/1764214549 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f0c38058080 0x7f0c3814b090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:31:01.403 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c36575640 1 --2- 10.20.193.178:0/1764214549 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f0c38056850 0x7f0c38144db0 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c2c00c470 tx=0x7f0c2c00c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:01.403 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c1effd640 1 -- 10.20.193.178:0/1764214549 <== mon.2 v2:10.20.193.178:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c2c016020 con 0x7f0c38056850 2026-02-13T02:31:01.403 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c1effd640 1 -- 10.20.193.178:0/1764214549 <== mon.2 v2:10.20.193.178:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c2c005330 con 0x7f0c38056850 2026-02-13T02:31:01.403 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c3c8fe640 1 -- 10.20.193.178:0/1764214549 --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c381343e0 con 0x7f0c38056850 2026-02-13T02:31:01.403 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c1effd640 1 -- 10.20.193.178:0/1764214549 <== mon.2 v2:10.20.193.178:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c2c0068d0 con 0x7f0c38056850 2026-02-13T02:31:01.403 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c3c8fe640 1 -- 10.20.193.178:0/1764214549 --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c381349a0 con 0x7f0c38056850 2026-02-13T02:31:01.404 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c3c8fe640 1 -- 10.20.193.178:0/1764214549 --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c3809de20 con 0x7f0c38056850 2026-02-13T02:31:01.404 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c1effd640 1 -- 10.20.193.178:0/1764214549 <== mon.2 v2:10.20.193.178:3301/0 4 ==== mgrmap(e 3) ==== 99924+0+0 (secure 0 0 0) 0x7f0c2c006a90 con 0x7f0c38056850 2026-02-13T02:31:01.404 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c1effd640 1 --2- 10.20.193.178:0/1764214549 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f0c04073f90 0x7f0c04094440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.404 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c1effd640 1 -- 10.20.193.178:0/1764214549 <== mon.2 v2:10.20.193.178:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1180+0+0 (secure 0 0 0) 0x7f0c2c0940d0 con 0x7f0c38056850 2026-02-13T02:31:01.404 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.394+0000 7f0c35d74640 1 --2- 10.20.193.178:0/1764214549 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f0c04073f90 0x7f0c04094440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:01.404 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.398+0000 7f0c35d74640 1 --2- 10.20.193.178:0/1764214549 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f0c04073f90 0x7f0c04094440 secure :-1 s=READY pgs=9 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c200029e0 tx=0x7f0c20009040 comp rx=0 tx=0).ready entity=mgr.4155 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:01.405 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.398+0000 7f0c1effd640 1 -- 10.20.193.178:0/1764214549 <== mon.2 v2:10.20.193.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (secure 0 0 0) 0x7f0c2c020020 con 0x7f0c38056850 2026-02-13T02:31:01.500 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.494+0000 7f0c3c8fe640 1 -- 10.20.193.178:0/1764214549 --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c12b1fa7-7ebd-4fd3-a785-f8e02e0cf3c4", "id": 4} v 0) -- 0x7f0c3814ed90 con 0x7f0c38056850 2026-02-13T02:31:01.504 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.498+0000 7f0c1effd640 1 -- 10.20.193.178:0/1764214549 <== mon.2 v2:10.20.193.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c12b1fa7-7ebd-4fd3-a785-f8e02e0cf3c4", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f0c2c05f760 con 0x7f0c38056850 2026-02-13T02:31:01.504 INFO:teuthology.orchestra.run.trial178.stdout:4 2026-02-13T02:31:01.505 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.498+0000 7f0c3c8fe640 1 -- 10.20.193.178:0/1764214549 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f0c04073f90 msgr2=0x7f0c04094440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.505 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.498+0000 7f0c3c8fe640 1 --2- 10.20.193.178:0/1764214549 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f0c04073f90 0x7f0c04094440 secure :-1 s=READY pgs=9 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c200029e0 tx=0x7f0c20009040 comp rx=0 tx=0).stop 2026-02-13T02:31:01.506 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.498+0000 7f0c3c8fe640 1 -- 10.20.193.178:0/1764214549 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f0c38056850 msgr2=0x7f0c38144db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.506 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.498+0000 7f0c3c8fe640 1 --2- 10.20.193.178:0/1764214549 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f0c38056850 0x7f0c38144db0 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c2c00c470 tx=0x7f0c2c00c930 comp rx=0 tx=0).stop 2026-02-13T02:31:01.506 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.498+0000 7f0c3c8fe640 1 -- 10.20.193.178:0/1764214549 shutdown_connections 2026-02-13T02:31:01.506 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.498+0000 7f0c3c8fe640 1 --2- 10.20.193.178:0/1764214549 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f0c04073f90 0x7f0c04094440 unknown :-1 s=CLOSED pgs=9 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.506 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.498+0000 7f0c3c8fe640 1 --2- 10.20.193.178:0/1764214549 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f0c381684a0 0x7f0c3814b5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.506 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.498+0000 7f0c3c8fe640 1 --2- 10.20.193.178:0/1764214549 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f0c38058080 0x7f0c3814b090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.506 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.498+0000 7f0c3c8fe640 1 --2- 10.20.193.178:0/1764214549 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f0c38056850 0x7f0c38144db0 unknown :-1 s=CLOSED pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.506 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.498+0000 7f0c3c8fe640 1 -- 10.20.193.178:0/1764214549 >> 10.20.193.178:0/1764214549 conn(0x7f0c380a16e0 msgr2=0x7f0c380b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:01.506 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.498+0000 7f0c3c8fe640 1 -- 10.20.193.178:0/1764214549 shutdown_connections 2026-02-13T02:31:01.506 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.498+0000 7f0c3c8fe640 1 -- 10.20.193.178:0/1764214549 wait complete. 2026-02-13T02:31:01.516 DEBUG:teuthology.orchestra.run.trial178:> sudo ceph --cluster ceph osd new 7c8786af-1011-41b5-ac07-20302bd12503 5 2026-02-13T02:31:01.581 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.574+0000 7f56d0da6640 1 -- 10.20.193.178:0/2342761005 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f56cc160770 msgr2=0x7f56cc167240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.581 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.574+0000 7f56d0da6640 1 --2- 10.20.193.178:0/2342761005 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f56cc160770 0x7f56cc167240 secure :-1 s=READY pgs=55 gs=1 cs=0 l=1 c_cookie=8036518665183900668 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56cc055330 tx=0x7f56c001c570 comp rx=0 tx=0).stop 2026-02-13T02:31:01.581 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.574+0000 7f56d0da6640 1 -- 10.20.193.178:0/2342761005 shutdown_connections 2026-02-13T02:31:01.581 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.574+0000 7f56d0da6640 1 --2- 10.20.193.178:0/2342761005 >> v2:10.20.193.121:3300/0 conn(0x7f56cc0a1110 0x7f56cc169db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.581 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.574+0000 7f56d0da6640 1 --2- 10.20.193.178:0/2342761005 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f56cc059ad0 0x7f56cc0a0bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.582 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.574+0000 7f56d0da6640 1 --2- 10.20.193.178:0/2342761005 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f56cc160770 0x7f56cc167240 unknown :-1 s=CLOSED pgs=55 gs=1 cs=0 l=1 c_cookie=8036518665183900668 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.582 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.574+0000 7f56d0da6640 1 -- 10.20.193.178:0/2342761005 >> 10.20.193.178:0/2342761005 conn(0x7f56cc054c00 msgr2=0x7f56cc0bcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:01.582 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.574+0000 7f56d0da6640 1 -- 10.20.193.178:0/2342761005 shutdown_connections 2026-02-13T02:31:01.582 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.574+0000 7f56d0da6640 1 -- 10.20.193.178:0/2342761005 wait complete. 2026-02-13T02:31:01.584 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56d0da6640 1 Processor -- start 2026-02-13T02:31:01.585 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56d0da6640 1 -- start start 2026-02-13T02:31:01.585 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56d0da6640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f56cc059ad0 0x7f56cc13ed80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.585 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56d0da6640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f56cc0a1110 0x7f56cc15c110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.585 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56d0da6640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f56cc160770 0x7f56cc057290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.585 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56d0da6640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7f56cc167b00 con 0x7f56cc0a1110 2026-02-13T02:31:01.585 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56d0da6640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7f56cc167980 con 0x7f56cc059ad0 2026-02-13T02:31:01.585 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56d0da6640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7f56cc167c80 con 0x7f56cc160770 2026-02-13T02:31:01.585 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56ca575640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f56cc059ad0 0x7f56cc13ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:01.585 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56ca575640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f56cc059ad0 0x7f56cc13ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.178:3300/0 says I am v2:10.20.193.178:38030/0 (socket says 10.20.193.178:38030) 2026-02-13T02:31:01.585 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56ca575640 1 -- 10.20.193.178:0/1545646194 learned_addr learned my addr 10.20.193.178:0/1545646194 (peer_addr_for_me v2:10.20.193.178:0/0) 2026-02-13T02:31:01.586 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56cad76640 1 --2- 10.20.193.178:0/1545646194 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f56cc160770 0x7f56cc057290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:01.586 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56c9d74640 1 --2- 10.20.193.178:0/1545646194 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f56cc0a1110 0x7f56cc15c110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:01.586 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56ca575640 1 -- 10.20.193.178:0/1545646194 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f56cc160770 msgr2=0x7f56cc057290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.586 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56ca575640 1 --2- 10.20.193.178:0/1545646194 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f56cc160770 0x7f56cc057290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.586 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56ca575640 1 -- 10.20.193.178:0/1545646194 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f56cc0a1110 msgr2=0x7f56cc15c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.586 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56ca575640 1 --2- 10.20.193.178:0/1545646194 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f56cc0a1110 0x7f56cc15c110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.586 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56ca575640 1 -- 10.20.193.178:0/1545646194 --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56cc0577d0 con 0x7f56cc059ad0 2026-02-13T02:31:01.586 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56ca575640 1 --2- 10.20.193.178:0/1545646194 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f56cc059ad0 0x7f56cc13ed80 secure :-1 s=READY pgs=56 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56c0002410 tx=0x7f56c0004690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:01.586 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56b2ffd640 1 -- 10.20.193.178:0/1545646194 <== mon.1 v2:10.20.193.178:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56c0002b40 con 0x7f56cc059ad0 2026-02-13T02:31:01.586 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56b2ffd640 1 -- 10.20.193.178:0/1545646194 <== mon.1 v2:10.20.193.178:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56c00b7030 con 0x7f56cc059ad0 2026-02-13T02:31:01.586 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56b2ffd640 1 -- 10.20.193.178:0/1545646194 <== mon.1 v2:10.20.193.178:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56c00a8700 con 0x7f56cc059ad0 2026-02-13T02:31:01.586 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56d0da6640 1 -- 10.20.193.178:0/1545646194 --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56cc17f3e0 con 0x7f56cc059ad0 2026-02-13T02:31:01.587 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56d0da6640 1 -- 10.20.193.178:0/1545646194 --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56cc17f9a0 con 0x7f56cc059ad0 2026-02-13T02:31:01.587 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56d0da6640 1 -- 10.20.193.178:0/1545646194 --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56cc17fcd0 con 0x7f56cc059ad0 2026-02-13T02:31:01.587 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56b2ffd640 1 -- 10.20.193.178:0/1545646194 <== mon.1 v2:10.20.193.178:3300/0 4 ==== mgrmap(e 3) ==== 99924+0+0 (secure 0 0 0) 0x7f56c00a88a0 con 0x7f56cc059ad0 2026-02-13T02:31:01.587 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56b2ffd640 1 --2- 10.20.193.178:0/1545646194 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f5698073f90 0x7f5698094440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.587 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56b2ffd640 1 -- 10.20.193.178:0/1545646194 <== mon.1 v2:10.20.193.178:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1295+0+0 (secure 0 0 0) 0x7f56c012f0c0 con 0x7f56cc059ad0 2026-02-13T02:31:01.587 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56c9d74640 1 --2- 10.20.193.178:0/1545646194 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f5698073f90 0x7f5698094440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:01.588 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.578+0000 7f56c9d74640 1 --2- 10.20.193.178:0/1545646194 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f5698073f90 0x7f5698094440 secure :-1 s=READY pgs=10 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56cc15fca0 tx=0x7f56b4009260 comp rx=0 tx=0).ready entity=mgr.4155 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:01.588 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.582+0000 7f56b2ffd640 1 -- 10.20.193.178:0/1545646194 <== mon.1 v2:10.20.193.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (secure 0 0 0) 0x7f56c00c1030 con 0x7f56cc059ad0 2026-02-13T02:31:01.680 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.674+0000 7f56d0da6640 1 -- 10.20.193.178:0/1545646194 --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7c8786af-1011-41b5-ac07-20302bd12503", "id": 5} v 0) -- 0x7f56cc05ce20 con 0x7f56cc059ad0 2026-02-13T02:31:01.683 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.678+0000 7f56b2ffd640 1 -- 10.20.193.178:0/1545646194 <== mon.1 v2:10.20.193.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7c8786af-1011-41b5-ac07-20302bd12503", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f56cc05ce20 con 0x7f56cc059ad0 2026-02-13T02:31:01.683 INFO:teuthology.orchestra.run.trial178.stdout:5 2026-02-13T02:31:01.684 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.678+0000 7f56d0da6640 1 -- 10.20.193.178:0/1545646194 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f5698073f90 msgr2=0x7f5698094440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.684 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.678+0000 7f56d0da6640 1 --2- 10.20.193.178:0/1545646194 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f5698073f90 0x7f5698094440 secure :-1 s=READY pgs=10 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56cc15fca0 tx=0x7f56b4009260 comp rx=0 tx=0).stop 2026-02-13T02:31:01.685 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.678+0000 7f56d0da6640 1 -- 10.20.193.178:0/1545646194 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f56cc059ad0 msgr2=0x7f56cc13ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.685 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.678+0000 7f56d0da6640 1 --2- 10.20.193.178:0/1545646194 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f56cc059ad0 0x7f56cc13ed80 secure :-1 s=READY pgs=56 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56c0002410 tx=0x7f56c0004690 comp rx=0 tx=0).stop 2026-02-13T02:31:01.685 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.678+0000 7f56d0da6640 1 -- 10.20.193.178:0/1545646194 shutdown_connections 2026-02-13T02:31:01.685 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.678+0000 7f56d0da6640 1 --2- 10.20.193.178:0/1545646194 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f5698073f90 0x7f5698094440 unknown :-1 s=CLOSED pgs=10 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.685 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.678+0000 7f56d0da6640 1 --2- 10.20.193.178:0/1545646194 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f56cc160770 0x7f56cc057290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.685 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.678+0000 7f56d0da6640 1 --2- 10.20.193.178:0/1545646194 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f56cc0a1110 0x7f56cc15c110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.685 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.678+0000 7f56d0da6640 1 --2- 10.20.193.178:0/1545646194 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f56cc059ad0 0x7f56cc13ed80 unknown :-1 s=CLOSED pgs=56 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.685 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.678+0000 7f56d0da6640 1 -- 10.20.193.178:0/1545646194 >> 10.20.193.178:0/1545646194 conn(0x7f56cc054c00 msgr2=0x7f56cc13fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:01.685 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.678+0000 7f56d0da6640 1 -- 10.20.193.178:0/1545646194 shutdown_connections 2026-02-13T02:31:01.686 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.678+0000 7f56d0da6640 1 -- 10.20.193.178:0/1545646194 wait complete. 2026-02-13T02:31:01.694 DEBUG:teuthology.orchestra.run.trial178:> sudo ceph --cluster ceph osd new 4da5620f-6851-4da1-898d-22654932a4d6 6 2026-02-13T02:31:01.760 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.754+0000 7fbe63b32640 1 -- 10.20.193.178:0/854310425 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fbe5c056850 msgr2=0x7fbe5c168cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.760 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.754+0000 7fbe63b32640 1 --2- 10.20.193.178:0/854310425 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fbe5c056850 0x7fbe5c168cd0 secure :-1 s=READY pgs=20 gs=3 cs=0 l=1 c_cookie=2967851231203972833 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe58005c90 tx=0x7fbe5801db10 comp rx=0 tx=0).stop 2026-02-13T02:31:01.760 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.754+0000 7fbe63b32640 1 -- 10.20.193.178:0/854310425 shutdown_connections 2026-02-13T02:31:01.760 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.754+0000 7fbe63b32640 1 --2- 10.20.193.178:0/854310425 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fbe5c056850 0x7fbe5c168cd0 unknown :-1 s=CLOSED pgs=20 gs=3 cs=0 l=1 c_cookie=2967851231203972833 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.760 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.754+0000 7fbe63b32640 1 --2- 10.20.193.178:0/854310425 >> v2:10.20.193.178:3300/0 conn(0x7fbe5c1684a0 0x7fbe5c058080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.760 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.754+0000 7fbe63b32640 1 -- 10.20.193.178:0/854310425 >> 10.20.193.178:0/854310425 conn(0x7fbe5c0a16e0 msgr2=0x7fbe5c0bbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:01.761 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.754+0000 7fbe63b32640 1 -- 10.20.193.178:0/854310425 shutdown_connections 2026-02-13T02:31:01.761 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.754+0000 7fbe63b32640 1 -- 10.20.193.178:0/854310425 wait complete. 2026-02-13T02:31:01.763 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.754+0000 7fbe63b32640 1 Processor -- start 2026-02-13T02:31:01.763 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.754+0000 7fbe63b32640 1 -- start start 2026-02-13T02:31:01.764 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.754+0000 7fbe63b32640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fbe5c056850 0x7fbe5c131e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.764 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.754+0000 7fbe63b32640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fbe5c1684a0 0x7fbe5c146060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.764 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.754+0000 7fbe63b32640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fbe5c168870 0x7fbe5c149ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.764 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.754+0000 7fbe63b32640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5c0bd790 con 0x7fbe5c1684a0 2026-02-13T02:31:01.764 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.754+0000 7fbe63b32640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5c0bd610 con 0x7fbe5c056850 2026-02-13T02:31:01.764 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.754+0000 7fbe63b32640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7fbe5c0bd910 con 0x7fbe5c168870 2026-02-13T02:31:01.764 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.754+0000 7fbe618a7640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fbe5c056850 0x7fbe5c131e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:01.764 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.754+0000 7fbe618a7640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fbe5c056850 0x7fbe5c131e50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.178:3300/0 says I am v2:10.20.193.178:38050/0 (socket says 10.20.193.178:38050) 2026-02-13T02:31:01.764 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.754+0000 7fbe618a7640 1 -- 10.20.193.178:0/3441602259 learned_addr learned my addr 10.20.193.178:0/3441602259 (peer_addr_for_me v2:10.20.193.178:0/0) 2026-02-13T02:31:01.764 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.754+0000 7fbe620a8640 1 --2- 10.20.193.178:0/3441602259 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fbe5c168870 0x7fbe5c149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:01.764 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.758+0000 7fbe618a7640 1 -- 10.20.193.178:0/3441602259 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fbe5c168870 msgr2=0x7fbe5c149ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.765 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.758+0000 7fbe618a7640 1 --2- 10.20.193.178:0/3441602259 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fbe5c168870 0x7fbe5c149ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.765 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.758+0000 7fbe618a7640 1 -- 10.20.193.178:0/3441602259 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fbe5c1684a0 msgr2=0x7fbe5c146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.765 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.758+0000 7fbe618a7640 1 --2- 10.20.193.178:0/3441602259 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fbe5c1684a0 0x7fbe5c146060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.765 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.758+0000 7fbe618a7640 1 -- 10.20.193.178:0/3441602259 --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe5c0a3840 con 0x7fbe5c056850 2026-02-13T02:31:01.765 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.758+0000 7fbe620a8640 1 --2- 10.20.193.178:0/3441602259 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fbe5c168870 0x7fbe5c149ed0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:31:01.765 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.758+0000 7fbe618a7640 1 --2- 10.20.193.178:0/3441602259 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fbe5c056850 0x7fbe5c131e50 secure :-1 s=READY pgs=58 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe4c00e9c0 tx=0x7fbe4c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:01.765 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.758+0000 7fbe4a7fc640 1 -- 10.20.193.178:0/3441602259 <== mon.1 v2:10.20.193.178:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbe4c00cda0 con 0x7fbe5c056850 2026-02-13T02:31:01.765 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.758+0000 7fbe4a7fc640 1 -- 10.20.193.178:0/3441602259 <== mon.1 v2:10.20.193.178:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe4c004890 con 0x7fbe5c056850 2026-02-13T02:31:01.765 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.758+0000 7fbe4a7fc640 1 -- 10.20.193.178:0/3441602259 <== mon.1 v2:10.20.193.178:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbe4c004cc0 con 0x7fbe5c056850 2026-02-13T02:31:01.765 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.758+0000 7fbe63b32640 1 -- 10.20.193.178:0/3441602259 --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe5c132e30 con 0x7fbe5c056850 2026-02-13T02:31:01.765 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.758+0000 7fbe63b32640 1 -- 10.20.193.178:0/3441602259 --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe5c132590 con 0x7fbe5c056850 2026-02-13T02:31:01.765 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.758+0000 7fbe63b32640 1 -- 10.20.193.178:0/3441602259 --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe5c168cd0 con 0x7fbe5c056850 2026-02-13T02:31:01.766 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.758+0000 7fbe4a7fc640 1 -- 10.20.193.178:0/3441602259 <== mon.1 v2:10.20.193.178:3300/0 4 ==== mgrmap(e 3) ==== 99924+0+0 (secure 0 0 0) 0x7fbe4c005020 con 0x7fbe5c056850 2026-02-13T02:31:01.766 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.758+0000 7fbe4a7fc640 1 --2- 10.20.193.178:0/3441602259 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fbe2c073f90 0x7fbe2c094440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.766 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.758+0000 7fbe4a7fc640 1 -- 10.20.193.178:0/3441602259 <== mon.1 v2:10.20.193.178:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (secure 0 0 0) 0x7fbe4c0952b0 con 0x7fbe5c056850 2026-02-13T02:31:01.766 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.758+0000 7fbe610a6640 1 --2- 10.20.193.178:0/3441602259 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fbe2c073f90 0x7fbe2c094440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:01.766 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.758+0000 7fbe610a6640 1 --2- 10.20.193.178:0/3441602259 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fbe2c073f90 0x7fbe2c094440 secure :-1 s=READY pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe5c142860 tx=0x7fbe50007b50 comp rx=0 tx=0).ready entity=mgr.4155 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:01.767 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.762+0000 7fbe4a7fc640 1 -- 10.20.193.178:0/3441602259 <== mon.1 v2:10.20.193.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (secure 0 0 0) 0x7fbe4c060e50 con 0x7fbe5c056850 2026-02-13T02:31:01.864 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.858+0000 7fbe63b32640 1 -- 10.20.193.178:0/3441602259 --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4da5620f-6851-4da1-898d-22654932a4d6", "id": 6} v 0) -- 0x7fbe5c056450 con 0x7fbe5c056850 2026-02-13T02:31:01.867 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.862+0000 7fbe4a7fc640 1 -- 10.20.193.178:0/3441602259 <== mon.1 v2:10.20.193.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4da5620f-6851-4da1-898d-22654932a4d6", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fbe4c060730 con 0x7fbe5c056850 2026-02-13T02:31:01.867 INFO:teuthology.orchestra.run.trial178.stdout:6 2026-02-13T02:31:01.868 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.862+0000 7fbe63b32640 1 -- 10.20.193.178:0/3441602259 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fbe2c073f90 msgr2=0x7fbe2c094440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.869 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.862+0000 7fbe63b32640 1 --2- 10.20.193.178:0/3441602259 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fbe2c073f90 0x7fbe2c094440 secure :-1 s=READY pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe5c142860 tx=0x7fbe50007b50 comp rx=0 tx=0).stop 2026-02-13T02:31:01.869 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.862+0000 7fbe63b32640 1 -- 10.20.193.178:0/3441602259 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fbe5c056850 msgr2=0x7fbe5c131e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.869 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.862+0000 7fbe63b32640 1 --2- 10.20.193.178:0/3441602259 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fbe5c056850 0x7fbe5c131e50 secure :-1 s=READY pgs=58 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe4c00e9c0 tx=0x7fbe4c00ee80 comp rx=0 tx=0).stop 2026-02-13T02:31:01.869 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.862+0000 7fbe63b32640 1 -- 10.20.193.178:0/3441602259 shutdown_connections 2026-02-13T02:31:01.869 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.862+0000 7fbe63b32640 1 --2- 10.20.193.178:0/3441602259 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fbe2c073f90 0x7fbe2c094440 unknown :-1 s=CLOSED pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.869 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.862+0000 7fbe63b32640 1 --2- 10.20.193.178:0/3441602259 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fbe5c168870 0x7fbe5c149ed0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.869 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.862+0000 7fbe63b32640 1 --2- 10.20.193.178:0/3441602259 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fbe5c1684a0 0x7fbe5c146060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.869 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.862+0000 7fbe63b32640 1 --2- 10.20.193.178:0/3441602259 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fbe5c056850 0x7fbe5c131e50 unknown :-1 s=CLOSED pgs=58 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.869 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.862+0000 7fbe63b32640 1 -- 10.20.193.178:0/3441602259 >> 10.20.193.178:0/3441602259 conn(0x7fbe5c0a16e0 msgr2=0x7fbe5c0b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:01.869 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.862+0000 7fbe63b32640 1 -- 10.20.193.178:0/3441602259 shutdown_connections 2026-02-13T02:31:01.870 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.862+0000 7fbe63b32640 1 -- 10.20.193.178:0/3441602259 wait complete. 2026-02-13T02:31:01.879 DEBUG:teuthology.orchestra.run.trial178:> sudo ceph --cluster ceph osd new 91841061-fa38-436d-b719-90cbf2f1830d 7 2026-02-13T02:31:01.944 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.938+0000 7fe69e1d9640 1 -- 10.20.193.178:0/1222891 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fe69809bc10 msgr2=0x7fe69809dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.945 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.938+0000 7fe69e1d9640 1 --2- 10.20.193.178:0/1222891 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fe69809bc10 0x7fe69809dd30 secure :-1 s=READY pgs=21 gs=2 cs=0 l=1 c_cookie=14189499807443554220 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe684005eb0 tx=0x7fe68401c9a0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.945 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.938+0000 7fe69e1d9640 1 -- 10.20.193.178:0/1222891 shutdown_connections 2026-02-13T02:31:01.945 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.938+0000 7fe69e1d9640 1 --2- 10.20.193.178:0/1222891 >> v2:10.20.193.121:3300/0 conn(0x7fe69809a020 0x7fe698169dd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.945 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.938+0000 7fe69e1d9640 1 --2- 10.20.193.178:0/1222891 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fe69809bc10 0x7fe69809dd30 unknown :-1 s=CLOSED pgs=21 gs=2 cs=0 l=1 c_cookie=14189499807443554220 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.945 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.938+0000 7fe69e1d9640 1 -- 10.20.193.178:0/1222891 >> 10.20.193.178:0/1222891 conn(0x7fe698057b80 msgr2=0x7fe69809ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:01.945 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.938+0000 7fe69e1d9640 1 -- 10.20.193.178:0/1222891 shutdown_connections 2026-02-13T02:31:01.945 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.938+0000 7fe69e1d9640 1 -- 10.20.193.178:0/1222891 wait complete. 2026-02-13T02:31:01.948 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.938+0000 7fe69e1d9640 1 Processor -- start 2026-02-13T02:31:01.948 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.938+0000 7fe69e1d9640 1 -- start start 2026-02-13T02:31:01.948 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe69e1d9640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fe69809a020 0x7fe698142bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.948 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe69e1d9640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fe69809bc10 0x7fe69812d640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.948 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe69e1d9640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fe69809bfe0 0x7fe69812db80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.948 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe69e1d9640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe69809f880 con 0x7fe69809bfe0 2026-02-13T02:31:01.948 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe69e1d9640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe69809f700 con 0x7fe69809bc10 2026-02-13T02:31:01.948 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe69e1d9640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7fe69809fa00 con 0x7fe69809a020 2026-02-13T02:31:01.948 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe6977fe640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fe69809a020 0x7fe698142bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:01.949 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe6977fe640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fe69809a020 0x7fe698142bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.178:3301/0 says I am v2:10.20.193.178:34666/0 (socket says 10.20.193.178:34666) 2026-02-13T02:31:01.949 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe6977fe640 1 -- 10.20.193.178:0/365153398 learned_addr learned my addr 10.20.193.178:0/365153398 (peer_addr_for_me v2:10.20.193.178:0/0) 2026-02-13T02:31:01.949 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe696ffd640 1 --2- 10.20.193.178:0/365153398 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fe69809bc10 0x7fe69812d640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:01.949 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe6977fe640 1 -- 10.20.193.178:0/365153398 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fe69809bc10 msgr2=0x7fe69812d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.949 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe6977fe640 1 --2- 10.20.193.178:0/365153398 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fe69809bc10 0x7fe69812d640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.949 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe6977fe640 1 -- 10.20.193.178:0/365153398 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fe69809bfe0 msgr2=0x7fe69812db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:01.949 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe6977fe640 1 --2- 10.20.193.178:0/365153398 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fe69809bfe0 0x7fe69812db80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:01.949 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe6977fe640 1 -- 10.20.193.178:0/365153398 --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe69813f390 con 0x7fe69809a020 2026-02-13T02:31:01.949 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe6977fe640 1 --2- 10.20.193.178:0/365153398 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fe69809a020 0x7fe698142bf0 secure :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe68401c7d0 tx=0x7fe6840a5e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:01.949 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe673fff640 1 -- 10.20.193.178:0/365153398 <== mon.2 v2:10.20.193.178:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe684004070 con 0x7fe69809a020 2026-02-13T02:31:01.949 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe673fff640 1 -- 10.20.193.178:0/365153398 <== mon.2 v2:10.20.193.178:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe684004210 con 0x7fe69809a020 2026-02-13T02:31:01.950 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe673fff640 1 -- 10.20.193.178:0/365153398 <== mon.2 v2:10.20.193.178:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe684002900 con 0x7fe69809a020 2026-02-13T02:31:01.950 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe69e1d9640 1 -- 10.20.193.178:0/365153398 --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe69813f670 con 0x7fe69809a020 2026-02-13T02:31:01.950 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe69e1d9640 1 -- 10.20.193.178:0/365153398 --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe69813fc30 con 0x7fe69809a020 2026-02-13T02:31:01.950 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe69e1d9640 1 -- 10.20.193.178:0/365153398 --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe698169dd0 con 0x7fe69809a020 2026-02-13T02:31:01.950 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe673fff640 1 -- 10.20.193.178:0/365153398 <== mon.2 v2:10.20.193.178:3301/0 4 ==== mgrmap(e 3) ==== 99924+0+0 (secure 0 0 0) 0x7fe684002aa0 con 0x7fe69809a020 2026-02-13T02:31:01.950 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe673fff640 1 --2- 10.20.193.178:0/365153398 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fe668073f90 0x7fe668094440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:01.950 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe673fff640 1 -- 10.20.193.178:0/365153398 <== mon.2 v2:10.20.193.178:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1525+0+0 (secure 0 0 0) 0x7fe6840b4030 con 0x7fe69809a020 2026-02-13T02:31:01.950 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe696ffd640 1 --2- 10.20.193.178:0/365153398 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fe668073f90 0x7fe668094440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:01.951 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.942+0000 7fe696ffd640 1 --2- 10.20.193.178:0/365153398 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fe668073f90 0x7fe668094440 secure :-1 s=READY pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe698142490 tx=0x7fe6880037b0 comp rx=0 tx=0).ready entity=mgr.4155 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:01.951 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:01.946+0000 7fe673fff640 1 -- 10.20.193.178:0/365153398 <== mon.2 v2:10.20.193.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (secure 0 0 0) 0x7fe6840bf030 con 0x7fe69809a020 2026-02-13T02:31:02.040 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:02.034+0000 7fe69e1d9640 1 -- 10.20.193.178:0/365153398 --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_command({"prefix": "osd new", "uuid": "91841061-fa38-436d-b719-90cbf2f1830d", "id": 7} v 0) -- 0x7fe698133ba0 con 0x7fe69809a020 2026-02-13T02:31:02.043 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:02.038+0000 7fe673fff640 1 -- 10.20.193.178:0/365153398 <== mon.2 v2:10.20.193.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "91841061-fa38-436d-b719-90cbf2f1830d", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fe684016590 con 0x7fe69809a020 2026-02-13T02:31:02.043 INFO:teuthology.orchestra.run.trial178.stdout:7 2026-02-13T02:31:02.044 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:02.038+0000 7fe69e1d9640 1 -- 10.20.193.178:0/365153398 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fe668073f90 msgr2=0x7fe668094440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:02.044 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:02.038+0000 7fe69e1d9640 1 --2- 10.20.193.178:0/365153398 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fe668073f90 0x7fe668094440 secure :-1 s=READY pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe698142490 tx=0x7fe6880037b0 comp rx=0 tx=0).stop 2026-02-13T02:31:02.044 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:02.038+0000 7fe69e1d9640 1 -- 10.20.193.178:0/365153398 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fe69809a020 msgr2=0x7fe698142bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:02.045 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:02.038+0000 7fe69e1d9640 1 --2- 10.20.193.178:0/365153398 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fe69809a020 0x7fe698142bf0 secure :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe68401c7d0 tx=0x7fe6840a5e70 comp rx=0 tx=0).stop 2026-02-13T02:31:02.045 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:02.038+0000 7fe69e1d9640 1 -- 10.20.193.178:0/365153398 shutdown_connections 2026-02-13T02:31:02.045 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:02.038+0000 7fe69e1d9640 1 --2- 10.20.193.178:0/365153398 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fe668073f90 0x7fe668094440 unknown :-1 s=CLOSED pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:02.045 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:02.038+0000 7fe69e1d9640 1 --2- 10.20.193.178:0/365153398 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fe69809bfe0 0x7fe69812db80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:02.045 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:02.038+0000 7fe69e1d9640 1 --2- 10.20.193.178:0/365153398 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fe69809bc10 0x7fe69812d640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:02.045 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:02.038+0000 7fe69e1d9640 1 --2- 10.20.193.178:0/365153398 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fe69809a020 0x7fe698142bf0 unknown :-1 s=CLOSED pgs=22 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:02.045 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:02.038+0000 7fe69e1d9640 1 -- 10.20.193.178:0/365153398 >> 10.20.193.178:0/365153398 conn(0x7fe698057b80 msgr2=0x7fe698165250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:02.045 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:02.038+0000 7fe69e1d9640 1 -- 10.20.193.178:0/365153398 shutdown_connections 2026-02-13T02:31:02.045 INFO:teuthology.orchestra.run.trial178.stderr:2026-02-13T02:31:02.038+0000 7fe69e1d9640 1 -- 10.20.193.178:0/365153398 wait complete. 2026-02-13T02:31:02.054 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-13T02:31:02.054 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-13T02:31:02.056 INFO:tasks.ceph.osd.0:Started 2026-02-13T02:31:02.056 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-13T02:31:02.057 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-13T02:31:02.059 INFO:tasks.ceph.osd.1:Started 2026-02-13T02:31:02.059 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-13T02:31:02.059 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-13T02:31:02.061 INFO:tasks.ceph.osd.2:Started 2026-02-13T02:31:02.061 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-13T02:31:02.061 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-13T02:31:02.063 INFO:tasks.ceph.osd.3:Started 2026-02-13T02:31:02.063 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-13T02:31:02.063 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2026-02-13T02:31:02.065 INFO:tasks.ceph.osd.4:Started 2026-02-13T02:31:02.065 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-13T02:31:02.065 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2026-02-13T02:31:02.067 INFO:tasks.ceph.osd.5:Started 2026-02-13T02:31:02.067 INFO:tasks.ceph.osd.6:Restarting daemon 2026-02-13T02:31:02.068 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2026-02-13T02:31:02.072 INFO:tasks.ceph.osd.6:Started 2026-02-13T02:31:02.072 INFO:tasks.ceph.osd.7:Restarting daemon 2026-02-13T02:31:02.073 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2026-02-13T02:31:02.075 INFO:tasks.ceph.osd.7:Started 2026-02-13T02:31:02.075 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-13T02:31:02.138 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.128+0000 7fd3a7494640 1 -- 10.20.193.121:0/2234271077 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fd388005480 msgr2=0x7fd388065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:02.138 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.128+0000 7fd3a7494640 1 --2- 10.20.193.121:0/2234271077 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fd388005480 0x7fd388065a90 secure :-1 s=READY pgs=96 gs=4 cs=0 l=1 c_cookie=11293820203793094675 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3a0099b00 tx=0x7fd39c01e740 comp rx=0 tx=0).stop 2026-02-13T02:31:02.138 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.128+0000 7fd3a7494640 1 -- 10.20.193.121:0/2234271077 shutdown_connections 2026-02-13T02:31:02.138 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.128+0000 7fd3a7494640 1 --2- 10.20.193.121:0/2234271077 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fd388005480 0x7fd388065a90 unknown :-1 s=CLOSED pgs=96 gs=4 cs=0 l=1 c_cookie=11293820203793094675 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:02.138 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.128+0000 7fd3a7494640 1 -- 10.20.193.121:0/2234271077 >> 10.20.193.121:0/2234271077 conn(0x7fd3a0057b80 msgr2=0x7fd3a009ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:02.138 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.128+0000 7fd3a7494640 1 -- 10.20.193.121:0/2234271077 shutdown_connections 2026-02-13T02:31:02.138 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.128+0000 7fd3a7494640 1 -- 10.20.193.121:0/2234271077 wait complete. 2026-02-13T02:31:02.141 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.128+0000 7fd3a7494640 1 Processor -- start 2026-02-13T02:31:02.142 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.128+0000 7fd3a7494640 1 -- start start 2026-02-13T02:31:02.142 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd3a7494640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fd388005480 0x7fd3a01413f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:02.142 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd3a7494640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fd3a013bd90 0x7fd3a01fe300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:02.142 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd3a7494640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fd3a0138f10 0x7fd3a0139390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:02.142 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd3a7494640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a0166cd0 con 0x7fd3a013bd90 2026-02-13T02:31:02.142 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd3a7494640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a0166b50 con 0x7fd388005480 2026-02-13T02:31:02.142 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd3a7494640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7fd3a00b9770 con 0x7fd3a0138f10 2026-02-13T02:31:02.142 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd3a4a08640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fd3a013bd90 0x7fd3a01fe300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:02.142 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd3a4a08640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fd3a013bd90 0x7fd3a01fe300 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:38808/0 (socket says 10.20.193.121:38808) 2026-02-13T02:31:02.142 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd3a4a08640 1 -- 10.20.193.121:0/4007516771 learned_addr learned my addr 10.20.193.121:0/4007516771 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:02.142 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd3a5a0a640 1 --2- 10.20.193.121:0/4007516771 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fd3a0138f10 0x7fd3a0139390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:02.143 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd3a5209640 1 --2- 10.20.193.121:0/4007516771 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fd388005480 0x7fd3a01413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:02.143 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd3a4a08640 1 -- 10.20.193.121:0/4007516771 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fd3a0138f10 msgr2=0x7fd3a0139390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:02.143 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd3a4a08640 1 --2- 10.20.193.121:0/4007516771 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fd3a0138f10 0x7fd3a0139390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:02.143 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd3a4a08640 1 -- 10.20.193.121:0/4007516771 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fd388005480 msgr2=0x7fd3a01413f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:02.143 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd3a4a08640 1 --2- 10.20.193.121:0/4007516771 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fd388005480 0x7fd3a01413f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:02.143 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd3a4a08640 1 -- 10.20.193.121:0/4007516771 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a0202fa0 con 0x7fd3a013bd90 2026-02-13T02:31:02.143 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd3a5209640 1 --2- 10.20.193.121:0/4007516771 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fd388005480 0x7fd3a01413f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:31:02.143 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd3a4a08640 1 --2- 10.20.193.121:0/4007516771 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fd3a013bd90 0x7fd3a01fe300 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd39400d5b0 tx=0x7fd39400da70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:02.143 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd38dffb640 1 -- 10.20.193.121:0/4007516771 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd394014070 con 0x7fd3a013bd90 2026-02-13T02:31:02.143 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd38dffb640 1 -- 10.20.193.121:0/4007516771 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd39400f990 con 0x7fd3a013bd90 2026-02-13T02:31:02.143 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd38dffb640 1 -- 10.20.193.121:0/4007516771 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd39400fde0 con 0x7fd3a013bd90 2026-02-13T02:31:02.143 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd3a7494640 1 -- 10.20.193.121:0/4007516771 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3a013c220 con 0x7fd3a013bd90 2026-02-13T02:31:02.144 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd3a7494640 1 -- 10.20.193.121:0/4007516771 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3a02024c0 con 0x7fd3a013bd90 2026-02-13T02:31:02.144 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd3a7494640 1 -- 10.20.193.121:0/4007516771 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3a009bdb0 con 0x7fd3a013bd90 2026-02-13T02:31:02.144 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd38dffb640 1 -- 10.20.193.121:0/4007516771 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 3) ==== 99924+0+0 (secure 0 0 0) 0x7fd394010450 con 0x7fd3a013bd90 2026-02-13T02:31:02.144 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd38dffb640 1 --2- 10.20.193.121:0/4007516771 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fd370073f90 0x7fd370094440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:02.144 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd3a5209640 1 --2- 10.20.193.121:0/4007516771 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fd370073f90 0x7fd370094440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:02.144 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd38dffb640 1 -- 10.20.193.121:0/4007516771 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1640+0+0 (secure 0 0 0) 0x7fd394094f80 con 0x7fd3a013bd90 2026-02-13T02:31:02.144 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.132+0000 7fd3a5209640 1 --2- 10.20.193.121:0/4007516771 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fd370073f90 0x7fd370094440 secure :-1 s=READY pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd390005a30 tx=0x7fd390007040 comp rx=0 tx=0).ready entity=mgr.4155 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:02.144 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.136+0000 7fd38dffb640 1 -- 10.20.193.121:0/4007516771 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (secure 0 0 0) 0x7fd394060a40 con 0x7fd3a013bd90 2026-02-13T02:31:02.231 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.224+0000 7fd3a7494640 1 -- 10.20.193.121:0/4007516771 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3a01686c0 con 0x7fd3a013bd90 2026-02-13T02:31:02.232 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.224+0000 7fd38dffb640 1 -- 10.20.193.121:0/4007516771 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7056 (secure 0 0 0) 0x7fd394060320 con 0x7fd3a013bd90 2026-02-13T02:31:02.233 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:31:02.233 INFO:teuthology.orchestra.run.trial121.stdout:{"epoch":10,"fsid":"58020caa-1bc7-4445-b2fc-3f075ab46105","created":"2026-02-13T02:30:58.802931+0000","modified":"2026-02-13T02:31:02.036447+0000","last_up_change":"0.000000","last_in_change":"2026-02-13T02:31:02.036447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1bbcd75b-e678-4cb7-b625-1475960a9cb7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8e4f3373-8bf0-4119-9e36-38ae77f57ad1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f88cfbd7-657c-42c3-848e-d41286534244","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e4972ad7-8b35-4f37-99b5-37c7eebb40c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c12b1fa7-7ebd-4fd3-a785-f8e02e0cf3c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7c8786af-1011-41b5-ac07-20302bd12503","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4da5620f-6851-4da1-898d-22654932a4d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"91841061-fa38-436d-b719-90cbf2f1830d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T02:31:02.234 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.224+0000 7fd3a7494640 1 -- 10.20.193.121:0/4007516771 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fd370073f90 msgr2=0x7fd370094440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:02.234 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.224+0000 7fd3a7494640 1 --2- 10.20.193.121:0/4007516771 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fd370073f90 0x7fd370094440 secure :-1 s=READY pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd390005a30 tx=0x7fd390007040 comp rx=0 tx=0).stop 2026-02-13T02:31:02.234 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.224+0000 7fd3a7494640 1 -- 10.20.193.121:0/4007516771 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fd3a013bd90 msgr2=0x7fd3a01fe300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:02.234 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.224+0000 7fd3a7494640 1 --2- 10.20.193.121:0/4007516771 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fd3a013bd90 0x7fd3a01fe300 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd39400d5b0 tx=0x7fd39400da70 comp rx=0 tx=0).stop 2026-02-13T02:31:02.234 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.224+0000 7fd3a7494640 1 -- 10.20.193.121:0/4007516771 shutdown_connections 2026-02-13T02:31:02.234 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.224+0000 7fd3a7494640 1 --2- 10.20.193.121:0/4007516771 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fd370073f90 0x7fd370094440 unknown :-1 s=CLOSED pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:02.234 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.224+0000 7fd3a7494640 1 --2- 10.20.193.121:0/4007516771 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fd3a0138f10 0x7fd3a0139390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:02.234 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.224+0000 7fd3a7494640 1 --2- 10.20.193.121:0/4007516771 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fd3a013bd90 0x7fd3a01fe300 unknown :-1 s=CLOSED pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:02.235 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.224+0000 7fd3a7494640 1 --2- 10.20.193.121:0/4007516771 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fd388005480 0x7fd3a01413f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:02.235 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.224+0000 7fd3a7494640 1 -- 10.20.193.121:0/4007516771 >> 10.20.193.121:0/4007516771 conn(0x7fd3a0057b80 msgr2=0x7fd3a009ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:02.235 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.224+0000 7fd3a7494640 1 -- 10.20.193.121:0/4007516771 shutdown_connections 2026-02-13T02:31:02.235 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:02.224+0000 7fd3a7494640 1 -- 10.20.193.121:0/4007516771 wait complete. 2026-02-13T02:31:02.243 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-13T02:31:02.244 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-13T02:31:02.350 INFO:tasks.ceph.mgr.y.trial121.stderr:WARNING:root:not enough osds to create mgr pool 2026-02-13T02:31:02.350 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:Sleeping for 2 seconds 2026-02-13T02:31:02.410 INFO:tasks.ceph.osd.6.trial178.stderr:2026-02-13T02:31:02.406+0000 7faf9007da40 -1 Falling back to public interface 2026-02-13T02:31:02.434 INFO:tasks.ceph.osd.4.trial178.stderr:2026-02-13T02:31:02.430+0000 7f6816f66a40 -1 Falling back to public interface 2026-02-13T02:31:02.438 INFO:tasks.ceph.osd.7.trial178.stderr:2026-02-13T02:31:02.434+0000 7f99ea87ca40 -1 Falling back to public interface 2026-02-13T02:31:02.458 INFO:tasks.ceph.osd.5.trial178.stderr:2026-02-13T02:31:02.454+0000 7f0f38e65a40 -1 Falling back to public interface 2026-02-13T02:31:02.512 INFO:tasks.ceph.osd.1.trial121.stderr:2026-02-13T02:31:02.504+0000 7f6622bdba40 -1 Falling back to public interface 2026-02-13T02:31:02.512 INFO:tasks.ceph.osd.2.trial121.stderr:2026-02-13T02:31:02.504+0000 7f9d8b261a40 -1 Falling back to public interface 2026-02-13T02:31:02.527 INFO:tasks.ceph.osd.0.trial121.stderr:2026-02-13T02:31:02.520+0000 7f097b1f9a40 -1 Falling back to public interface 2026-02-13T02:31:02.563 INFO:tasks.ceph.osd.3.trial121.stderr:2026-02-13T02:31:02.556+0000 7f7749378a40 -1 Falling back to public interface 2026-02-13T02:31:03.049 DEBUG:teuthology.orchestra.run.trial121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-13T02:31:03.110 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.100+0000 7f4427682640 1 -- 10.20.193.121:0/2065876934 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f4408004e10 msgr2=0x7f4408005280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:03.110 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.100+0000 7f4427682640 1 --2- 10.20.193.121:0/2065876934 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f4408004e10 0x7f4408005280 secure :-1 s=READY pgs=99 gs=4 cs=0 l=1 c_cookie=14999517685220695780 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f441c005c90 tx=0x7f441c01e0b0 comp rx=0 tx=0).stop 2026-02-13T02:31:03.110 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.100+0000 7f4425bf8640 1 -- 10.20.193.121:0/2065876934 reap_dead start 2026-02-13T02:31:03.110 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.100+0000 7f4427682640 1 -- 10.20.193.121:0/2065876934 shutdown_connections 2026-02-13T02:31:03.110 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.100+0000 7f4427682640 1 -- 10.20.193.121:0/2065876934 >> 10.20.193.121:0/2065876934 conn(0x7f4420054c00 msgr2=0x7f44200bbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:03.110 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.100+0000 7f4427682640 1 -- 10.20.193.121:0/2065876934 shutdown_connections 2026-02-13T02:31:03.111 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.100+0000 7f4427682640 1 -- 10.20.193.121:0/2065876934 wait complete. 2026-02-13T02:31:03.113 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.100+0000 7f4427682640 1 Processor -- start 2026-02-13T02:31:03.113 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.100+0000 7f4427682640 1 -- start start 2026-02-13T02:31:03.113 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f4427682640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f44201675a0 0x7f4420165610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:03.113 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f4427682640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f44201481b0 0x7f4420167970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:03.113 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f4427682640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f44201326d0 0x7f44200b2b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:03.113 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f4427682640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7f44200bd240 con 0x7f44201326d0 2026-02-13T02:31:03.114 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f4427682640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7f442009e2d0 con 0x7f44201481b0 2026-02-13T02:31:03.114 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f4427682640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7f442009e150 con 0x7f44201675a0 2026-02-13T02:31:03.114 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f4425bf8640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f44201326d0 0x7f44200b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:03.114 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f4425bf8640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f44201326d0 0x7f44200b2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:38826/0 (socket says 10.20.193.121:38826) 2026-02-13T02:31:03.114 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f4425bf8640 1 -- 10.20.193.121:0/2139489775 learned_addr learned my addr 10.20.193.121:0/2139489775 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:03.114 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f4424bf6640 1 --2- 10.20.193.121:0/2139489775 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f44201481b0 0x7f4420167970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:03.114 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f44253f7640 1 --2- 10.20.193.121:0/2139489775 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f44201675a0 0x7f4420165610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:03.114 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f4425bf8640 1 -- 10.20.193.121:0/2139489775 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f44201675a0 msgr2=0x7f4420165610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:03.114 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f4425bf8640 1 --2- 10.20.193.121:0/2139489775 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f44201675a0 0x7f4420165610 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:03.114 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f4425bf8640 1 -- 10.20.193.121:0/2139489775 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f44201481b0 msgr2=0x7f4420167970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:03.114 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f4425bf8640 1 --2- 10.20.193.121:0/2139489775 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f44201481b0 0x7f4420167970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:03.114 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f4425bf8640 1 -- 10.20.193.121:0/2139489775 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4420131f10 con 0x7f44201326d0 2026-02-13T02:31:03.115 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f4425bf8640 1 --2- 10.20.193.121:0/2139489775 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f44201326d0 0x7f44200b2b90 secure :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f441c00afd0 tx=0x7f441c009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:03.115 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f440dffb640 1 -- 10.20.193.121:0/2139489775 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f441c0b2040 con 0x7f44201326d0 2026-02-13T02:31:03.115 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f440dffb640 1 -- 10.20.193.121:0/2139489775 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f441c00a280 con 0x7f44201326d0 2026-02-13T02:31:03.115 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f440dffb640 1 -- 10.20.193.121:0/2139489775 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f441c0b6410 con 0x7f44201326d0 2026-02-13T02:31:03.115 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f4427682640 1 -- 10.20.193.121:0/2139489775 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4420135fa0 con 0x7f44201326d0 2026-02-13T02:31:03.115 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f4427682640 1 -- 10.20.193.121:0/2139489775 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44201650e0 con 0x7f44201326d0 2026-02-13T02:31:03.115 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f4427682640 1 -- 10.20.193.121:0/2139489775 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f442014bfb0 con 0x7f44201326d0 2026-02-13T02:31:03.115 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f440dffb640 1 -- 10.20.193.121:0/2139489775 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 4) ==== 100030+0+0 (secure 0 0 0) 0x7f441c0c8070 con 0x7f44201326d0 2026-02-13T02:31:03.116 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f440dffb640 1 --2- 10.20.193.121:0/2139489775 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f43f00740b0 0x7f43f0094560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:03.116 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f44253f7640 1 --2- 10.20.193.121:0/2139489775 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f43f00740b0 0x7f43f0094560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:03.116 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f440dffb640 1 -- 10.20.193.121:0/2139489775 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1640+0+0 (secure 0 0 0) 0x7f441c0bc020 con 0x7f44201326d0 2026-02-13T02:31:03.116 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.104+0000 7f44253f7640 1 --2- 10.20.193.121:0/2139489775 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f43f00740b0 0x7f43f0094560 secure :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f442014b7d0 tx=0x7f4410009260 comp rx=0 tx=0).ready entity=mgr.4155 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:03.116 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.108+0000 7f440dffb640 1 -- 10.20.193.121:0/2139489775 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (secure 0 0 0) 0x7f441c0c5020 con 0x7f44201326d0 2026-02-13T02:31:03.203 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.196+0000 7f4427682640 1 -- 10.20.193.121:0/2139489775 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f442014bcd0 con 0x7f44201326d0 2026-02-13T02:31:03.204 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.196+0000 7f440dffb640 1 -- 10.20.193.121:0/2139489775 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7056 (secure 0 0 0) 0x7f441c017dc0 con 0x7f44201326d0 2026-02-13T02:31:03.204 INFO:teuthology.misc.health.trial121.stdout: 2026-02-13T02:31:03.205 INFO:teuthology.misc.health.trial121.stdout:{"epoch":10,"fsid":"58020caa-1bc7-4445-b2fc-3f075ab46105","created":"2026-02-13T02:30:58.802931+0000","modified":"2026-02-13T02:31:02.036447+0000","last_up_change":"0.000000","last_in_change":"2026-02-13T02:31:02.036447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1bbcd75b-e678-4cb7-b625-1475960a9cb7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8e4f3373-8bf0-4119-9e36-38ae77f57ad1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f88cfbd7-657c-42c3-848e-d41286534244","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e4972ad7-8b35-4f37-99b5-37c7eebb40c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c12b1fa7-7ebd-4fd3-a785-f8e02e0cf3c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7c8786af-1011-41b5-ac07-20302bd12503","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4da5620f-6851-4da1-898d-22654932a4d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"91841061-fa38-436d-b719-90cbf2f1830d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T02:31:03.206 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.196+0000 7f4427682640 1 -- 10.20.193.121:0/2139489775 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f43f00740b0 msgr2=0x7f43f0094560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:03.206 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.196+0000 7f4427682640 1 --2- 10.20.193.121:0/2139489775 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f43f00740b0 0x7f43f0094560 secure :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f442014b7d0 tx=0x7f4410009260 comp rx=0 tx=0).stop 2026-02-13T02:31:03.206 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.196+0000 7f4427682640 1 -- 10.20.193.121:0/2139489775 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f44201326d0 msgr2=0x7f44200b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:03.206 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.196+0000 7f4427682640 1 --2- 10.20.193.121:0/2139489775 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f44201326d0 0x7f44200b2b90 secure :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f441c00afd0 tx=0x7f441c009c60 comp rx=0 tx=0).stop 2026-02-13T02:31:03.206 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.196+0000 7f4427682640 1 -- 10.20.193.121:0/2139489775 shutdown_connections 2026-02-13T02:31:03.206 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.196+0000 7f4427682640 1 --2- 10.20.193.121:0/2139489775 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f43f00740b0 0x7f43f0094560 unknown :-1 s=CLOSED pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:03.206 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.196+0000 7f4427682640 1 --2- 10.20.193.121:0/2139489775 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f44201326d0 0x7f44200b2b90 unknown :-1 s=CLOSED pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:03.206 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.196+0000 7f4427682640 1 --2- 10.20.193.121:0/2139489775 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f44201481b0 0x7f4420167970 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:03.206 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.196+0000 7f4427682640 1 --2- 10.20.193.121:0/2139489775 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f44201675a0 0x7f4420165610 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:03.206 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.196+0000 7f4427682640 1 -- 10.20.193.121:0/2139489775 >> 10.20.193.121:0/2139489775 conn(0x7f4420054c00 msgr2=0x7f44200a24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:03.207 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.196+0000 7f4427682640 1 -- 10.20.193.121:0/2139489775 shutdown_connections 2026-02-13T02:31:03.207 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:03.196+0000 7f4427682640 1 -- 10.20.193.121:0/2139489775 wait complete. 2026-02-13T02:31:03.215 DEBUG:teuthology.misc:0 of 8 OSDs are up 2026-02-13T02:31:03.546 INFO:tasks.ceph.osd.6.trial178.stderr:2026-02-13T02:31:03.542+0000 7faf9007da40 -1 osd.6 0 log_to_monitors true 2026-02-13T02:31:03.626 INFO:tasks.ceph.osd.1.trial121.stderr:2026-02-13T02:31:03.616+0000 7f6622bdba40 -1 osd.1 0 log_to_monitors true 2026-02-13T02:31:03.631 INFO:tasks.ceph.osd.5.trial178.stderr:2026-02-13T02:31:03.626+0000 7f0f38e65a40 -1 osd.5 0 log_to_monitors true 2026-02-13T02:31:03.636 INFO:tasks.ceph.osd.2.trial121.stderr:2026-02-13T02:31:03.628+0000 7f9d8b261a40 -1 osd.2 0 log_to_monitors true 2026-02-13T02:31:03.642 INFO:tasks.ceph.osd.4.trial178.stderr:2026-02-13T02:31:03.638+0000 7f6816f66a40 -1 osd.4 0 log_to_monitors true 2026-02-13T02:31:03.645 INFO:tasks.ceph.osd.7.trial178.stderr:2026-02-13T02:31:03.638+0000 7f99ea87ca40 -1 osd.7 0 log_to_monitors true 2026-02-13T02:31:03.717 INFO:tasks.ceph.osd.0.trial121.stderr:2026-02-13T02:31:03.708+0000 7f097b1f9a40 -1 osd.0 0 log_to_monitors true 2026-02-13T02:31:03.745 INFO:tasks.ceph.osd.3.trial121.stderr:2026-02-13T02:31:03.736+0000 7f7749378a40 -1 osd.3 0 log_to_monitors true 2026-02-13T02:31:04.236 DEBUG:teuthology.orchestra.run.trial121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-13T02:31:04.239 DEBUG:teuthology.orchestra.run.trial178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-13T02:31:04.351 INFO:tasks.ceph.mgr.y.trial121.stderr:WARNING:root:not enough osds to create mgr pool 2026-02-13T02:31:04.351 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:Sleeping for 2 seconds 2026-02-13T02:31:05.051 INFO:tasks.ceph.osd.6.trial178.stderr:2026-02-13T02:31:05.046+0000 7faf8c027640 -1 osd.6 0 waiting for initial osdmap 2026-02-13T02:31:05.052 INFO:tasks.ceph.osd.1.trial121.stderr:2026-02-13T02:31:05.044+0000 7f661eb85640 -1 osd.1 0 waiting for initial osdmap 2026-02-13T02:31:05.052 INFO:tasks.ceph.osd.4.trial178.stderr:2026-02-13T02:31:05.046+0000 7f6812f10640 -1 osd.4 0 waiting for initial osdmap 2026-02-13T02:31:05.053 INFO:tasks.ceph.osd.3.trial121.stderr:2026-02-13T02:31:05.044+0000 7f7745322640 -1 osd.3 0 waiting for initial osdmap 2026-02-13T02:31:05.053 INFO:tasks.ceph.osd.5.trial178.stderr:2026-02-13T02:31:05.046+0000 7f0f34e0f640 -1 osd.5 0 waiting for initial osdmap 2026-02-13T02:31:05.053 INFO:tasks.ceph.osd.2.trial121.stderr:2026-02-13T02:31:05.044+0000 7f9d8720b640 -1 osd.2 0 waiting for initial osdmap 2026-02-13T02:31:05.053 INFO:tasks.ceph.osd.7.trial178.stderr:2026-02-13T02:31:05.046+0000 7f99e6826640 -1 osd.7 0 waiting for initial osdmap 2026-02-13T02:31:05.054 INFO:tasks.ceph.osd.0.trial121.stderr:2026-02-13T02:31:05.044+0000 7f09771a3640 -1 osd.0 0 waiting for initial osdmap 2026-02-13T02:31:05.055 INFO:tasks.ceph.osd.4.trial178.stderr:2026-02-13T02:31:05.050+0000 7f680a5df640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:31:05.056 INFO:tasks.ceph.osd.5.trial178.stderr:2026-02-13T02:31:05.050+0000 7f0f2c4de640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:31:05.056 INFO:tasks.ceph.osd.7.trial178.stderr:2026-02-13T02:31:05.050+0000 7f99ddef5640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:31:05.056 INFO:tasks.ceph.osd.6.trial178.stderr:2026-02-13T02:31:05.050+0000 7faf836f6640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:31:05.057 INFO:tasks.ceph.osd.0.trial121.stderr:2026-02-13T02:31:05.048+0000 7f096e872640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:31:05.057 INFO:tasks.ceph.osd.3.trial121.stderr:2026-02-13T02:31:05.048+0000 7f773c9f1640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:31:05.057 INFO:tasks.ceph.osd.1.trial121.stderr:2026-02-13T02:31:05.048+0000 7f6616254640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:31:05.057 INFO:tasks.ceph.osd.2.trial121.stderr:2026-02-13T02:31:05.048+0000 7f9d7e8da640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:31:05.356 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:PerfHandler: tick 2026-02-13T02:31:05.356 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:TaskHandler: tick 2026-02-13T02:31:06.351 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:creating mgr pool 2026-02-13T02:31:06.352 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:creating new mgr pool 2026-02-13T02:31:07.058 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:mon_command: 'osd pool create' -> 0 in 0.706s 2026-02-13T02:31:08.061 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:mon_command: 'osd pool application enable' -> 0 in 1.003s 2026-02-13T02:31:08.061 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:using uri file:///.mgr:devicehealth/main.db?vfs=ceph 2026-02-13T02:31:08.151 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:new libcephsqlite addrv = 10.20.193.121:0/2556358360 2026-02-13T02:31:08.157 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:creating main.db for devicehealth 2026-02-13T02:31:08.163 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:Running 2026-02-13T02:31:08.169 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:finished reading legacy pool, complete = True 2026-02-13T02:31:08.169 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:get_kv('last_scrape') 2026-02-13T02:31:08.171 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:Last scrape None 2026-02-13T02:31:08.171 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:Check health 2026-02-13T02:31:08.174 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:Last scrape never, next scrape due 20260213-023108 2026-02-13T02:31:08.175 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:do_scrape_daemon osd.0 2026-02-13T02:31:08.209 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:created device MTFDKCC1T9TGP-1BK1JABYY_092510AB6C1D 2026-02-13T02:31:08.218 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:updating MTFDKCC1T9TGP-1BK1JABYY_092510AB6C1D wear level to 0.0 2026-02-13T02:31:08.220 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:do_scrape_daemon osd.1 2026-02-13T02:31:08.253 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:skipping duplicate MTFDKCC1T9TGP-1BK1JABYY_092510AB6C1D 2026-02-13T02:31:08.254 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:do_scrape_daemon osd.2 2026-02-13T02:31:08.286 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:created device MTFDKCC1T9TGP-1BK1JABYY_012510B0043D 2026-02-13T02:31:08.295 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:updating MTFDKCC1T9TGP-1BK1JABYY_012510B0043D wear level to 0.0 2026-02-13T02:31:08.298 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:do_scrape_daemon osd.3 2026-02-13T02:31:08.330 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:skipping duplicate MTFDKCC1T9TGP-1BK1JABYY_012510B0043D 2026-02-13T02:31:08.330 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:do_scrape_daemon osd.4 2026-02-13T02:31:08.367 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:created device MTFDKCC1T9TGP-1BK1JABYY_012510B002B9 2026-02-13T02:31:08.376 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:updating MTFDKCC1T9TGP-1BK1JABYY_012510B002B9 wear level to 0.0 2026-02-13T02:31:08.378 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:do_scrape_daemon osd.5 2026-02-13T02:31:08.412 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:skipping duplicate MTFDKCC1T9TGP-1BK1JABYY_012510B002B9 2026-02-13T02:31:08.412 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:do_scrape_daemon osd.6 2026-02-13T02:31:08.446 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:created device MTFDKCC1T9TGP-1BK1JABYY_012510B002C3 2026-02-13T02:31:08.455 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:updating MTFDKCC1T9TGP-1BK1JABYY_012510B002C3 wear level to 0.0 2026-02-13T02:31:08.456 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:do_scrape_daemon osd.7 2026-02-13T02:31:08.488 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:skipping duplicate MTFDKCC1T9TGP-1BK1JABYY_012510B002C3 2026-02-13T02:31:08.488 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:do_scrape_daemon mon.a 2026-02-13T02:31:08.519 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:skipping duplicate MTFDKCC1T9TGP-1BK1JABYY_092510AB6C1D 2026-02-13T02:31:08.519 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:do_scrape_daemon mon.b 2026-02-13T02:31:08.549 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:skipping duplicate MTFDKCC1T9TGP-1BK1JABYY_012510B002B9 2026-02-13T02:31:08.549 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:do_scrape_daemon mon.c 2026-02-13T02:31:08.581 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:skipping duplicate MTFDKCC1T9TGP-1BK1JABYY_012510B002B9 2026-02-13T02:31:08.581 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:set_kv('last_scrape', '20260213-023108') 2026-02-13T02:31:08.589 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:Sleeping for 600 seconds 2026-02-13T02:31:10.021 DEBUG:teuthology.orchestra.run.trial121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-13T02:31:10.080 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9939226640 1 -- 10.20.193.121:0/368556711 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f993415d520 msgr2=0x7f99340b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:10.080 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9939226640 1 --2- 10.20.193.121:0/368556711 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f993415d520 0x7f99340b8830 secure :-1 s=READY pgs=109 gs=3 cs=0 l=1 c_cookie=9872658314762028513 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f991c005eb0 tx=0x7f991c01c970 comp rx=0 tx=0).stop 2026-02-13T02:31:10.081 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9939226640 1 -- 10.20.193.121:0/368556711 shutdown_connections 2026-02-13T02:31:10.081 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9939226640 1 --2- 10.20.193.121:0/368556711 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f993415d520 0x7f99340b8830 unknown :-1 s=CLOSED pgs=109 gs=3 cs=0 l=1 c_cookie=9872658314762028513 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:10.081 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9939226640 1 -- 10.20.193.121:0/368556711 >> 10.20.193.121:0/368556711 conn(0x7f993409c520 msgr2=0x7f9934054370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:10.081 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9939226640 1 -- 10.20.193.121:0/368556711 shutdown_connections 2026-02-13T02:31:10.081 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9939226640 1 -- 10.20.193.121:0/368556711 wait complete. 2026-02-13T02:31:10.083 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9939226640 1 Processor -- start 2026-02-13T02:31:10.084 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9939226640 1 -- start start 2026-02-13T02:31:10.084 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9939226640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f993415d150 0x7f9934141660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:10.084 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9939226640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f993415d520 0x7f993417f1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:10.084 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9939226640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f9934169f10 0x7f9934099dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:10.084 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9939226640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7f99341ce470 con 0x7f993415d520 2026-02-13T02:31:10.084 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9939226640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7f99341ce2f0 con 0x7f9934169f10 2026-02-13T02:31:10.084 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9939226640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7f99341ce5f0 con 0x7f993415d150 2026-02-13T02:31:10.084 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9932575640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f993415d520 0x7f993417f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:10.084 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9932575640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f993415d520 0x7f993417f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:40558/0 (socket says 10.20.193.121:40558) 2026-02-13T02:31:10.084 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9932575640 1 -- 10.20.193.121:0/3305895510 learned_addr learned my addr 10.20.193.121:0/3305895510 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:10.085 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9933577640 1 --2- 10.20.193.121:0/3305895510 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f9934169f10 0x7f9934099dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:10.085 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9932575640 1 -- 10.20.193.121:0/3305895510 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f993415d150 msgr2=0x7f9934141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:10.085 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9932575640 1 --2- 10.20.193.121:0/3305895510 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f993415d150 0x7f9934141660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:10.085 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9932575640 1 -- 10.20.193.121:0/3305895510 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f9934169f10 msgr2=0x7f9934099dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:10.085 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9932575640 1 --2- 10.20.193.121:0/3305895510 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f9934169f10 0x7f9934099dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:10.085 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9932575640 1 -- 10.20.193.121:0/3305895510 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f993417b780 con 0x7f993415d520 2026-02-13T02:31:10.085 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9933577640 1 --2- 10.20.193.121:0/3305895510 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f9934169f10 0x7f9934099dd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:31:10.085 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9932575640 1 --2- 10.20.193.121:0/3305895510 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f993415d520 0x7f993417f1e0 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f991c01cee0 tx=0x7f991c005940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:10.085 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f99137fe640 1 -- 10.20.193.121:0/3305895510 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f991c004290 con 0x7f993415d520 2026-02-13T02:31:10.085 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f99137fe640 1 -- 10.20.193.121:0/3305895510 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f991c0026e0 con 0x7f993415d520 2026-02-13T02:31:10.085 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f99137fe640 1 -- 10.20.193.121:0/3305895510 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f991c002ad0 con 0x7f993415d520 2026-02-13T02:31:10.085 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9939226640 1 -- 10.20.193.121:0/3305895510 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f993417ba60 con 0x7f993415d520 2026-02-13T02:31:10.086 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.071+0000 7f9939226640 1 -- 10.20.193.121:0/3305895510 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f993417c020 con 0x7f993415d520 2026-02-13T02:31:10.086 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.075+0000 7f9939226640 1 -- 10.20.193.121:0/3305895510 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9934142a10 con 0x7f993415d520 2026-02-13T02:31:10.086 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.075+0000 7f99137fe640 1 -- 10.20.193.121:0/3305895510 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 5) ==== 100086+0+0 (secure 0 0 0) 0x7f991c002c70 con 0x7f993415d520 2026-02-13T02:31:10.086 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.075+0000 7f99137fe640 1 --2- 10.20.193.121:0/3305895510 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f9900074140 0x7f99000945f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:10.087 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.075+0000 7f9932d76640 1 --2- 10.20.193.121:0/3305895510 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f9900074140 0x7f99000945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:10.087 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.075+0000 7f99137fe640 1 -- 10.20.193.121:0/3305895510 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4851+0+0 (secure 0 0 0) 0x7f991c0b4030 con 0x7f993415d520 2026-02-13T02:31:10.087 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.075+0000 7f9932d76640 1 --2- 10.20.193.121:0/3305895510 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f9900074140 0x7f99000945f0 secure :-1 s=READY pgs=40 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99280037b0 tx=0x7f9928007ab0 comp rx=0 tx=0).ready entity=mgr.4155 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:10.087 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.079+0000 7f99137fe640 1 -- 10.20.193.121:0/3305895510 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (secure 0 0 0) 0x7f991c0bf020 con 0x7f993415d520 2026-02-13T02:31:10.172 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.163+0000 7f9939226640 1 -- 10.20.193.121:0/3305895510 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9934142450 con 0x7f993415d520 2026-02-13T02:31:10.172 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.163+0000 7f99137fe640 1 -- 10.20.193.121:0/3305895510 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12795 (secure 0 0 0) 0x7f991c016590 con 0x7f993415d520 2026-02-13T02:31:10.173 INFO:teuthology.misc.health.trial121.stdout: 2026-02-13T02:31:10.173 INFO:teuthology.misc.health.trial121.stdout:{"epoch":16,"fsid":"58020caa-1bc7-4445-b2fc-3f075ab46105","created":"2026-02-13T02:30:58.802931+0000","modified":"2026-02-13T02:31:09.055506+0000","last_up_change":"2026-02-13T02:31:06.046386+0000","last_in_change":"2026-02-13T02:31:02.036447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T02:31:06.353015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bbcd75b-e678-4cb7-b625-1475960a9cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6818","nonce":4064034701},{"type":"v1","addr":"10.20.193.121:6819","nonce":4064034701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6820","nonce":4064034701},{"type":"v1","addr":"10.20.193.121:6821","nonce":4064034701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6824","nonce":4064034701},{"type":"v1","addr":"10.20.193.121:6825","nonce":4064034701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6822","nonce":4064034701},{"type":"v1","addr":"10.20.193.121:6823","nonce":4064034701}]},"public_addr":"10.20.193.121:6819/4064034701","cluster_addr":"10.20.193.121:6821/4064034701","heartbeat_back_addr":"10.20.193.121:6825/4064034701","heartbeat_front_addr":"10.20.193.121:6823/4064034701","state":["exists","up"]},{"osd":1,"uuid":"8e4f3373-8bf0-4119-9e36-38ae77f57ad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6802","nonce":3452928042},{"type":"v1","addr":"10.20.193.121:6803","nonce":3452928042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6805","nonce":3452928042},{"type":"v1","addr":"10.20.193.121:6806","nonce":3452928042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6811","nonce":3452928042},{"type":"v1","addr":"10.20.193.121:6813","nonce":3452928042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6808","nonce":3452928042},{"type":"v1","addr":"10.20.193.121:6810","nonce":3452928042}]},"public_addr":"10.20.193.121:6803/3452928042","cluster_addr":"10.20.193.121:6806/3452928042","heartbeat_back_addr":"10.20.193.121:6813/3452928042","heartbeat_front_addr":"10.20.193.121:6810/3452928042","state":["exists","up"]},{"osd":2,"uuid":"f88cfbd7-657c-42c3-848e-d41286534244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6804","nonce":1907018650},{"type":"v1","addr":"10.20.193.121:6807","nonce":1907018650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6809","nonce":1907018650},{"type":"v1","addr":"10.20.193.121:6812","nonce":1907018650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6816","nonce":1907018650},{"type":"v1","addr":"10.20.193.121:6817","nonce":1907018650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6814","nonce":1907018650},{"type":"v1","addr":"10.20.193.121:6815","nonce":1907018650}]},"public_addr":"10.20.193.121:6807/1907018650","cluster_addr":"10.20.193.121:6812/1907018650","heartbeat_back_addr":"10.20.193.121:6817/1907018650","heartbeat_front_addr":"10.20.193.121:6815/1907018650","state":["exists","up"]},{"osd":3,"uuid":"e4972ad7-8b35-4f37-99b5-37c7eebb40c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6826","nonce":4123684708},{"type":"v1","addr":"10.20.193.121:6827","nonce":4123684708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6828","nonce":4123684708},{"type":"v1","addr":"10.20.193.121:6829","nonce":4123684708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6832","nonce":4123684708},{"type":"v1","addr":"10.20.193.121:6833","nonce":4123684708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6830","nonce":4123684708},{"type":"v1","addr":"10.20.193.121:6831","nonce":4123684708}]},"public_addr":"10.20.193.121:6827/4123684708","cluster_addr":"10.20.193.121:6829/4123684708","heartbeat_back_addr":"10.20.193.121:6833/4123684708","heartbeat_front_addr":"10.20.193.121:6831/4123684708","state":["exists","up"]},{"osd":4,"uuid":"c12b1fa7-7ebd-4fd3-a785-f8e02e0cf3c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6808","nonce":608607716},{"type":"v1","addr":"10.20.193.178:6809","nonce":608607716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6810","nonce":608607716},{"type":"v1","addr":"10.20.193.178:6811","nonce":608607716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6814","nonce":608607716},{"type":"v1","addr":"10.20.193.178:6815","nonce":608607716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6812","nonce":608607716},{"type":"v1","addr":"10.20.193.178:6813","nonce":608607716}]},"public_addr":"10.20.193.178:6809/608607716","cluster_addr":"10.20.193.178:6811/608607716","heartbeat_back_addr":"10.20.193.178:6815/608607716","heartbeat_front_addr":"10.20.193.178:6813/608607716","state":["exists","up"]},{"osd":5,"uuid":"7c8786af-1011-41b5-ac07-20302bd12503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6824","nonce":3784702419},{"type":"v1","addr":"10.20.193.178:6825","nonce":3784702419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6826","nonce":3784702419},{"type":"v1","addr":"10.20.193.178:6827","nonce":3784702419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6830","nonce":3784702419},{"type":"v1","addr":"10.20.193.178:6831","nonce":3784702419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6828","nonce":3784702419},{"type":"v1","addr":"10.20.193.178:6829","nonce":3784702419}]},"public_addr":"10.20.193.178:6825/3784702419","cluster_addr":"10.20.193.178:6827/3784702419","heartbeat_back_addr":"10.20.193.178:6831/3784702419","heartbeat_front_addr":"10.20.193.178:6829/3784702419","state":["exists","up"]},{"osd":6,"uuid":"4da5620f-6851-4da1-898d-22654932a4d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6800","nonce":3993947833},{"type":"v1","addr":"10.20.193.178:6801","nonce":3993947833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6802","nonce":3993947833},{"type":"v1","addr":"10.20.193.178:6803","nonce":3993947833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6806","nonce":3993947833},{"type":"v1","addr":"10.20.193.178:6807","nonce":3993947833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6804","nonce":3993947833},{"type":"v1","addr":"10.20.193.178:6805","nonce":3993947833}]},"public_addr":"10.20.193.178:6801/3993947833","cluster_addr":"10.20.193.178:6803/3993947833","heartbeat_back_addr":"10.20.193.178:6807/3993947833","heartbeat_front_addr":"10.20.193.178:6805/3993947833","state":["exists","up"]},{"osd":7,"uuid":"91841061-fa38-436d-b719-90cbf2f1830d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6816","nonce":1274696415},{"type":"v1","addr":"10.20.193.178:6817","nonce":1274696415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6818","nonce":1274696415},{"type":"v1","addr":"10.20.193.178:6819","nonce":1274696415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6822","nonce":1274696415},{"type":"v1","addr":"10.20.193.178:6823","nonce":1274696415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6820","nonce":1274696415},{"type":"v1","addr":"10.20.193.178:6821","nonce":1274696415}]},"public_addr":"10.20.193.178:6817/1274696415","cluster_addr":"10.20.193.178:6819/1274696415","heartbeat_back_addr":"10.20.193.178:6823/1274696415","heartbeat_front_addr":"10.20.193.178:6821/1274696415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T02:31:10.174 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.163+0000 7f9939226640 1 -- 10.20.193.121:0/3305895510 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f9900074140 msgr2=0x7f99000945f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:10.174 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.163+0000 7f9939226640 1 --2- 10.20.193.121:0/3305895510 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f9900074140 0x7f99000945f0 secure :-1 s=READY pgs=40 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99280037b0 tx=0x7f9928007ab0 comp rx=0 tx=0).stop 2026-02-13T02:31:10.174 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.163+0000 7f9939226640 1 -- 10.20.193.121:0/3305895510 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f993415d520 msgr2=0x7f993417f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:10.174 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.163+0000 7f9939226640 1 --2- 10.20.193.121:0/3305895510 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f993415d520 0x7f993417f1e0 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f991c01cee0 tx=0x7f991c005940 comp rx=0 tx=0).stop 2026-02-13T02:31:10.175 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.163+0000 7f9939226640 1 -- 10.20.193.121:0/3305895510 shutdown_connections 2026-02-13T02:31:10.175 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.163+0000 7f9939226640 1 --2- 10.20.193.121:0/3305895510 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f9900074140 0x7f99000945f0 unknown :-1 s=CLOSED pgs=40 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:10.175 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.163+0000 7f9939226640 1 --2- 10.20.193.121:0/3305895510 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f9934169f10 0x7f9934099dd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:10.175 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.163+0000 7f9939226640 1 --2- 10.20.193.121:0/3305895510 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f993415d520 0x7f993417f1e0 unknown :-1 s=CLOSED pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:10.175 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.163+0000 7f9939226640 1 --2- 10.20.193.121:0/3305895510 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f993415d150 0x7f9934141660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:10.175 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.163+0000 7f9939226640 1 -- 10.20.193.121:0/3305895510 >> 10.20.193.121:0/3305895510 conn(0x7f993409c520 msgr2=0x7f99341648c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:10.175 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.163+0000 7f9939226640 1 -- 10.20.193.121:0/3305895510 shutdown_connections 2026-02-13T02:31:10.175 INFO:teuthology.misc.health.trial121.stderr:2026-02-13T02:31:10.163+0000 7f9939226640 1 -- 10.20.193.121:0/3305895510 wait complete. 2026-02-13T02:31:10.184 DEBUG:teuthology.misc:8 of 8 OSDs are up 2026-02-13T02:31:10.184 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-13T02:31:10.185 INFO:tasks.ceph.mds.a:Restarting daemon 2026-02-13T02:31:10.185 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2026-02-13T02:31:10.187 INFO:tasks.ceph.mds.a:Started 2026-02-13T02:31:10.187 INFO:tasks.ceph.mds.c:Restarting daemon 2026-02-13T02:31:10.187 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2026-02-13T02:31:10.189 INFO:tasks.ceph.mds.c:Started 2026-02-13T02:31:10.189 INFO:tasks.ceph.mds.b:Restarting daemon 2026-02-13T02:31:10.189 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2026-02-13T02:31:10.239 INFO:tasks.ceph.mds.a.trial121.stdout:starting mds.a at 2026-02-13T02:31:10.240 INFO:tasks.ceph.mds.c.trial121.stdout:starting mds.c at 2026-02-13T02:31:10.240 INFO:tasks.ceph.mds.b:Started 2026-02-13T02:31:10.240 INFO:tasks.ceph.mds.d:Restarting daemon 2026-02-13T02:31:10.240 DEBUG:teuthology.orchestra.run.trial178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2026-02-13T02:31:10.242 INFO:tasks.ceph.mds.d:Started 2026-02-13T02:31:10.242 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2026-02-13T02:31:10.242 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2026-02-13T02:31:10.277 INFO:tasks.ceph.mds.b.trial178.stdout:starting mds.b at 2026-02-13T02:31:10.287 INFO:tasks.ceph.mds.d.trial178.stdout:starting mds.d at 2026-02-13T02:31:10.310 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.299+0000 7f5eef590640 1 -- 10.20.193.121:0/4126669202 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f5ed0004180 msgr2=0x7f5ed00048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:10.310 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.299+0000 7f5eef590640 1 --2- 10.20.193.121:0/4126669202 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f5ed0004180 0x7f5ed00048d0 secure :-1 s=READY pgs=117 gs=4 cs=0 l=1 c_cookie=11516089803547904249 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ee80bbd50 tx=0x7f5edc01f760 comp rx=0 tx=0).stop 2026-02-13T02:31:10.310 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.299+0000 7f5eedb06640 1 -- 10.20.193.121:0/4126669202 reap_dead start 2026-02-13T02:31:10.310 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.299+0000 7f5eef590640 1 -- 10.20.193.121:0/4126669202 shutdown_connections 2026-02-13T02:31:10.310 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.299+0000 7f5eef590640 1 -- 10.20.193.121:0/4126669202 >> 10.20.193.121:0/4126669202 conn(0x7f5ee80a16e0 msgr2=0x7f5ee80bbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:10.310 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.299+0000 7f5eef590640 1 -- 10.20.193.121:0/4126669202 shutdown_connections 2026-02-13T02:31:10.310 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.299+0000 7f5eef590640 1 -- 10.20.193.121:0/4126669202 wait complete. 2026-02-13T02:31:10.311 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eef590640 1 Processor -- start 2026-02-13T02:31:10.311 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eef590640 1 -- start start 2026-02-13T02:31:10.313 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eef590640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f5ed0004180 0x7f5ee80b7bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:10.313 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eef590640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f5ee8166df0 0x7f5ee80b4800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:10.313 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eef590640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f5ee80b4d40 0x7f5ee8204d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:10.314 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eef590640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee8168c80 con 0x7f5ee80b4d40 2026-02-13T02:31:10.314 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eef590640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee8058450 con 0x7f5ee8166df0 2026-02-13T02:31:10.314 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eef590640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7f5ee8168e00 con 0x7f5ed0004180 2026-02-13T02:31:10.314 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eedb06640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f5ee80b4d40 0x7f5ee8204d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:10.314 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eedb06640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f5ee80b4d40 0x7f5ee8204d10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:40604/0 (socket says 10.20.193.121:40604) 2026-02-13T02:31:10.314 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eedb06640 1 -- 10.20.193.121:0/1937603179 learned_addr learned my addr 10.20.193.121:0/1937603179 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:10.314 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eecb04640 1 --2- 10.20.193.121:0/1937603179 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f5ee8166df0 0x7f5ee80b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:10.314 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eed305640 1 --2- 10.20.193.121:0/1937603179 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f5ed0004180 0x7f5ee80b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:10.314 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eedb06640 1 -- 10.20.193.121:0/1937603179 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f5ed0004180 msgr2=0x7f5ee80b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:10.314 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eedb06640 1 --2- 10.20.193.121:0/1937603179 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f5ed0004180 0x7f5ee80b7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:10.314 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eedb06640 1 -- 10.20.193.121:0/1937603179 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f5ee8166df0 msgr2=0x7f5ee80b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:10.315 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eedb06640 1 --2- 10.20.193.121:0/1937603179 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f5ee8166df0 0x7f5ee80b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:10.315 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eedb06640 1 -- 10.20.193.121:0/1937603179 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee80b83c0 con 0x7f5ee80b4d40 2026-02-13T02:31:10.315 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eecb04640 1 --2- 10.20.193.121:0/1937603179 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f5ee8166df0 0x7f5ee80b4800 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:31:10.315 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eedb06640 1 --2- 10.20.193.121:0/1937603179 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f5ee80b4d40 0x7f5ee8204d10 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ee8056c40 tx=0x7f5ee4005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:10.315 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5ed5ffb640 1 -- 10.20.193.121:0/1937603179 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ee4016020 con 0x7f5ee80b4d40 2026-02-13T02:31:10.315 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5ed5ffb640 1 -- 10.20.193.121:0/1937603179 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ee4012a60 con 0x7f5ee80b4d40 2026-02-13T02:31:10.315 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5ed5ffb640 1 -- 10.20.193.121:0/1937603179 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ee40113c0 con 0x7f5ee80b4d40 2026-02-13T02:31:10.315 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eef590640 1 -- 10.20.193.121:0/1937603179 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ee80b86a0 con 0x7f5ee80b4d40 2026-02-13T02:31:10.315 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eef590640 1 -- 10.20.193.121:0/1937603179 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ee80b8c60 con 0x7f5ee80b4d40 2026-02-13T02:31:10.315 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eef590640 1 -- 10.20.193.121:0/1937603179 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ee809e610 con 0x7f5ee80b4d40 2026-02-13T02:31:10.315 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5ed5ffb640 1 -- 10.20.193.121:0/1937603179 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 5) ==== 100086+0+0 (secure 0 0 0) 0x7f5ee4011560 con 0x7f5ee80b4d40 2026-02-13T02:31:10.316 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5ed5ffb640 1 --2- 10.20.193.121:0/1937603179 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f5eb8074140 0x7f5eb80945f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:10.316 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5ed5ffb640 1 -- 10.20.193.121:0/1937603179 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4851+0+0 (secure 0 0 0) 0x7f5ee4097b10 con 0x7f5ee80b4d40 2026-02-13T02:31:10.316 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eed305640 1 --2- 10.20.193.121:0/1937603179 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f5eb8074140 0x7f5eb80945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:10.316 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.303+0000 7f5eed305640 1 --2- 10.20.193.121:0/1937603179 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f5eb8074140 0x7f5eb80945f0 secure :-1 s=READY pgs=42 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ed8005e70 tx=0x7f5ed8005d40 comp rx=0 tx=0).ready entity=mgr.4155 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:10.316 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.307+0000 7f5ed5ffb640 1 -- 10.20.193.121:0/1937603179 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (secure 0 0 0) 0x7f5ee4020020 con 0x7f5ee80b4d40 2026-02-13T02:31:10.356 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:PerfHandler: tick 2026-02-13T02:31:10.356 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:TaskHandler: tick 2026-02-13T02:31:10.370 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:Not sending report until user re-opts-in 2026-02-13T02:31:10.426 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.415+0000 7f5eef590640 1 -- 10.20.193.121:0/1937603179 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ee816a860 con 0x7f5ee80b4d40 2026-02-13T02:31:10.426 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.415+0000 7f5ed5ffb640 1 -- 10.20.193.121:0/1937603179 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7f5ee4062150 con 0x7f5ee80b4d40 2026-02-13T02:31:10.426 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:31:10.427 INFO:teuthology.orchestra.run.trial121.stdout:{"epoch":2,"btime":"2026-02-13T02:31:10:229488+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4341,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.121:6837/3462984922","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6836","nonce":3462984922},{"type":"v1","addr":"10.20.193.121:6837","nonce":3462984922}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2026-02-13T02:31:10.427 INFO:teuthology.orchestra.run.trial121.stderr:dumped fsmap epoch 2 2026-02-13T02:31:10.428 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.419+0000 7f5eef590640 1 -- 10.20.193.121:0/1937603179 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f5eb8074140 msgr2=0x7f5eb80945f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:10.428 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.419+0000 7f5eef590640 1 --2- 10.20.193.121:0/1937603179 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f5eb8074140 0x7f5eb80945f0 secure :-1 s=READY pgs=42 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ed8005e70 tx=0x7f5ed8005d40 comp rx=0 tx=0).stop 2026-02-13T02:31:10.428 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.419+0000 7f5eef590640 1 -- 10.20.193.121:0/1937603179 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f5ee80b4d40 msgr2=0x7f5ee8204d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:10.428 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.419+0000 7f5eef590640 1 --2- 10.20.193.121:0/1937603179 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f5ee80b4d40 0x7f5ee8204d10 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ee8056c40 tx=0x7f5ee4005bc0 comp rx=0 tx=0).stop 2026-02-13T02:31:10.428 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.419+0000 7f5eef590640 1 -- 10.20.193.121:0/1937603179 shutdown_connections 2026-02-13T02:31:10.428 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.419+0000 7f5eef590640 1 --2- 10.20.193.121:0/1937603179 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f5eb8074140 0x7f5eb80945f0 unknown :-1 s=CLOSED pgs=42 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:10.428 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.419+0000 7f5eef590640 1 --2- 10.20.193.121:0/1937603179 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f5ee80b4d40 0x7f5ee8204d10 unknown :-1 s=CLOSED pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:10.428 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.419+0000 7f5eef590640 1 --2- 10.20.193.121:0/1937603179 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f5ee8166df0 0x7f5ee80b4800 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:10.428 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.419+0000 7f5eef590640 1 --2- 10.20.193.121:0/1937603179 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f5ed0004180 0x7f5ee80b7bc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:10.429 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.419+0000 7f5eef590640 1 -- 10.20.193.121:0/1937603179 >> 10.20.193.121:0/1937603179 conn(0x7f5ee80a16e0 msgr2=0x7f5ee80a3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:10.429 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.419+0000 7f5eef590640 1 -- 10.20.193.121:0/1937603179 shutdown_connections 2026-02-13T02:31:10.429 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:10.419+0000 7f5eef590640 1 -- 10.20.193.121:0/1937603179 wait complete. 2026-02-13T02:31:12.438 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2026-02-13T02:31:12.502 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.491+0000 7fd5e450c640 1 -- 10.20.193.121:0/2465449948 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fd5dc0b98d0 msgr2=0x7fd5dc0bea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:12.503 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.491+0000 7fd5e450c640 1 --2- 10.20.193.121:0/2465449948 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fd5dc0b98d0 0x7fd5dc0bea50 secure :-1 s=READY pgs=76 gs=2 cs=0 l=1 c_cookie=13320268921147201287 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5cc004780 tx=0x7fd5cc01c850 comp rx=0 tx=0).stop 2026-02-13T02:31:12.503 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.491+0000 7fd5e450c640 1 -- 10.20.193.121:0/2465449948 shutdown_connections 2026-02-13T02:31:12.503 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.491+0000 7fd5e450c640 1 --2- 10.20.193.121:0/2465449948 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fd5dc0ba920 0x7fd5dc0a3e90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:12.503 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.491+0000 7fd5e450c640 1 --2- 10.20.193.121:0/2465449948 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fd5dc0b98d0 0x7fd5dc0bea50 unknown :-1 s=CLOSED pgs=76 gs=2 cs=0 l=1 c_cookie=13320268921147201287 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:12.503 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.491+0000 7fd5e450c640 1 -- 10.20.193.121:0/2465449948 >> 10.20.193.121:0/2465449948 conn(0x7fd5dc0549d0 msgr2=0x7fd5dc0a0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:12.503 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.491+0000 7fd5e450c640 1 -- 10.20.193.121:0/2465449948 shutdown_connections 2026-02-13T02:31:12.503 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.491+0000 7fd5e450c640 1 -- 10.20.193.121:0/2465449948 wait complete. 2026-02-13T02:31:12.506 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e450c640 1 Processor -- start 2026-02-13T02:31:12.506 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e450c640 1 -- start start 2026-02-13T02:31:12.506 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e450c640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fd5dc0b98d0 0x7fd5dc132940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:12.506 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e450c640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fd5dc0b9ca0 0x7fd5dc14d400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:12.507 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e450c640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fd5dc0ba920 0x7fd5dc1454e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:12.507 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e450c640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc16cbe0 con 0x7fd5dc0b98d0 2026-02-13T02:31:12.507 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e450c640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc16ca60 con 0x7fd5dc0ba920 2026-02-13T02:31:12.507 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e450c640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7fd5dc16cd60 con 0x7fd5dc0b9ca0 2026-02-13T02:31:12.507 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e2281640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fd5dc0b98d0 0x7fd5dc132940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:12.507 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e2281640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fd5dc0b98d0 0x7fd5dc132940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:40610/0 (socket says 10.20.193.121:40610) 2026-02-13T02:31:12.507 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e2281640 1 -- 10.20.193.121:0/1961719127 learned_addr learned my addr 10.20.193.121:0/1961719127 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:12.507 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e1a80640 1 --2- 10.20.193.121:0/1961719127 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fd5dc0b9ca0 0x7fd5dc14d400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:12.507 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e2a82640 1 --2- 10.20.193.121:0/1961719127 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fd5dc0ba920 0x7fd5dc1454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:12.507 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e2281640 1 -- 10.20.193.121:0/1961719127 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fd5dc0b9ca0 msgr2=0x7fd5dc14d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:12.507 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e2281640 1 --2- 10.20.193.121:0/1961719127 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fd5dc0b9ca0 0x7fd5dc14d400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:12.507 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e2281640 1 -- 10.20.193.121:0/1961719127 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fd5dc0ba920 msgr2=0x7fd5dc1454e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:12.508 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e2281640 1 --2- 10.20.193.121:0/1961719127 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fd5dc0ba920 0x7fd5dc1454e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:12.508 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e2281640 1 -- 10.20.193.121:0/1961719127 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5dc145e70 con 0x7fd5dc0b98d0 2026-02-13T02:31:12.508 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e1a80640 1 --2- 10.20.193.121:0/1961719127 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fd5dc0b9ca0 0x7fd5dc14d400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:31:12.508 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e2a82640 1 --2- 10.20.193.121:0/1961719127 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fd5dc0ba920 0x7fd5dc1454e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:31:12.508 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e2281640 1 --2- 10.20.193.121:0/1961719127 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fd5dc0b98d0 0x7fd5dc132940 secure :-1 s=READY pgs=119 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5cc01d0f0 tx=0x7fd5cc0a5710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:12.508 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5c2ffd640 1 -- 10.20.193.121:0/1961719127 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5cc0a5be0 con 0x7fd5dc0b98d0 2026-02-13T02:31:12.508 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5c2ffd640 1 -- 10.20.193.121:0/1961719127 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5cc0a5d80 con 0x7fd5dc0b98d0 2026-02-13T02:31:12.508 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5c2ffd640 1 -- 10.20.193.121:0/1961719127 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5cc002920 con 0x7fd5dc0b98d0 2026-02-13T02:31:12.508 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e450c640 1 -- 10.20.193.121:0/1961719127 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5dc146150 con 0x7fd5dc0b98d0 2026-02-13T02:31:12.508 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e450c640 1 -- 10.20.193.121:0/1961719127 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5dc132420 con 0x7fd5dc0b98d0 2026-02-13T02:31:12.508 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e450c640 1 -- 10.20.193.121:0/1961719127 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5dc0be2f0 con 0x7fd5dc0b98d0 2026-02-13T02:31:12.508 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5c2ffd640 1 -- 10.20.193.121:0/1961719127 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 5) ==== 100086+0+0 (secure 0 0 0) 0x7fd5cc002ac0 con 0x7fd5dc0b98d0 2026-02-13T02:31:12.509 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5c2ffd640 1 --2- 10.20.193.121:0/1961719127 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fd5ac074140 0x7fd5ac0945f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:12.509 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e1a80640 1 --2- 10.20.193.121:0/1961719127 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fd5ac074140 0x7fd5ac0945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:12.509 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5c2ffd640 1 -- 10.20.193.121:0/1961719127 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4851+0+0 (secure 0 0 0) 0x7fd5cc0b4070 con 0x7fd5dc0b98d0 2026-02-13T02:31:12.509 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.495+0000 7fd5e1a80640 1 --2- 10.20.193.121:0/1961719127 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fd5ac074140 0x7fd5ac0945f0 secure :-1 s=READY pgs=46 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5dc16b1e0 tx=0x7fd5d0009260 comp rx=0 tx=0).ready entity=mgr.4155 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:12.509 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.499+0000 7fd5c2ffd640 1 -- 10.20.193.121:0/1961719127 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (secure 0 0 0) 0x7fd5cc0164d0 con 0x7fd5dc0b98d0 2026-02-13T02:31:12.610 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.599+0000 7fd5e450c640 1 -- 10.20.193.121:0/1961719127 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5dc146f40 con 0x7fd5dc0b98d0 2026-02-13T02:31:12.610 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.599+0000 7fd5c2ffd640 1 -- 10.20.193.121:0/1961719127 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3918 (secure 0 0 0) 0x7fd5cc0fa2e0 con 0x7fd5dc0b98d0 2026-02-13T02:31:12.611 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:31:12.611 INFO:teuthology.orchestra.run.trial121.stdout:{"epoch":3,"btime":"2026-02-13T02:31:11:230368+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.121:6835/1203730948","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6834","nonce":1203730948},{"type":"v1","addr":"10.20.193.121:6835","nonce":1203730948}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4341,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.121:6837/3462984922","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6836","nonce":3462984922},{"type":"v1","addr":"10.20.193.121:6837","nonce":3462984922}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4378,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.178:6833/2455821452","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6832","nonce":2455821452},{"type":"v1","addr":"10.20.193.178:6833","nonce":2455821452}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4387,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.178:6835/2386750552","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6834","nonce":2386750552},{"type":"v1","addr":"10.20.193.178:6835","nonce":2386750552}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2026-02-13T02:31:12.612 INFO:teuthology.orchestra.run.trial121.stderr:dumped fsmap epoch 3 2026-02-13T02:31:12.612 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.603+0000 7fd5e450c640 1 -- 10.20.193.121:0/1961719127 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fd5ac074140 msgr2=0x7fd5ac0945f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:12.612 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.603+0000 7fd5e450c640 1 --2- 10.20.193.121:0/1961719127 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fd5ac074140 0x7fd5ac0945f0 secure :-1 s=READY pgs=46 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5dc16b1e0 tx=0x7fd5d0009260 comp rx=0 tx=0).stop 2026-02-13T02:31:12.612 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.603+0000 7fd5e450c640 1 -- 10.20.193.121:0/1961719127 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fd5dc0b98d0 msgr2=0x7fd5dc132940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:12.612 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.603+0000 7fd5e450c640 1 --2- 10.20.193.121:0/1961719127 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fd5dc0b98d0 0x7fd5dc132940 secure :-1 s=READY pgs=119 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5cc01d0f0 tx=0x7fd5cc0a5710 comp rx=0 tx=0).stop 2026-02-13T02:31:12.612 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.603+0000 7fd5e450c640 1 -- 10.20.193.121:0/1961719127 shutdown_connections 2026-02-13T02:31:12.612 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.603+0000 7fd5e450c640 1 --2- 10.20.193.121:0/1961719127 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fd5ac074140 0x7fd5ac0945f0 unknown :-1 s=CLOSED pgs=46 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:12.613 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.603+0000 7fd5e450c640 1 --2- 10.20.193.121:0/1961719127 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fd5dc0ba920 0x7fd5dc1454e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:12.613 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.603+0000 7fd5e450c640 1 --2- 10.20.193.121:0/1961719127 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fd5dc0b9ca0 0x7fd5dc14d400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:12.613 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.603+0000 7fd5e450c640 1 --2- 10.20.193.121:0/1961719127 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fd5dc0b98d0 0x7fd5dc132940 unknown :-1 s=CLOSED pgs=119 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:12.613 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.603+0000 7fd5e450c640 1 -- 10.20.193.121:0/1961719127 >> 10.20.193.121:0/1961719127 conn(0x7fd5dc0549d0 msgr2=0x7fd5dc168430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:12.613 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.603+0000 7fd5e450c640 1 -- 10.20.193.121:0/1961719127 shutdown_connections 2026-02-13T02:31:12.613 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.603+0000 7fd5e450c640 1 -- 10.20.193.121:0/1961719127 wait complete. 2026-02-13T02:31:12.621 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2026-02-13T02:31:12.693 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.683+0000 7f2e66d72640 1 -- 10.20.193.121:0/3452589488 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f2e4c0040d0 msgr2=0x7f2e4c0048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:12.693 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.683+0000 7f2e66d72640 1 --2- 10.20.193.121:0/3452589488 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f2e4c0040d0 0x7f2e4c0048d0 secure :-1 s=READY pgs=121 gs=4 cs=0 l=1 c_cookie=3152486201200221576 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e48003270 tx=0x7f2e4801cea0 comp rx=0 tx=0).stop 2026-02-13T02:31:12.693 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.683+0000 7f2e652e8640 1 -- 10.20.193.121:0/3452589488 reap_dead start 2026-02-13T02:31:12.693 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.683+0000 7f2e66d72640 1 -- 10.20.193.121:0/3452589488 shutdown_connections 2026-02-13T02:31:12.693 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.683+0000 7f2e66d72640 1 -- 10.20.193.121:0/3452589488 >> 10.20.193.121:0/3452589488 conn(0x7f2e600549d0 msgr2=0x7f2e600a0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:12.693 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.683+0000 7f2e66d72640 1 -- 10.20.193.121:0/3452589488 shutdown_connections 2026-02-13T02:31:12.693 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.683+0000 7f2e66d72640 1 -- 10.20.193.121:0/3452589488 wait complete. 2026-02-13T02:31:12.696 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.683+0000 7f2e66d72640 1 Processor -- start 2026-02-13T02:31:12.696 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.683+0000 7f2e66d72640 1 -- start start 2026-02-13T02:31:12.696 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.683+0000 7f2e66d72640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f2e4c0040d0 0x7f2e6012fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:12.697 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.683+0000 7f2e66d72640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f2e60162650 0x7f2e60149390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:12.697 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.683+0000 7f2e66d72640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f2e60162b80 0x7f2e601498d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:12.697 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.683+0000 7f2e66d72640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6016c630 con 0x7f2e4c0040d0 2026-02-13T02:31:12.697 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.683+0000 7f2e66d72640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6016c4b0 con 0x7f2e60162650 2026-02-13T02:31:12.697 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.683+0000 7f2e66d72640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7f2e6016c7b0 con 0x7f2e60162b80 2026-02-13T02:31:12.697 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.683+0000 7f2e64ae7640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f2e4c0040d0 0x7f2e6012fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:12.697 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.683+0000 7f2e64ae7640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f2e4c0040d0 0x7f2e6012fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:40616/0 (socket says 10.20.193.121:40616) 2026-02-13T02:31:12.697 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.683+0000 7f2e64ae7640 1 -- 10.20.193.121:0/3097921751 learned_addr learned my addr 10.20.193.121:0/3097921751 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:12.697 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.683+0000 7f2e57fff640 1 --2- 10.20.193.121:0/3097921751 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f2e60162650 0x7f2e60149390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:12.697 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.683+0000 7f2e652e8640 1 --2- 10.20.193.121:0/3097921751 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f2e60162b80 0x7f2e601498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:12.697 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.687+0000 7f2e64ae7640 1 -- 10.20.193.121:0/3097921751 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f2e60162b80 msgr2=0x7f2e601498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:12.698 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.687+0000 7f2e64ae7640 1 --2- 10.20.193.121:0/3097921751 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f2e60162b80 0x7f2e601498d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:12.698 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.687+0000 7f2e64ae7640 1 -- 10.20.193.121:0/3097921751 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f2e60162650 msgr2=0x7f2e60149390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:12.698 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.687+0000 7f2e64ae7640 1 --2- 10.20.193.121:0/3097921751 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f2e60162650 0x7f2e60149390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:12.698 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.687+0000 7f2e64ae7640 1 -- 10.20.193.121:0/3097921751 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e60144ff0 con 0x7f2e4c0040d0 2026-02-13T02:31:12.698 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.687+0000 7f2e64ae7640 1 --2- 10.20.193.121:0/3097921751 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f2e4c0040d0 0x7f2e6012fda0 secure :-1 s=READY pgs=122 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e500094d0 tx=0x7f2e5000edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:12.698 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.687+0000 7f2e557fa640 1 -- 10.20.193.121:0/3097921751 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e5000cce0 con 0x7f2e4c0040d0 2026-02-13T02:31:12.698 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.687+0000 7f2e557fa640 1 -- 10.20.193.121:0/3097921751 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e50004890 con 0x7f2e4c0040d0 2026-02-13T02:31:12.698 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.687+0000 7f2e557fa640 1 -- 10.20.193.121:0/3097921751 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e50004d00 con 0x7f2e4c0040d0 2026-02-13T02:31:12.698 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.687+0000 7f2e66d72640 1 -- 10.20.193.121:0/3097921751 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e601430d0 con 0x7f2e4c0040d0 2026-02-13T02:31:12.698 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.687+0000 7f2e66d72640 1 -- 10.20.193.121:0/3097921751 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e60143690 con 0x7f2e4c0040d0 2026-02-13T02:31:12.698 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.687+0000 7f2e66d72640 1 -- 10.20.193.121:0/3097921751 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e6009dd10 con 0x7f2e4c0040d0 2026-02-13T02:31:12.698 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.687+0000 7f2e557fa640 1 -- 10.20.193.121:0/3097921751 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 5) ==== 100086+0+0 (secure 0 0 0) 0x7f2e50005020 con 0x7f2e4c0040d0 2026-02-13T02:31:12.699 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.687+0000 7f2e557fa640 1 --2- 10.20.193.121:0/3097921751 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f2e30074140 0x7f2e300945f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:12.699 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.687+0000 7f2e557fa640 1 -- 10.20.193.121:0/3097921751 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4851+0+0 (secure 0 0 0) 0x7f2e50096600 con 0x7f2e4c0040d0 2026-02-13T02:31:12.699 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.687+0000 7f2e57fff640 1 --2- 10.20.193.121:0/3097921751 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f2e30074140 0x7f2e300945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:12.699 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.687+0000 7f2e57fff640 1 --2- 10.20.193.121:0/3097921751 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f2e30074140 0x7f2e300945f0 secure :-1 s=READY pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e48002b70 tx=0x7f2e48019ce0 comp rx=0 tx=0).ready entity=mgr.4155 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:12.700 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.687+0000 7f2e557fa640 1 -- 10.20.193.121:0/3097921751 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (secure 0 0 0) 0x7f2e50060b10 con 0x7f2e4c0040d0 2026-02-13T02:31:12.788 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.779+0000 7f2e66d72640 1 -- 10.20.193.121:0/3097921751 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2e600be2f0 con 0x7f2e4c0040d0 2026-02-13T02:31:12.788 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.779+0000 7f2e557fa640 1 -- 10.20.193.121:0/3097921751 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f2e50066440 con 0x7f2e4c0040d0 2026-02-13T02:31:12.788 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:31:12.788 INFO:teuthology.orchestra.run.trial121.stdout:[ 2026-02-13T02:31:12.788 INFO:teuthology.orchestra.run.trial121.stdout: { 2026-02-13T02:31:12.788 INFO:teuthology.orchestra.run.trial121.stdout: "poolnum": 1, 2026-02-13T02:31:12.788 INFO:teuthology.orchestra.run.trial121.stdout: "poolname": ".mgr" 2026-02-13T02:31:12.789 INFO:teuthology.orchestra.run.trial121.stdout: } 2026-02-13T02:31:12.789 INFO:teuthology.orchestra.run.trial121.stdout:] 2026-02-13T02:31:12.789 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.779+0000 7f2e66d72640 1 -- 10.20.193.121:0/3097921751 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f2e30074140 msgr2=0x7f2e300945f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:12.790 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.779+0000 7f2e66d72640 1 --2- 10.20.193.121:0/3097921751 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f2e30074140 0x7f2e300945f0 secure :-1 s=READY pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e48002b70 tx=0x7f2e48019ce0 comp rx=0 tx=0).stop 2026-02-13T02:31:12.790 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.779+0000 7f2e66d72640 1 -- 10.20.193.121:0/3097921751 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f2e4c0040d0 msgr2=0x7f2e6012fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:12.790 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.779+0000 7f2e66d72640 1 --2- 10.20.193.121:0/3097921751 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f2e4c0040d0 0x7f2e6012fda0 secure :-1 s=READY pgs=122 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e500094d0 tx=0x7f2e5000edd0 comp rx=0 tx=0).stop 2026-02-13T02:31:12.790 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.779+0000 7f2e66d72640 1 -- 10.20.193.121:0/3097921751 shutdown_connections 2026-02-13T02:31:12.790 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.779+0000 7f2e66d72640 1 --2- 10.20.193.121:0/3097921751 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f2e30074140 0x7f2e300945f0 unknown :-1 s=CLOSED pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:12.790 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.779+0000 7f2e66d72640 1 --2- 10.20.193.121:0/3097921751 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f2e60162b80 0x7f2e601498d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:12.790 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.779+0000 7f2e66d72640 1 --2- 10.20.193.121:0/3097921751 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f2e60162650 0x7f2e60149390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:12.790 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.779+0000 7f2e66d72640 1 --2- 10.20.193.121:0/3097921751 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f2e4c0040d0 0x7f2e6012fda0 unknown :-1 s=CLOSED pgs=122 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:12.790 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.779+0000 7f2e66d72640 1 -- 10.20.193.121:0/3097921751 >> 10.20.193.121:0/3097921751 conn(0x7f2e600549d0 msgr2=0x7f2e6016a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:12.790 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.779+0000 7f2e66d72640 1 -- 10.20.193.121:0/3097921751 shutdown_connections 2026-02-13T02:31:12.791 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.779+0000 7f2e66d72640 1 -- 10.20.193.121:0/3097921751 wait complete. 2026-02-13T02:31:12.799 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2026-02-13T02:31:12.799 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2026-02-13T02:31:12.873 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.863+0000 7f9de8ffc640 1 -- 10.20.193.121:0/439661323 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f9de416c8c0 msgr2=0x7f9de409dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:12.873 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.863+0000 7f9de8ffc640 1 --2- 10.20.193.121:0/439661323 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f9de416c8c0 0x7f9de409dd10 secure :-1 s=READY pgs=123 gs=2 cs=0 l=1 c_cookie=17801448878149844880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9dd400a750 tx=0x7f9dd401db40 comp rx=0 tx=0).stop 2026-02-13T02:31:12.873 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.863+0000 7f9de8ffc640 1 -- 10.20.193.121:0/439661323 shutdown_connections 2026-02-13T02:31:12.873 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.863+0000 7f9de8ffc640 1 --2- 10.20.193.121:0/439661323 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f9de416c8c0 0x7f9de409dd10 unknown :-1 s=CLOSED pgs=123 gs=2 cs=0 l=1 c_cookie=17801448878149844880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:12.873 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.863+0000 7f9de8ffc640 1 --2- 10.20.193.121:0/439661323 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f9de40a41f0 0x7f9de40be520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:12.874 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.863+0000 7f9de8ffc640 1 -- 10.20.193.121:0/439661323 >> 10.20.193.121:0/439661323 conn(0x7f9de4054970 msgr2=0x7f9de40a0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:12.874 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.863+0000 7f9de8ffc640 1 -- 10.20.193.121:0/439661323 shutdown_connections 2026-02-13T02:31:12.874 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.863+0000 7f9de8ffc640 1 -- 10.20.193.121:0/439661323 wait complete. 2026-02-13T02:31:12.876 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.863+0000 7f9de8ffc640 1 Processor -- start 2026-02-13T02:31:12.876 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.863+0000 7f9de8ffc640 1 -- start start 2026-02-13T02:31:12.876 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.863+0000 7f9de8ffc640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f9de40a41f0 0x7f9de41633c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:12.876 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.863+0000 7f9de8ffc640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f9de40ba920 0x7f9de416b020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:12.877 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.863+0000 7f9de8ffc640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f9de416c8c0 0x7f9de416b560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:12.877 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.863+0000 7f9de8ffc640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9de40bd4a0 con 0x7f9de40ba920 2026-02-13T02:31:12.877 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.863+0000 7f9de8ffc640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9de40bd320 con 0x7f9de416c8c0 2026-02-13T02:31:12.877 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.863+0000 7f9de8ffc640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7f9de40bd620 con 0x7f9de40a41f0 2026-02-13T02:31:12.877 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.863+0000 7f9de1d74640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f9de40ba920 0x7f9de416b020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:12.877 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.863+0000 7f9de1d74640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f9de40ba920 0x7f9de416b020 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:40628/0 (socket says 10.20.193.121:40628) 2026-02-13T02:31:12.877 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.863+0000 7f9de1d74640 1 -- 10.20.193.121:0/238153640 learned_addr learned my addr 10.20.193.121:0/238153640 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:12.877 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.867+0000 7f9de2d76640 1 --2- 10.20.193.121:0/238153640 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f9de416c8c0 0x7f9de416b560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:12.877 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.867+0000 7f9de2575640 1 --2- 10.20.193.121:0/238153640 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f9de40a41f0 0x7f9de41633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:12.877 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.867+0000 7f9de1d74640 1 -- 10.20.193.121:0/238153640 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f9de40a41f0 msgr2=0x7f9de41633c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:12.877 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.867+0000 7f9de1d74640 1 --2- 10.20.193.121:0/238153640 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f9de40a41f0 0x7f9de41633c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:12.878 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.867+0000 7f9de1d74640 1 -- 10.20.193.121:0/238153640 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f9de416c8c0 msgr2=0x7f9de416b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:12.878 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.867+0000 7f9de1d74640 1 --2- 10.20.193.121:0/238153640 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f9de416c8c0 0x7f9de416b560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:12.878 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.867+0000 7f9de1d74640 1 -- 10.20.193.121:0/238153640 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de4163d00 con 0x7f9de40ba920 2026-02-13T02:31:12.878 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.867+0000 7f9de1d74640 1 --2- 10.20.193.121:0/238153640 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f9de40ba920 0x7f9de416b020 secure :-1 s=READY pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9dcc00c450 tx=0x7f9dcc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:12.878 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.867+0000 7f9dcaffd640 1 -- 10.20.193.121:0/238153640 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9dcc006af0 con 0x7f9de40ba920 2026-02-13T02:31:12.878 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.867+0000 7f9dcaffd640 1 -- 10.20.193.121:0/238153640 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9dcc006d80 con 0x7f9de40ba920 2026-02-13T02:31:12.878 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.867+0000 7f9dcaffd640 1 -- 10.20.193.121:0/238153640 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9dcc0072b0 con 0x7f9de40ba920 2026-02-13T02:31:12.878 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.867+0000 7f9de8ffc640 1 -- 10.20.193.121:0/238153640 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9de4138780 con 0x7f9de40ba920 2026-02-13T02:31:12.878 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.867+0000 7f9de8ffc640 1 -- 10.20.193.121:0/238153640 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9de4138d40 con 0x7f9de40ba920 2026-02-13T02:31:12.878 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.867+0000 7f9de8ffc640 1 -- 10.20.193.121:0/238153640 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9de409dd10 con 0x7f9de40ba920 2026-02-13T02:31:12.878 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.867+0000 7f9dcaffd640 1 -- 10.20.193.121:0/238153640 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 5) ==== 100086+0+0 (secure 0 0 0) 0x7f9dcc023060 con 0x7f9de40ba920 2026-02-13T02:31:12.879 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.867+0000 7f9dcaffd640 1 --2- 10.20.193.121:0/238153640 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f9db0074140 0x7f9db00945f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:12.880 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.867+0000 7f9de2575640 1 --2- 10.20.193.121:0/238153640 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f9db0074140 0x7f9db00945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:12.880 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.867+0000 7f9dcaffd640 1 -- 10.20.193.121:0/238153640 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4851+0+0 (secure 0 0 0) 0x7f9dcc095d40 con 0x7f9de40ba920 2026-02-13T02:31:12.880 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.867+0000 7f9de2575640 1 --2- 10.20.193.121:0/238153640 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f9db0074140 0x7f9db00945f0 secure :-1 s=READY pgs=48 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9dd80059b0 tx=0x7f9dd8005940 comp rx=0 tx=0).ready entity=mgr.4155 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:12.880 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.871+0000 7f9dcaffd640 1 -- 10.20.193.121:0/238153640 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (secure 0 0 0) 0x7f9dcc0222f0 con 0x7f9de40ba920 2026-02-13T02:31:12.964 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:12.955+0000 7f9de8ffc640 1 -- 10.20.193.121:0/238153640 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9de40ba6b0 con 0x7f9de40ba920 2026-02-13T02:31:13.244 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.235+0000 7f9dcaffd640 1 -- 10.20.193.121:0/238153640 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f9dcc060250 con 0x7f9de40ba920 2026-02-13T02:31:13.244 INFO:teuthology.orchestra.run.trial121.stderr:pool 'cephfs_metadata' created 2026-02-13T02:31:13.246 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.235+0000 7f9de8ffc640 1 -- 10.20.193.121:0/238153640 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f9db0074140 msgr2=0x7f9db00945f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:13.246 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.235+0000 7f9de8ffc640 1 --2- 10.20.193.121:0/238153640 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f9db0074140 0x7f9db00945f0 secure :-1 s=READY pgs=48 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9dd80059b0 tx=0x7f9dd8005940 comp rx=0 tx=0).stop 2026-02-13T02:31:13.246 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.235+0000 7f9de8ffc640 1 -- 10.20.193.121:0/238153640 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f9de40ba920 msgr2=0x7f9de416b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:13.246 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.235+0000 7f9de8ffc640 1 --2- 10.20.193.121:0/238153640 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f9de40ba920 0x7f9de416b020 secure :-1 s=READY pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9dcc00c450 tx=0x7f9dcc00c910 comp rx=0 tx=0).stop 2026-02-13T02:31:13.246 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.235+0000 7f9de8ffc640 1 -- 10.20.193.121:0/238153640 shutdown_connections 2026-02-13T02:31:13.246 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.235+0000 7f9de8ffc640 1 --2- 10.20.193.121:0/238153640 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f9db0074140 0x7f9db00945f0 unknown :-1 s=CLOSED pgs=48 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:13.246 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.235+0000 7f9de8ffc640 1 --2- 10.20.193.121:0/238153640 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f9de416c8c0 0x7f9de416b560 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:13.246 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.235+0000 7f9de8ffc640 1 --2- 10.20.193.121:0/238153640 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f9de40ba920 0x7f9de416b020 unknown :-1 s=CLOSED pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:13.246 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.235+0000 7f9de8ffc640 1 --2- 10.20.193.121:0/238153640 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f9de40a41f0 0x7f9de41633c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:13.247 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.235+0000 7f9de8ffc640 1 -- 10.20.193.121:0/238153640 >> 10.20.193.121:0/238153640 conn(0x7f9de4054970 msgr2=0x7f9de40b9650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:13.247 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.235+0000 7f9de8ffc640 1 -- 10.20.193.121:0/238153640 shutdown_connections 2026-02-13T02:31:13.247 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.235+0000 7f9de8ffc640 1 -- 10.20.193.121:0/238153640 wait complete. 2026-02-13T02:31:13.257 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2026-02-13T02:31:13.327 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.315+0000 7fcd9b5fc640 1 -- 10.20.193.121:0/2027404483 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fcd9415f4f0 msgr2=0x7fcd94169680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:13.327 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.315+0000 7fcd9b5fc640 1 --2- 10.20.193.121:0/2027404483 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fcd9415f4f0 0x7fcd94169680 secure :-1 s=READY pgs=126 gs=2 cs=0 l=1 c_cookie=9700317385424876782 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd84005eb0 tx=0x7fcd8401c930 comp rx=0 tx=0).stop 2026-02-13T02:31:13.327 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.315+0000 7fcd9b5fc640 1 -- 10.20.193.121:0/2027404483 shutdown_connections 2026-02-13T02:31:13.327 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.315+0000 7fcd9b5fc640 1 --2- 10.20.193.121:0/2027404483 >> v2:10.20.193.178:3300/0 conn(0x7fcd9409f350 0x7fcd9405e4f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:13.327 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.315+0000 7fcd9b5fc640 1 --2- 10.20.193.121:0/2027404483 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fcd9415f4f0 0x7fcd94169680 unknown :-1 s=CLOSED pgs=126 gs=2 cs=0 l=1 c_cookie=9700317385424876782 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:13.327 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.315+0000 7fcd9b5fc640 1 -- 10.20.193.121:0/2027404483 >> 10.20.193.121:0/2027404483 conn(0x7fcd94057b80 msgr2=0x7fcd9409ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:13.327 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.315+0000 7fcd9b5fc640 1 -- 10.20.193.121:0/2027404483 shutdown_connections 2026-02-13T02:31:13.328 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.315+0000 7fcd9b5fc640 1 -- 10.20.193.121:0/2027404483 wait complete. 2026-02-13T02:31:13.330 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd9b5fc640 1 Processor -- start 2026-02-13T02:31:13.330 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd9b5fc640 1 -- start start 2026-02-13T02:31:13.330 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd9b5fc640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fcd9409b9b0 0x7fcd94125840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:13.330 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd9b5fc640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fcd9409f350 0x7fcd94136580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:13.330 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd9b5fc640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fcd9415f4f0 0x7fcd94136ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:13.330 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd9b5fc640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcd941cf870 con 0x7fcd9415f4f0 2026-02-13T02:31:13.330 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd9b5fc640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7fcd941cf6f0 con 0x7fcd9409f350 2026-02-13T02:31:13.330 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd9b5fc640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7fcd941cf9f0 con 0x7fcd9409b9b0 2026-02-13T02:31:13.331 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd99b72640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fcd9415f4f0 0x7fcd94136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:13.331 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd99b72640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fcd9415f4f0 0x7fcd94136ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:40642/0 (socket says 10.20.193.121:40642) 2026-02-13T02:31:13.331 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd99b72640 1 -- 10.20.193.121:0/612486439 learned_addr learned my addr 10.20.193.121:0/612486439 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:13.331 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd99371640 1 --2- 10.20.193.121:0/612486439 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fcd9409b9b0 0x7fcd94125840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:13.331 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd98b70640 1 --2- 10.20.193.121:0/612486439 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fcd9409f350 0x7fcd94136580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:13.331 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd99b72640 1 -- 10.20.193.121:0/612486439 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fcd9409b9b0 msgr2=0x7fcd94125840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:13.331 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd99b72640 1 --2- 10.20.193.121:0/612486439 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fcd9409b9b0 0x7fcd94125840 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:13.331 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd99b72640 1 -- 10.20.193.121:0/612486439 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fcd9409f350 msgr2=0x7fcd94136580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:13.331 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd99b72640 1 --2- 10.20.193.121:0/612486439 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fcd9409f350 0x7fcd94136580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:13.331 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd99b72640 1 -- 10.20.193.121:0/612486439 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd9415d7f0 con 0x7fcd9415f4f0 2026-02-13T02:31:13.331 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd99b72640 1 --2- 10.20.193.121:0/612486439 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fcd9415f4f0 0x7fcd94136ac0 secure :-1 s=READY pgs=127 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd9000dbe0 tx=0x7fcd9000b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:13.331 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd81ffb640 1 -- 10.20.193.121:0/612486439 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd9000bd60 con 0x7fcd9415f4f0 2026-02-13T02:31:13.332 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd81ffb640 1 -- 10.20.193.121:0/612486439 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd90006070 con 0x7fcd9415f4f0 2026-02-13T02:31:13.332 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd81ffb640 1 -- 10.20.193.121:0/612486439 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd900064e0 con 0x7fcd9415f4f0 2026-02-13T02:31:13.332 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd9b5fc640 1 -- 10.20.193.121:0/612486439 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd9415dad0 con 0x7fcd9415f4f0 2026-02-13T02:31:13.332 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd9b5fc640 1 -- 10.20.193.121:0/612486439 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd9415e090 con 0x7fcd9415f4f0 2026-02-13T02:31:13.332 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd9b5fc640 1 -- 10.20.193.121:0/612486439 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd9405e4f0 con 0x7fcd9415f4f0 2026-02-13T02:31:13.333 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd81ffb640 1 -- 10.20.193.121:0/612486439 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 5) ==== 100086+0+0 (secure 0 0 0) 0x7fcd90006680 con 0x7fcd9415f4f0 2026-02-13T02:31:13.333 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.319+0000 7fcd81ffb640 1 --2- 10.20.193.121:0/612486439 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fcd64074140 0x7fcd640945f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:13.333 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.323+0000 7fcd81ffb640 1 -- 10.20.193.121:0/612486439 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5224+0+0 (secure 0 0 0) 0x7fcd90097ab0 con 0x7fcd9415f4f0 2026-02-13T02:31:13.333 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.323+0000 7fcd99371640 1 --2- 10.20.193.121:0/612486439 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fcd64074140 0x7fcd640945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:13.333 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.323+0000 7fcd99371640 1 --2- 10.20.193.121:0/612486439 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fcd64074140 0x7fcd640945f0 secure :-1 s=READY pgs=49 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd84019540 tx=0x7fcd8401b170 comp rx=0 tx=0).ready entity=mgr.4155 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:13.333 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.323+0000 7fcd81ffb640 1 -- 10.20.193.121:0/612486439 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (secure 0 0 0) 0x7fcd90061e90 con 0x7fcd9415f4f0 2026-02-13T02:31:13.421 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:13.411+0000 7fcd9b5fc640 1 -- 10.20.193.121:0/612486439 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fcd94168fc0 con 0x7fcd9415f4f0 2026-02-13T02:31:14.246 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.235+0000 7fcd81ffb640 1 -- 10.20.193.121:0/612486439 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7fcd900677c0 con 0x7fcd9415f4f0 2026-02-13T02:31:14.246 INFO:teuthology.orchestra.run.trial121.stderr:pool 'cephfs_data' created 2026-02-13T02:31:14.248 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.239+0000 7fcd9b5fc640 1 -- 10.20.193.121:0/612486439 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fcd64074140 msgr2=0x7fcd640945f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:14.248 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.239+0000 7fcd9b5fc640 1 --2- 10.20.193.121:0/612486439 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fcd64074140 0x7fcd640945f0 secure :-1 s=READY pgs=49 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd84019540 tx=0x7fcd8401b170 comp rx=0 tx=0).stop 2026-02-13T02:31:14.248 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.239+0000 7fcd9b5fc640 1 -- 10.20.193.121:0/612486439 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fcd9415f4f0 msgr2=0x7fcd94136ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:14.248 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.239+0000 7fcd9b5fc640 1 --2- 10.20.193.121:0/612486439 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fcd9415f4f0 0x7fcd94136ac0 secure :-1 s=READY pgs=127 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd9000dbe0 tx=0x7fcd9000b430 comp rx=0 tx=0).stop 2026-02-13T02:31:14.248 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.239+0000 7fcd9b5fc640 1 -- 10.20.193.121:0/612486439 shutdown_connections 2026-02-13T02:31:14.248 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.239+0000 7fcd9b5fc640 1 --2- 10.20.193.121:0/612486439 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fcd64074140 0x7fcd640945f0 unknown :-1 s=CLOSED pgs=49 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:14.248 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.239+0000 7fcd9b5fc640 1 --2- 10.20.193.121:0/612486439 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fcd9415f4f0 0x7fcd94136ac0 unknown :-1 s=CLOSED pgs=127 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:14.248 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.239+0000 7fcd9b5fc640 1 --2- 10.20.193.121:0/612486439 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fcd9409f350 0x7fcd94136580 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:14.248 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.239+0000 7fcd9b5fc640 1 --2- 10.20.193.121:0/612486439 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fcd9409b9b0 0x7fcd94125840 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:14.248 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.239+0000 7fcd9b5fc640 1 -- 10.20.193.121:0/612486439 >> 10.20.193.121:0/612486439 conn(0x7fcd94057b80 msgr2=0x7fcd941692a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:14.248 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.239+0000 7fcd9b5fc640 1 -- 10.20.193.121:0/612486439 shutdown_connections 2026-02-13T02:31:14.248 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.239+0000 7fcd9b5fc640 1 -- 10.20.193.121:0/612486439 wait complete. 2026-02-13T02:31:14.262 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2026-02-13T02:31:14.326 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.315+0000 7fef181a7640 1 -- 10.20.193.121:0/3201217207 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fef10056140 msgr2=0x7fef100565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:14.326 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.315+0000 7fef181a7640 1 --2- 10.20.193.121:0/3201217207 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fef10056140 0x7fef100565c0 secure :-1 s=READY pgs=128 gs=1 cs=0 l=1 c_cookie=13347070517082454979 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef100a54e0 tx=0x7fef0c01db90 comp rx=0 tx=0).stop 2026-02-13T02:31:14.326 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.315+0000 7fef181a7640 1 -- 10.20.193.121:0/3201217207 shutdown_connections 2026-02-13T02:31:14.326 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.315+0000 7fef181a7640 1 --2- 10.20.193.121:0/3201217207 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fef10056140 0x7fef100565c0 unknown :-1 s=CLOSED pgs=128 gs=1 cs=0 l=1 c_cookie=13347070517082454979 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:14.326 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.315+0000 7fef181a7640 1 --2- 10.20.193.121:0/3201217207 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fef10168870 0x7fef10168ca0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:14.326 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.315+0000 7fef181a7640 1 --2- 10.20.193.121:0/3201217207 >> v2:10.20.193.178:3300/0 conn(0x7fef101684a0 0x7fef10058080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:14.326 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.315+0000 7fef181a7640 1 -- 10.20.193.121:0/3201217207 >> 10.20.193.121:0/3201217207 conn(0x7fef100a16e0 msgr2=0x7fef100bbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:14.326 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.315+0000 7fef181a7640 1 -- 10.20.193.121:0/3201217207 shutdown_connections 2026-02-13T02:31:14.326 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.315+0000 7fef181a7640 1 -- 10.20.193.121:0/3201217207 wait complete. 2026-02-13T02:31:14.327 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7fef181a7640 1 Processor -- start 2026-02-13T02:31:14.327 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7fef181a7640 1 -- start start 2026-02-13T02:31:14.328 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7fef181a7640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fef10056140 0x7fef100b5cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:14.328 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7fef181a7640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fef101684a0 0x7fef10149a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:14.328 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7fef181a7640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fef10168870 0x7fef1017e770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:14.328 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7fef181a7640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7fef100544f0 con 0x7fef10168870 2026-02-13T02:31:14.328 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7fef181a7640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7fef10054370 con 0x7fef10056140 2026-02-13T02:31:14.328 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7fef181a7640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7fef10054670 con 0x7fef101684a0 2026-02-13T02:31:14.328 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7fef1671d640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fef10168870 0x7fef1017e770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:14.328 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7fef1671d640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fef10168870 0x7fef1017e770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:40666/0 (socket says 10.20.193.121:40666) 2026-02-13T02:31:14.328 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7fef1671d640 1 -- 10.20.193.121:0/1717688061 learned_addr learned my addr 10.20.193.121:0/1717688061 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:14.328 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7fef1571b640 1 --2- 10.20.193.121:0/1717688061 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fef101684a0 0x7fef10149a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:14.328 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7fef15f1c640 1 --2- 10.20.193.121:0/1717688061 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fef10056140 0x7fef100b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:14.328 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7fef1671d640 1 -- 10.20.193.121:0/1717688061 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fef101684a0 msgr2=0x7fef10149a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:14.328 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7fef1671d640 1 --2- 10.20.193.121:0/1717688061 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fef101684a0 0x7fef10149a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:14.328 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7fef1671d640 1 -- 10.20.193.121:0/1717688061 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fef10056140 msgr2=0x7fef100b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:14.328 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7fef1671d640 1 --2- 10.20.193.121:0/1717688061 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fef10056140 0x7fef100b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:14.329 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7fef1671d640 1 -- 10.20.193.121:0/1717688061 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef1014d0c0 con 0x7fef10168870 2026-02-13T02:31:14.329 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7fef1671d640 1 --2- 10.20.193.121:0/1717688061 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fef10168870 0x7fef1017e770 secure :-1 s=READY pgs=129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef0c01f270 tx=0x7fef0c00a810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:14.329 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7feefe7fc640 1 -- 10.20.193.121:0/1717688061 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef0c008590 con 0x7fef10168870 2026-02-13T02:31:14.329 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7feefe7fc640 1 -- 10.20.193.121:0/1717688061 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef0c008820 con 0x7fef10168870 2026-02-13T02:31:14.329 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7feefe7fc640 1 -- 10.20.193.121:0/1717688061 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef0c008c50 con 0x7fef10168870 2026-02-13T02:31:14.329 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7fef181a7640 1 -- 10.20.193.121:0/1717688061 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef10149fc0 con 0x7fef10168870 2026-02-13T02:31:14.329 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7fef181a7640 1 -- 10.20.193.121:0/1717688061 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef1014d640 con 0x7fef10168870 2026-02-13T02:31:14.329 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7fef181a7640 1 -- 10.20.193.121:0/1717688061 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef10167e20 con 0x7fef10168870 2026-02-13T02:31:14.329 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7feefe7fc640 1 -- 10.20.193.121:0/1717688061 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 5) ==== 100086+0+0 (secure 0 0 0) 0x7fef0c0c0060 con 0x7fef10168870 2026-02-13T02:31:14.330 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7feefe7fc640 1 --2- 10.20.193.121:0/1717688061 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7feee0074140 0x7feee00945f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:14.330 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7fef15f1c640 1 --2- 10.20.193.121:0/1717688061 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7feee0074140 0x7feee00945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:14.330 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7feefe7fc640 1 -- 10.20.193.121:0/1717688061 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fef0c130740 con 0x7fef10168870 2026-02-13T02:31:14.330 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.319+0000 7fef15f1c640 1 --2- 10.20.193.121:0/1717688061 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7feee0074140 0x7feee00945f0 secure :-1 s=READY pgs=50 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef00005fd0 tx=0x7fef00005f40 comp rx=0 tx=0).ready entity=mgr.4155 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:14.331 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.323+0000 7feefe7fc640 1 -- 10.20.193.121:0/1717688061 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (secure 0 0 0) 0x7fef0c017780 con 0x7fef10168870 2026-02-13T02:31:14.435 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:14.427+0000 7fef181a7640 1 -- 10.20.193.121:0/1717688061 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fef10168ca0 con 0x7fef10168870 2026-02-13T02:31:15.260 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.251+0000 7feefe7fc640 1 -- 10.20.193.121:0/1717688061 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fef0c0fb030 con 0x7fef10168870 2026-02-13T02:31:15.260 INFO:teuthology.orchestra.run.trial121.stderr:new fs with metadata pool 2 and data pool 3 2026-02-13T02:31:15.263 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.251+0000 7fef181a7640 1 -- 10.20.193.121:0/1717688061 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7feee0074140 msgr2=0x7feee00945f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:15.263 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.255+0000 7fef181a7640 1 --2- 10.20.193.121:0/1717688061 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7feee0074140 0x7feee00945f0 secure :-1 s=READY pgs=50 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef00005fd0 tx=0x7fef00005f40 comp rx=0 tx=0).stop 2026-02-13T02:31:15.263 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.255+0000 7fef181a7640 1 -- 10.20.193.121:0/1717688061 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fef10168870 msgr2=0x7fef1017e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:15.263 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.255+0000 7fef181a7640 1 --2- 10.20.193.121:0/1717688061 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fef10168870 0x7fef1017e770 secure :-1 s=READY pgs=129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef0c01f270 tx=0x7fef0c00a810 comp rx=0 tx=0).stop 2026-02-13T02:31:15.263 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.255+0000 7fef181a7640 1 -- 10.20.193.121:0/1717688061 shutdown_connections 2026-02-13T02:31:15.264 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.255+0000 7fef181a7640 1 --2- 10.20.193.121:0/1717688061 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7feee0074140 0x7feee00945f0 unknown :-1 s=CLOSED pgs=50 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:15.264 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.255+0000 7fef181a7640 1 --2- 10.20.193.121:0/1717688061 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fef10168870 0x7fef1017e770 unknown :-1 s=CLOSED pgs=129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:15.264 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.255+0000 7fef181a7640 1 --2- 10.20.193.121:0/1717688061 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fef101684a0 0x7fef10149a80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:15.264 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.255+0000 7fef181a7640 1 --2- 10.20.193.121:0/1717688061 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fef10056140 0x7fef100b5cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:15.264 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.255+0000 7fef181a7640 1 -- 10.20.193.121:0/1717688061 >> 10.20.193.121:0/1717688061 conn(0x7fef100a16e0 msgr2=0x7fef1014b580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:15.265 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.255+0000 7fef181a7640 1 -- 10.20.193.121:0/1717688061 shutdown_connections 2026-02-13T02:31:15.265 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.255+0000 7fef181a7640 1 -- 10.20.193.121:0/1717688061 wait complete. 2026-02-13T02:31:15.277 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2026-02-13T02:31:15.278 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2026-02-13T02:31:15.348 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.335+0000 7faecbb41640 1 -- 10.20.193.121:0/3618107346 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7faec40b9e80 msgr2=0x7faec409be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:15.348 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.335+0000 7faecbb41640 1 --2- 10.20.193.121:0/3618107346 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7faec40b9e80 0x7faec409be10 secure :-1 s=READY pgs=131 gs=2 cs=0 l=1 c_cookie=13619448395602826310 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faec000a750 tx=0x7faec001db90 comp rx=0 tx=0).stop 2026-02-13T02:31:15.348 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.335+0000 7faecbb41640 1 -- 10.20.193.121:0/3618107346 shutdown_connections 2026-02-13T02:31:15.348 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.335+0000 7faecbb41640 1 --2- 10.20.193.121:0/3618107346 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7faec40b9e80 0x7faec409be10 unknown :-1 s=CLOSED pgs=131 gs=2 cs=0 l=1 c_cookie=13619448395602826310 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:15.349 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.335+0000 7faecbb41640 1 --2- 10.20.193.121:0/3618107346 >> v2:10.20.193.178:3300/0 conn(0x7faec415c230 0x7faec4166940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:15.349 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.335+0000 7faecbb41640 1 -- 10.20.193.121:0/3618107346 >> 10.20.193.121:0/3618107346 conn(0x7faec4057b80 msgr2=0x7faec409ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:15.349 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.335+0000 7faecbb41640 1 -- 10.20.193.121:0/3618107346 shutdown_connections 2026-02-13T02:31:15.349 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.335+0000 7faecbb41640 1 -- 10.20.193.121:0/3618107346 wait complete. 2026-02-13T02:31:15.349 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.335+0000 7faecbb41640 1 Processor -- start 2026-02-13T02:31:15.349 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.335+0000 7faecbb41640 1 -- start start 2026-02-13T02:31:15.349 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faecbb41640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7faec409b9b0 0x7faec414e7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:15.349 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faecbb41640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7faec40b9e80 0x7faec409e090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:15.349 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faecbb41640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7faec415c230 0x7faec415eb30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:15.349 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faecbb41640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7faec41cc080 con 0x7faec415c230 2026-02-13T02:31:15.350 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faecbb41640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7faec41cbf00 con 0x7faec409b9b0 2026-02-13T02:31:15.350 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faecbb41640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7faec41cc200 con 0x7faec40b9e80 2026-02-13T02:31:15.350 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faeca0b7640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7faec415c230 0x7faec415eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:15.350 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faeca0b7640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7faec415c230 0x7faec415eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:40690/0 (socket says 10.20.193.121:40690) 2026-02-13T02:31:15.350 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faeca0b7640 1 -- 10.20.193.121:0/1382400933 learned_addr learned my addr 10.20.193.121:0/1382400933 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:15.350 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faec98b6640 1 --2- 10.20.193.121:0/1382400933 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7faec409b9b0 0x7faec414e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:15.350 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faec90b5640 1 --2- 10.20.193.121:0/1382400933 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7faec40b9e80 0x7faec409e090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:15.350 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faeca0b7640 1 -- 10.20.193.121:0/1382400933 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7faec40b9e80 msgr2=0x7faec409e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:15.350 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faeca0b7640 1 --2- 10.20.193.121:0/1382400933 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7faec40b9e80 0x7faec409e090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:15.350 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faeca0b7640 1 -- 10.20.193.121:0/1382400933 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7faec409b9b0 msgr2=0x7faec414e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:15.350 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faeca0b7640 1 --2- 10.20.193.121:0/1382400933 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7faec409b9b0 0x7faec414e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:15.350 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faeca0b7640 1 -- 10.20.193.121:0/1382400933 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec414bb90 con 0x7faec415c230 2026-02-13T02:31:15.351 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faeca0b7640 1 --2- 10.20.193.121:0/1382400933 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7faec415c230 0x7faec415eb30 secure :-1 s=READY pgs=132 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faec001b7c0 tx=0x7faec000d020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:15.351 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faeb27fc640 1 -- 10.20.193.121:0/1382400933 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faec00a6940 con 0x7faec415c230 2026-02-13T02:31:15.351 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faeb27fc640 1 -- 10.20.193.121:0/1382400933 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faec00a6ae0 con 0x7faec415c230 2026-02-13T02:31:15.351 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faecbb41640 1 -- 10.20.193.121:0/1382400933 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec414be70 con 0x7faec415c230 2026-02-13T02:31:15.351 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faeb27fc640 1 -- 10.20.193.121:0/1382400933 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faec00a8070 con 0x7faec415c230 2026-02-13T02:31:15.351 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faecbb41640 1 -- 10.20.193.121:0/1382400933 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec414c430 con 0x7faec415c230 2026-02-13T02:31:15.351 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faecbb41640 1 -- 10.20.193.121:0/1382400933 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec409be10 con 0x7faec415c230 2026-02-13T02:31:15.352 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faeb27fc640 1 -- 10.20.193.121:0/1382400933 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 5) ==== 100086+0+0 (secure 0 0 0) 0x7faec00a8210 con 0x7faec415c230 2026-02-13T02:31:15.352 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faeb27fc640 1 --2- 10.20.193.121:0/1382400933 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fae940740b0 0x7fae94094560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:15.352 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faeb27fc640 1 -- 10.20.193.121:0/1382400933 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7faec00b5030 con 0x7faec415c230 2026-02-13T02:31:15.352 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faec98b6640 1 --2- 10.20.193.121:0/1382400933 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fae940740b0 0x7fae94094560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:15.353 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faec98b6640 1 --2- 10.20.193.121:0/1382400933 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fae940740b0 0x7fae94094560 secure :-1 s=READY pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faeb4005f00 tx=0x7faeb4005e90 comp rx=0 tx=0).ready entity=mgr.4155 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:15.353 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.339+0000 7faeb27fc640 1 -- 10.20.193.121:0/1382400933 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (secure 0 0 0) 0x7faec00c0030 con 0x7faec415c230 2026-02-13T02:31:15.356 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:PerfHandler: tick 2026-02-13T02:31:15.357 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:TaskHandler: tick 2026-02-13T02:31:15.442 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:15.431+0000 7faecbb41640 1 -- 10.20.193.121:0/1382400933 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7faec409cdb0 con 0x7faec415c230 2026-02-13T02:31:16.266 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.255+0000 7faeb27fc640 1 -- 10.20.193.121:0/1382400933 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 load: isa v20) ==== 167+0+0 (secure 0 0 0) 0x7faec0017780 con 0x7faec415c230 2026-02-13T02:31:16.266 INFO:teuthology.orchestra.run.trial121.stderr:load: isa 2026-02-13T02:31:16.267 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.259+0000 7faecbb41640 1 -- 10.20.193.121:0/1382400933 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fae940740b0 msgr2=0x7fae94094560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:16.268 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.259+0000 7faecbb41640 1 --2- 10.20.193.121:0/1382400933 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fae940740b0 0x7fae94094560 secure :-1 s=READY pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faeb4005f00 tx=0x7faeb4005e90 comp rx=0 tx=0).stop 2026-02-13T02:31:16.268 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.259+0000 7faecbb41640 1 -- 10.20.193.121:0/1382400933 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7faec415c230 msgr2=0x7faec415eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:16.268 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.259+0000 7faecbb41640 1 --2- 10.20.193.121:0/1382400933 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7faec415c230 0x7faec415eb30 secure :-1 s=READY pgs=132 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faec001b7c0 tx=0x7faec000d020 comp rx=0 tx=0).stop 2026-02-13T02:31:16.268 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.259+0000 7faecbb41640 1 -- 10.20.193.121:0/1382400933 shutdown_connections 2026-02-13T02:31:16.268 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.259+0000 7faecbb41640 1 --2- 10.20.193.121:0/1382400933 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fae940740b0 0x7fae94094560 unknown :-1 s=CLOSED pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:16.268 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.259+0000 7faecbb41640 1 --2- 10.20.193.121:0/1382400933 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7faec415c230 0x7faec415eb30 unknown :-1 s=CLOSED pgs=132 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:16.268 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.259+0000 7faecbb41640 1 --2- 10.20.193.121:0/1382400933 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7faec40b9e80 0x7faec409e090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:16.268 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.259+0000 7faecbb41640 1 --2- 10.20.193.121:0/1382400933 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7faec409b9b0 0x7faec414e7a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:16.268 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.259+0000 7faecbb41640 1 -- 10.20.193.121:0/1382400933 >> 10.20.193.121:0/1382400933 conn(0x7faec4057b80 msgr2=0x7faec40b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:16.268 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.259+0000 7faecbb41640 1 -- 10.20.193.121:0/1382400933 shutdown_connections 2026-02-13T02:31:16.268 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.259+0000 7faecbb41640 1 -- 10.20.193.121:0/1382400933 wait complete. 2026-02-13T02:31:16.278 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2026-02-13T02:31:16.354 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.343+0000 7f4f47803640 1 -- 10.20.193.121:0/1858810865 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f4f400bb600 msgr2=0x7f4f400a1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:16.354 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.343+0000 7f4f47803640 1 --2- 10.20.193.121:0/1858810865 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f4f400bb600 0x7f4f400a1ef0 secure :-1 s=READY pgs=134 gs=2 cs=0 l=1 c_cookie=14221269680037133168 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f40055230 tx=0x7f4f3c01db90 comp rx=0 tx=0).stop 2026-02-13T02:31:16.354 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.343+0000 7f4f47803640 1 -- 10.20.193.121:0/1858810865 shutdown_connections 2026-02-13T02:31:16.354 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.343+0000 7f4f47803640 1 --2- 10.20.193.121:0/1858810865 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f4f400bb600 0x7f4f400a1ef0 unknown :-1 s=CLOSED pgs=134 gs=2 cs=0 l=1 c_cookie=14221269680037133168 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:16.354 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.343+0000 7f4f47803640 1 --2- 10.20.193.121:0/1858810865 >> v2:10.20.193.178:3300/0 conn(0x7f4f40168410 0x7f4f400a0b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:16.355 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.343+0000 7f4f47803640 1 -- 10.20.193.121:0/1858810865 >> 10.20.193.121:0/1858810865 conn(0x7f4f40054ad0 msgr2=0x7f4f400bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:16.355 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.343+0000 7f4f47803640 1 -- 10.20.193.121:0/1858810865 shutdown_connections 2026-02-13T02:31:16.355 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.343+0000 7f4f47803640 1 -- 10.20.193.121:0/1858810865 wait complete. 2026-02-13T02:31:16.361 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.343+0000 7f4f47803640 1 Processor -- start 2026-02-13T02:31:16.361 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.343+0000 7f4f47803640 1 -- start start 2026-02-13T02:31:16.362 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f47803640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f4f400a1060 0x7f4f4014d690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:16.362 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f47803640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f4f400bb600 0x7f4f40179f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:16.362 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f47803640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f4f40168410 0x7f4f4017a490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:16.362 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f47803640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4f401cf8d0 con 0x7f4f40168410 2026-02-13T02:31:16.362 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f47803640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4f401cf750 con 0x7f4f400a1060 2026-02-13T02:31:16.362 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f47803640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7f4f401cfa50 con 0x7f4f400bb600 2026-02-13T02:31:16.363 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f45d79640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f4f40168410 0x7f4f4017a490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:16.363 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f45d79640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f4f40168410 0x7f4f4017a490 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:40712/0 (socket says 10.20.193.121:40712) 2026-02-13T02:31:16.363 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f45d79640 1 -- 10.20.193.121:0/507439370 learned_addr learned my addr 10.20.193.121:0/507439370 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:16.363 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f45578640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f4f400a1060 0x7f4f4014d690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:16.363 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f44d77640 1 --2- 10.20.193.121:0/507439370 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f4f400bb600 0x7f4f40179f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:16.364 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f45d79640 1 -- 10.20.193.121:0/507439370 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f4f400bb600 msgr2=0x7f4f40179f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:16.364 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f45d79640 1 --2- 10.20.193.121:0/507439370 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f4f400bb600 0x7f4f40179f50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:16.364 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f45d79640 1 -- 10.20.193.121:0/507439370 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f4f400a1060 msgr2=0x7f4f4014d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:16.364 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f45d79640 1 --2- 10.20.193.121:0/507439370 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f4f400a1060 0x7f4f4014d690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:16.364 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f45d79640 1 -- 10.20.193.121:0/507439370 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f4017e1a0 con 0x7f4f40168410 2026-02-13T02:31:16.365 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f45d79640 1 --2- 10.20.193.121:0/507439370 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f4f40168410 0x7f4f4017a490 secure :-1 s=READY pgs=135 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f3c01b7c0 tx=0x7f4f3c00d020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:16.365 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f2dffb640 1 -- 10.20.193.121:0/507439370 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4f3c0a6960 con 0x7f4f40168410 2026-02-13T02:31:16.365 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f2dffb640 1 -- 10.20.193.121:0/507439370 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f3c0a6b00 con 0x7f4f40168410 2026-02-13T02:31:16.365 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f2dffb640 1 -- 10.20.193.121:0/507439370 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4f3c0a8110 con 0x7f4f40168410 2026-02-13T02:31:16.365 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f47803640 1 -- 10.20.193.121:0/507439370 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f4017e480 con 0x7f4f40168410 2026-02-13T02:31:16.365 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f47803640 1 -- 10.20.193.121:0/507439370 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f4017ea40 con 0x7f4f40168410 2026-02-13T02:31:16.365 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f47803640 1 -- 10.20.193.121:0/507439370 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f40050fc0 con 0x7f4f40168410 2026-02-13T02:31:16.365 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f2dffb640 1 -- 10.20.193.121:0/507439370 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 5) ==== 100086+0+0 (secure 0 0 0) 0x7f4f3c0a82b0 con 0x7f4f40168410 2026-02-13T02:31:16.366 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f2dffb640 1 --2- 10.20.193.121:0/507439370 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f4f10074140 0x7f4f100945f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:16.366 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f45578640 1 --2- 10.20.193.121:0/507439370 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f4f10074140 0x7f4f100945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:16.366 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f2dffb640 1 -- 10.20.193.121:0/507439370 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5951+0+0 (secure 0 0 0) 0x7f4f3c0b5030 con 0x7f4f40168410 2026-02-13T02:31:16.366 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.347+0000 7f4f45578640 1 --2- 10.20.193.121:0/507439370 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f4f10074140 0x7f4f100945f0 secure :-1 s=READY pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f30005f00 tx=0x7f4f30005e90 comp rx=0 tx=0).ready entity=mgr.4155 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:16.366 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.351+0000 7f4f2dffb640 1 -- 10.20.193.121:0/507439370 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (secure 0 0 0) 0x7f4f3c0c0020 con 0x7f4f40168410 2026-02-13T02:31:16.448 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:16.439+0000 7f4f47803640 1 -- 10.20.193.121:0/507439370 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f4f400a3dc0 con 0x7f4f40168410 2026-02-13T02:31:18.275 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.267+0000 7f4f2dffb640 1 -- 10.20.193.121:0/507439370 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7f4f3c017780 con 0x7f4f40168410 2026-02-13T02:31:18.275 INFO:teuthology.orchestra.run.trial121.stderr:pool 'cephfs_data_ec' created 2026-02-13T02:31:18.279 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.267+0000 7f4f47803640 1 -- 10.20.193.121:0/507439370 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f4f10074140 msgr2=0x7f4f100945f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:18.279 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.267+0000 7f4f47803640 1 --2- 10.20.193.121:0/507439370 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f4f10074140 0x7f4f100945f0 secure :-1 s=READY pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f30005f00 tx=0x7f4f30005e90 comp rx=0 tx=0).stop 2026-02-13T02:31:18.280 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.267+0000 7f4f47803640 1 -- 10.20.193.121:0/507439370 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f4f40168410 msgr2=0x7f4f4017a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:18.280 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.267+0000 7f4f47803640 1 --2- 10.20.193.121:0/507439370 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f4f40168410 0x7f4f4017a490 secure :-1 s=READY pgs=135 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f3c01b7c0 tx=0x7f4f3c00d020 comp rx=0 tx=0).stop 2026-02-13T02:31:18.280 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.271+0000 7f4f47803640 1 -- 10.20.193.121:0/507439370 shutdown_connections 2026-02-13T02:31:18.280 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.271+0000 7f4f47803640 1 --2- 10.20.193.121:0/507439370 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f4f10074140 0x7f4f100945f0 unknown :-1 s=CLOSED pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:18.280 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.271+0000 7f4f47803640 1 --2- 10.20.193.121:0/507439370 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f4f40168410 0x7f4f4017a490 unknown :-1 s=CLOSED pgs=135 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:18.280 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.271+0000 7f4f47803640 1 --2- 10.20.193.121:0/507439370 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f4f400bb600 0x7f4f40179f50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:18.280 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.271+0000 7f4f47803640 1 --2- 10.20.193.121:0/507439370 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f4f400a1060 0x7f4f4014d690 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:18.280 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.271+0000 7f4f47803640 1 -- 10.20.193.121:0/507439370 >> 10.20.193.121:0/507439370 conn(0x7f4f40054ad0 msgr2=0x7f4f400bf820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:18.280 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.271+0000 7f4f47803640 1 -- 10.20.193.121:0/507439370 shutdown_connections 2026-02-13T02:31:18.280 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.271+0000 7f4f47803640 1 -- 10.20.193.121:0/507439370 wait complete. 2026-02-13T02:31:18.292 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2026-02-13T02:31:18.358 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.347+0000 7fa169c3a640 1 -- 10.20.193.121:0/3973435757 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fa16409f350 msgr2=0x7fa16405e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:18.358 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.347+0000 7fa169c3a640 1 --2- 10.20.193.121:0/3973435757 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fa16409f350 0x7fa16405e4f0 secure :-1 s=READY pgs=136 gs=1 cs=0 l=1 c_cookie=14051483034983940857 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa154005eb0 tx=0x7fa15401c960 comp rx=0 tx=0).stop 2026-02-13T02:31:18.358 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.347+0000 7fa169c3a640 1 -- 10.20.193.121:0/3973435757 shutdown_connections 2026-02-13T02:31:18.358 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.347+0000 7fa169c3a640 1 --2- 10.20.193.121:0/3973435757 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fa16409b9b0 0x7fa16409be50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:18.358 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.347+0000 7fa169c3a640 1 --2- 10.20.193.121:0/3973435757 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fa16409f350 0x7fa16405e4f0 unknown :-1 s=CLOSED pgs=136 gs=1 cs=0 l=1 c_cookie=14051483034983940857 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:18.358 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.347+0000 7fa169c3a640 1 --2- 10.20.193.121:0/3973435757 >> v2:10.20.193.178:3300/0 conn(0x7fa16415f4f0 0x7fa164169680 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:18.358 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.347+0000 7fa169c3a640 1 -- 10.20.193.121:0/3973435757 >> 10.20.193.121:0/3973435757 conn(0x7fa164057b80 msgr2=0x7fa16409ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:18.358 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.347+0000 7fa169c3a640 1 -- 10.20.193.121:0/3973435757 shutdown_connections 2026-02-13T02:31:18.358 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.347+0000 7fa169c3a640 1 -- 10.20.193.121:0/3973435757 wait complete. 2026-02-13T02:31:18.358 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa169c3a640 1 Processor -- start 2026-02-13T02:31:18.358 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa169c3a640 1 -- start start 2026-02-13T02:31:18.360 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa169c3a640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fa16409b9b0 0x7fa16417c5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:18.360 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa169c3a640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fa16409f350 0x7fa16417bae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:18.360 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa169c3a640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fa16415f4f0 0x7fa16417c020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:18.360 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa169c3a640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa1640b9c30 con 0x7fa16409b9b0 2026-02-13T02:31:18.360 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa169c3a640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa1640b9ab0 con 0x7fa16415f4f0 2026-02-13T02:31:18.360 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa169c3a640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7fa1640b9db0 con 0x7fa16409f350 2026-02-13T02:31:18.360 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa1637fe640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fa16409b9b0 0x7fa16417c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:18.360 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa1637fe640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fa16409b9b0 0x7fa16417c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:33642/0 (socket says 10.20.193.121:33642) 2026-02-13T02:31:18.360 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa1637fe640 1 -- 10.20.193.121:0/214777363 learned_addr learned my addr 10.20.193.121:0/214777363 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:18.360 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa162ffd640 1 --2- 10.20.193.121:0/214777363 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fa16409f350 0x7fa16417bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:18.360 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa163fff640 1 --2- 10.20.193.121:0/214777363 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fa16415f4f0 0x7fa16417c020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:18.360 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa1637fe640 1 -- 10.20.193.121:0/214777363 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fa16409f350 msgr2=0x7fa16417bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:18.360 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa1637fe640 1 --2- 10.20.193.121:0/214777363 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fa16409f350 0x7fa16417bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:18.361 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa1637fe640 1 -- 10.20.193.121:0/214777363 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fa16415f4f0 msgr2=0x7fa16417c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:18.361 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa1637fe640 1 --2- 10.20.193.121:0/214777363 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fa16415f4f0 0x7fa16417c020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:18.361 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa1637fe640 1 -- 10.20.193.121:0/214777363 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1640afe40 con 0x7fa16409b9b0 2026-02-13T02:31:18.361 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa1637fe640 1 --2- 10.20.193.121:0/214777363 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fa16409b9b0 0x7fa16417c5f0 secure :-1 s=READY pgs=137 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa15000d950 tx=0x7fa15000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:18.361 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa13ffff640 1 -- 10.20.193.121:0/214777363 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa150014070 con 0x7fa16409b9b0 2026-02-13T02:31:18.361 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa13ffff640 1 -- 10.20.193.121:0/214777363 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa15000b7e0 con 0x7fa16409b9b0 2026-02-13T02:31:18.361 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa169c3a640 1 -- 10.20.193.121:0/214777363 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1640b0120 con 0x7fa16409b9b0 2026-02-13T02:31:18.361 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa13ffff640 1 -- 10.20.193.121:0/214777363 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa15000bc30 con 0x7fa16409b9b0 2026-02-13T02:31:18.361 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa169c3a640 1 -- 10.20.193.121:0/214777363 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1640b06e0 con 0x7fa16409b9b0 2026-02-13T02:31:18.361 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa169c3a640 1 -- 10.20.193.121:0/214777363 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa16405e4f0 con 0x7fa16409b9b0 2026-02-13T02:31:18.361 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa13ffff640 1 -- 10.20.193.121:0/214777363 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 5) ==== 100086+0+0 (secure 0 0 0) 0x7fa1500026e0 con 0x7fa16409b9b0 2026-02-13T02:31:18.361 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa13ffff640 1 --2- 10.20.193.121:0/214777363 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fa1340740c0 0x7fa134094570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:18.361 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa13ffff640 1 -- 10.20.193.121:0/214777363 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6447+0+0 (secure 0 0 0) 0x7fa150096ae0 con 0x7fa16409b9b0 2026-02-13T02:31:18.362 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa162ffd640 1 --2- 10.20.193.121:0/214777363 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fa1340740c0 0x7fa134094570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:18.362 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.351+0000 7fa162ffd640 1 --2- 10.20.193.121:0/214777363 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fa1340740c0 0x7fa134094570 secure :-1 s=READY pgs=53 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa154002410 tx=0x7fa1540b0040 comp rx=0 tx=0).ready entity=mgr.4155 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:18.364 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.355+0000 7fa13ffff640 1 -- 10.20.193.121:0/214777363 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (secure 0 0 0) 0x7fa150060ab0 con 0x7fa16409b9b0 2026-02-13T02:31:18.454 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:18.443+0000 7fa169c3a640 1 -- 10.20.193.121:0/214777363 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fa16415ed00 con 0x7fa16409b9b0 2026-02-13T02:31:19.276 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.267+0000 7fa13ffff640 1 -- 10.20.193.121:0/214777363 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7fa1500663b0 con 0x7fa16409b9b0 2026-02-13T02:31:19.276 INFO:teuthology.orchestra.run.trial121.stderr:set pool 4 allow_ec_overwrites to true 2026-02-13T02:31:19.278 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.267+0000 7fa169c3a640 1 -- 10.20.193.121:0/214777363 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fa1340740c0 msgr2=0x7fa134094570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:19.278 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.267+0000 7fa169c3a640 1 --2- 10.20.193.121:0/214777363 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fa1340740c0 0x7fa134094570 secure :-1 s=READY pgs=53 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa154002410 tx=0x7fa1540b0040 comp rx=0 tx=0).stop 2026-02-13T02:31:19.278 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.267+0000 7fa169c3a640 1 -- 10.20.193.121:0/214777363 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fa16409b9b0 msgr2=0x7fa16417c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:19.278 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.267+0000 7fa169c3a640 1 --2- 10.20.193.121:0/214777363 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fa16409b9b0 0x7fa16417c5f0 secure :-1 s=READY pgs=137 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa15000d950 tx=0x7fa15000de10 comp rx=0 tx=0).stop 2026-02-13T02:31:19.279 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.267+0000 7fa169c3a640 1 -- 10.20.193.121:0/214777363 shutdown_connections 2026-02-13T02:31:19.279 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.267+0000 7fa169c3a640 1 --2- 10.20.193.121:0/214777363 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fa1340740c0 0x7fa134094570 unknown :-1 s=CLOSED pgs=53 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:19.279 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.267+0000 7fa169c3a640 1 --2- 10.20.193.121:0/214777363 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fa16415f4f0 0x7fa16417c020 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:19.279 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.267+0000 7fa169c3a640 1 --2- 10.20.193.121:0/214777363 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fa16409f350 0x7fa16417bae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:19.279 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.267+0000 7fa169c3a640 1 --2- 10.20.193.121:0/214777363 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fa16409b9b0 0x7fa16417c5f0 unknown :-1 s=CLOSED pgs=137 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:19.279 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.267+0000 7fa169c3a640 1 -- 10.20.193.121:0/214777363 >> 10.20.193.121:0/214777363 conn(0x7fa164057b80 msgr2=0x7fa1640ba400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:19.279 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.267+0000 7fa169c3a640 1 -- 10.20.193.121:0/214777363 shutdown_connections 2026-02-13T02:31:19.279 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.267+0000 7fa169c3a640 1 -- 10.20.193.121:0/214777363 wait complete. 2026-02-13T02:31:19.293 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2026-02-13T02:31:19.365 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.355+0000 7feccbfff640 1 -- 10.20.193.121:0/4293046221 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7feccc056850 msgr2=0x7feccc09cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:19.365 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.355+0000 7feccbfff640 1 --2- 10.20.193.121:0/4293046221 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7feccc056850 0x7feccc09cd70 secure :-1 s=READY pgs=139 gs=2 cs=0 l=1 c_cookie=11823434252968860245 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feccc0a1f20 tx=0x7fecb401c830 comp rx=0 tx=0).stop 2026-02-13T02:31:19.365 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.355+0000 7feccbfff640 1 -- 10.20.193.121:0/4293046221 shutdown_connections 2026-02-13T02:31:19.366 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.355+0000 7feccbfff640 1 --2- 10.20.193.121:0/4293046221 >> v2:10.20.193.178:3300/0 conn(0x7feccc169c70 0x7feccc09f220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:19.366 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.355+0000 7feccbfff640 1 --2- 10.20.193.121:0/4293046221 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7feccc056850 0x7feccc09cd70 unknown :-1 s=CLOSED pgs=139 gs=2 cs=0 l=1 c_cookie=11823434252968860245 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:19.366 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.355+0000 7feccbfff640 1 -- 10.20.193.121:0/4293046221 >> 10.20.193.121:0/4293046221 conn(0x7feccc054540 msgr2=0x7feccc054940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:19.366 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.355+0000 7feccbfff640 1 -- 10.20.193.121:0/4293046221 shutdown_connections 2026-02-13T02:31:19.366 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.355+0000 7feccbfff640 1 -- 10.20.193.121:0/4293046221 wait complete. 2026-02-13T02:31:19.369 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.355+0000 7feccbfff640 1 Processor -- start 2026-02-13T02:31:19.369 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.355+0000 7feccbfff640 1 -- start start 2026-02-13T02:31:19.369 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.355+0000 7feccbfff640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7feccc056850 0x7feccc161dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:19.369 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.355+0000 7feccbfff640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7feccc166080 0x7feccc1423f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:19.369 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.355+0000 7feccbfff640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7feccc169c70 0x7feccc15ec90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:19.369 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.355+0000 7feccbfff640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7feccc1cd190 con 0x7feccc056850 2026-02-13T02:31:19.369 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.355+0000 7feccbfff640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7feccc1cd010 con 0x7feccc166080 2026-02-13T02:31:19.369 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.355+0000 7feccbfff640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7feccc1cd310 con 0x7feccc169c70 2026-02-13T02:31:19.369 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.355+0000 7feccaffd640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7feccc056850 0x7feccc161dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:19.369 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.359+0000 7feccaffd640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7feccc056850 0x7feccc161dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:33662/0 (socket says 10.20.193.121:33662) 2026-02-13T02:31:19.369 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.359+0000 7feccaffd640 1 -- 10.20.193.121:0/1034309861 learned_addr learned my addr 10.20.193.121:0/1034309861 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:19.370 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.359+0000 7fecca7fc640 1 --2- 10.20.193.121:0/1034309861 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7feccc166080 0x7feccc1423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:19.370 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.359+0000 7feccb7fe640 1 --2- 10.20.193.121:0/1034309861 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7feccc169c70 0x7feccc15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:19.370 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.359+0000 7feccaffd640 1 -- 10.20.193.121:0/1034309861 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7feccc169c70 msgr2=0x7feccc15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:19.370 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.359+0000 7feccaffd640 1 --2- 10.20.193.121:0/1034309861 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7feccc169c70 0x7feccc15ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:19.370 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.359+0000 7feccaffd640 1 -- 10.20.193.121:0/1034309861 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7feccc166080 msgr2=0x7feccc1423f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:19.370 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.359+0000 7feccaffd640 1 --2- 10.20.193.121:0/1034309861 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7feccc166080 0x7feccc1423f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:19.370 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.359+0000 7feccaffd640 1 -- 10.20.193.121:0/1034309861 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feccc143e10 con 0x7feccc056850 2026-02-13T02:31:19.370 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.359+0000 7feccb7fe640 1 --2- 10.20.193.121:0/1034309861 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7feccc169c70 0x7feccc15ec90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:31:19.370 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.359+0000 7feccaffd640 1 --2- 10.20.193.121:0/1034309861 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7feccc056850 0x7feccc161dc0 secure :-1 s=READY pgs=140 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecc0007fd0 tx=0x7fecc000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:19.370 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.359+0000 7fecab7fe640 1 -- 10.20.193.121:0/1034309861 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecc0016070 con 0x7feccc056850 2026-02-13T02:31:19.370 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.359+0000 7fecab7fe640 1 -- 10.20.193.121:0/1034309861 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fecc0004340 con 0x7feccc056850 2026-02-13T02:31:19.371 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.359+0000 7feccbfff640 1 -- 10.20.193.121:0/1034309861 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feccc179b20 con 0x7feccc056850 2026-02-13T02:31:19.371 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.359+0000 7fecab7fe640 1 -- 10.20.193.121:0/1034309861 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecc0005020 con 0x7feccc056850 2026-02-13T02:31:19.371 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.359+0000 7feccbfff640 1 -- 10.20.193.121:0/1034309861 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feccc17a3c0 con 0x7feccc056850 2026-02-13T02:31:19.371 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.359+0000 7feccbfff640 1 -- 10.20.193.121:0/1034309861 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feccc09cd70 con 0x7feccc056850 2026-02-13T02:31:19.371 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.359+0000 7fecab7fe640 1 -- 10.20.193.121:0/1034309861 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 5) ==== 100086+0+0 (secure 0 0 0) 0x7fecc00051c0 con 0x7feccc056850 2026-02-13T02:31:19.371 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.359+0000 7fecab7fe640 1 --2- 10.20.193.121:0/1034309861 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fec98074140 0x7fec980945f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:19.371 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.359+0000 7fecca7fc640 1 --2- 10.20.193.121:0/1034309861 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fec98074140 0x7fec980945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:19.371 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.359+0000 7fecab7fe640 1 -- 10.20.193.121:0/1034309861 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6447+0+0 (secure 0 0 0) 0x7fecc0095c50 con 0x7feccc056850 2026-02-13T02:31:19.371 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.359+0000 7fecca7fc640 1 --2- 10.20.193.121:0/1034309861 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fec98074140 0x7fec980945f0 secure :-1 s=READY pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecb4009850 tx=0x7fecb40b0040 comp rx=0 tx=0).ready entity=mgr.4155 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:19.372 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.363+0000 7fecab7fe640 1 -- 10.20.193.121:0/1034309861 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (secure 0 0 0) 0x7fecc0060140 con 0x7feccc056850 2026-02-13T02:31:19.478 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:19.467+0000 7feccbfff640 1 -- 10.20.193.121:0/1034309861 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7feccc179cf0 con 0x7feccc056850 2026-02-13T02:31:20.290 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.279+0000 7fecab7fe640 1 -- 10.20.193.121:0/1034309861 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7fecc005fa20 con 0x7feccc056850 2026-02-13T02:31:20.290 INFO:teuthology.orchestra.run.trial121.stderr:added data pool 4 to fsmap 2026-02-13T02:31:20.292 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.283+0000 7feccbfff640 1 -- 10.20.193.121:0/1034309861 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fec98074140 msgr2=0x7fec980945f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:20.292 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.283+0000 7feccbfff640 1 --2- 10.20.193.121:0/1034309861 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fec98074140 0x7fec980945f0 secure :-1 s=READY pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecb4009850 tx=0x7fecb40b0040 comp rx=0 tx=0).stop 2026-02-13T02:31:20.292 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.283+0000 7feccbfff640 1 -- 10.20.193.121:0/1034309861 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7feccc056850 msgr2=0x7feccc161dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:20.292 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.283+0000 7feccbfff640 1 --2- 10.20.193.121:0/1034309861 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7feccc056850 0x7feccc161dc0 secure :-1 s=READY pgs=140 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecc0007fd0 tx=0x7fecc000cb90 comp rx=0 tx=0).stop 2026-02-13T02:31:20.292 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.283+0000 7feccbfff640 1 -- 10.20.193.121:0/1034309861 shutdown_connections 2026-02-13T02:31:20.293 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.283+0000 7feccbfff640 1 --2- 10.20.193.121:0/1034309861 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fec98074140 0x7fec980945f0 unknown :-1 s=CLOSED pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.293 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.283+0000 7feccbfff640 1 --2- 10.20.193.121:0/1034309861 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7feccc169c70 0x7feccc15ec90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.293 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.283+0000 7feccbfff640 1 --2- 10.20.193.121:0/1034309861 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7feccc166080 0x7feccc1423f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.293 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.283+0000 7feccbfff640 1 --2- 10.20.193.121:0/1034309861 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7feccc056850 0x7feccc161dc0 unknown :-1 s=CLOSED pgs=140 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.293 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.283+0000 7feccbfff640 1 -- 10.20.193.121:0/1034309861 >> 10.20.193.121:0/1034309861 conn(0x7feccc054540 msgr2=0x7feccc145da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:20.293 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.283+0000 7feccbfff640 1 -- 10.20.193.121:0/1034309861 shutdown_connections 2026-02-13T02:31:20.293 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.283+0000 7feccbfff640 1 -- 10.20.193.121:0/1034309861 wait complete. 2026-02-13T02:31:20.304 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2026-02-13T02:31:20.357 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:PerfHandler: tick 2026-02-13T02:31:20.357 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:TaskHandler: tick 2026-02-13T02:31:20.377 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.367+0000 7f955d07a640 1 -- 10.20.193.121:0/1045095327 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f955815c230 msgr2=0x7f9558166940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:20.377 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.367+0000 7f955d07a640 1 --2- 10.20.193.121:0/1045095327 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f955815c230 0x7f9558166940 secure :-1 s=READY pgs=142 gs=2 cs=0 l=1 c_cookie=13431513475477774804 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f954c005eb0 tx=0x7f954c01c960 comp rx=0 tx=0).stop 2026-02-13T02:31:20.377 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.367+0000 7f955d07a640 1 -- 10.20.193.121:0/1045095327 shutdown_connections 2026-02-13T02:31:20.377 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.367+0000 7f955d07a640 1 --2- 10.20.193.121:0/1045095327 >> v2:10.20.193.178:3300/0 conn(0x7f955809b9b0 0x7f955809be10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.378 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.367+0000 7f955d07a640 1 --2- 10.20.193.121:0/1045095327 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f955815c230 0x7f9558166940 unknown :-1 s=CLOSED pgs=142 gs=2 cs=0 l=1 c_cookie=13431513475477774804 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.378 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.367+0000 7f955d07a640 1 -- 10.20.193.121:0/1045095327 >> 10.20.193.121:0/1045095327 conn(0x7f9558057b80 msgr2=0x7f955809ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:20.378 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.367+0000 7f955d07a640 1 -- 10.20.193.121:0/1045095327 shutdown_connections 2026-02-13T02:31:20.378 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.367+0000 7f955d07a640 1 -- 10.20.193.121:0/1045095327 wait complete. 2026-02-13T02:31:20.381 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.367+0000 7f955d07a640 1 Processor -- start 2026-02-13T02:31:20.381 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.367+0000 7f955d07a640 1 -- start start 2026-02-13T02:31:20.381 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.367+0000 7f955d07a640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f955809b9b0 0x7f9558162970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:20.381 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.367+0000 7f955d07a640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f95580b9770 0x7f9558141600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:20.381 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.367+0000 7f955d07a640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f955815c230 0x7f9558141b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:20.381 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.367+0000 7f955d07a640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7f95581cc450 con 0x7f955809b9b0 2026-02-13T02:31:20.381 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.367+0000 7f955d07a640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7f95581cc2d0 con 0x7f955815c230 2026-02-13T02:31:20.381 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.367+0000 7f955d07a640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7f95581cc5d0 con 0x7f95580b9770 2026-02-13T02:31:20.381 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.367+0000 7f9556d76640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f955809b9b0 0x7f9558162970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:20.381 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.367+0000 7f9556d76640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f955809b9b0 0x7f9558162970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:33682/0 (socket says 10.20.193.121:33682) 2026-02-13T02:31:20.382 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.367+0000 7f9556d76640 1 -- 10.20.193.121:0/284806048 learned_addr learned my addr 10.20.193.121:0/284806048 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:20.382 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.371+0000 7f9556575640 1 --2- 10.20.193.121:0/284806048 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f95580b9770 0x7f9558141600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:20.382 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.371+0000 7f9557577640 1 --2- 10.20.193.121:0/284806048 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f955815c230 0x7f9558141b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:20.382 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.371+0000 7f9556d76640 1 -- 10.20.193.121:0/284806048 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f95580b9770 msgr2=0x7f9558141600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:20.382 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.371+0000 7f9556d76640 1 --2- 10.20.193.121:0/284806048 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f95580b9770 0x7f9558141600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.382 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.371+0000 7f9556d76640 1 -- 10.20.193.121:0/284806048 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f955815c230 msgr2=0x7f9558141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:20.382 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.371+0000 7f9556d76640 1 --2- 10.20.193.121:0/284806048 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f955815c230 0x7f9558141b40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.382 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.371+0000 7f9556d76640 1 -- 10.20.193.121:0/284806048 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f955817f760 con 0x7f955809b9b0 2026-02-13T02:31:20.382 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.371+0000 7f9556d76640 1 --2- 10.20.193.121:0/284806048 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f955809b9b0 0x7f9558162970 secure :-1 s=READY pgs=143 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f954c01ced0 tx=0x7f954c004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:20.382 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.371+0000 7f95377fe640 1 -- 10.20.193.121:0/284806048 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f954c0bc070 con 0x7f955809b9b0 2026-02-13T02:31:20.382 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.371+0000 7f95377fe640 1 -- 10.20.193.121:0/284806048 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f954c0a5b40 con 0x7f955809b9b0 2026-02-13T02:31:20.382 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.371+0000 7f95377fe640 1 -- 10.20.193.121:0/284806048 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f954c0026e0 con 0x7f955809b9b0 2026-02-13T02:31:20.383 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.371+0000 7f955d07a640 1 -- 10.20.193.121:0/284806048 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f955817e9a0 con 0x7f955809b9b0 2026-02-13T02:31:20.383 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.371+0000 7f955d07a640 1 -- 10.20.193.121:0/284806048 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f955817ef60 con 0x7f955809b9b0 2026-02-13T02:31:20.383 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.371+0000 7f955d07a640 1 -- 10.20.193.121:0/284806048 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f955809be10 con 0x7f955809b9b0 2026-02-13T02:31:20.383 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.371+0000 7f95377fe640 1 -- 10.20.193.121:0/284806048 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 5) ==== 100086+0+0 (secure 0 0 0) 0x7f954c0ae470 con 0x7f955809b9b0 2026-02-13T02:31:20.383 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.371+0000 7f95377fe640 1 --2- 10.20.193.121:0/284806048 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f9524074140 0x7f95240945f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:20.383 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.371+0000 7f95377fe640 1 -- 10.20.193.121:0/284806048 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6479+0+0 (secure 0 0 0) 0x7f954c0b4070 con 0x7f955809b9b0 2026-02-13T02:31:20.383 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.371+0000 7f9556575640 1 --2- 10.20.193.121:0/284806048 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f9524074140 0x7f95240945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:20.383 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.371+0000 7f9556575640 1 --2- 10.20.193.121:0/284806048 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f9524074140 0x7f95240945f0 secure :-1 s=READY pgs=55 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9558099100 tx=0x7f9540004050 comp rx=0 tx=0).ready entity=mgr.4155 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:20.384 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.375+0000 7f95377fe640 1 -- 10.20.193.121:0/284806048 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (secure 0 0 0) 0x7f954c016550 con 0x7f955809b9b0 2026-02-13T02:31:20.491 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.479+0000 7f955d07a640 1 -- 10.20.193.121:0/284806048 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9558166c40 con 0x7f955809b9b0 2026-02-13T02:31:20.491 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.483+0000 7f95377fe640 1 -- 10.20.193.121:0/284806048 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5261 (secure 0 0 0) 0x7f954c0fa350 con 0x7f955809b9b0 2026-02-13T02:31:20.492 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:31:20.492 INFO:teuthology.orchestra.run.trial121.stdout:{"epoch":7,"btime":"2026-02-13T02:31:20:281216+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.121:6835/1203730948","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6834","nonce":1203730948},{"type":"v1","addr":"10.20.193.121:6835","nonce":1203730948}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4341,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.121:6837/3462984922","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6836","nonce":3462984922},{"type":"v1","addr":"10.20.193.121:6837","nonce":3462984922}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4378,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.178:6833/2455821452","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6832","nonce":2455821452},{"type":"v1","addr":"10.20.193.178:6833","nonce":2455821452}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-13T02:31:14.431852+0000","modified":"2026-02-13T02:31:19.473944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4387},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4387":{"gid":4387,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"10.20.193.178:6835/2386750552","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6834","nonce":2386750552},{"type":"v1","addr":"10.20.193.178:6835","nonce":2386750552}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4387,"qdb_cluster":[4387]},"id":1}]} 2026-02-13T02:31:20.494 INFO:teuthology.orchestra.run.trial121.stderr:dumped fsmap epoch 7 2026-02-13T02:31:20.494 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.483+0000 7f955d07a640 1 -- 10.20.193.121:0/284806048 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f9524074140 msgr2=0x7f95240945f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:20.495 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.483+0000 7f955d07a640 1 --2- 10.20.193.121:0/284806048 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f9524074140 0x7f95240945f0 secure :-1 s=READY pgs=55 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9558099100 tx=0x7f9540004050 comp rx=0 tx=0).stop 2026-02-13T02:31:20.495 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.483+0000 7f955d07a640 1 -- 10.20.193.121:0/284806048 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f955809b9b0 msgr2=0x7f9558162970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:20.495 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.483+0000 7f955d07a640 1 --2- 10.20.193.121:0/284806048 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f955809b9b0 0x7f9558162970 secure :-1 s=READY pgs=143 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f954c01ced0 tx=0x7f954c004660 comp rx=0 tx=0).stop 2026-02-13T02:31:20.495 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.483+0000 7f955d07a640 1 -- 10.20.193.121:0/284806048 shutdown_connections 2026-02-13T02:31:20.495 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.483+0000 7f955d07a640 1 --2- 10.20.193.121:0/284806048 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f9524074140 0x7f95240945f0 unknown :-1 s=CLOSED pgs=55 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.495 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.483+0000 7f955d07a640 1 --2- 10.20.193.121:0/284806048 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f955815c230 0x7f9558141b40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.495 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.483+0000 7f955d07a640 1 --2- 10.20.193.121:0/284806048 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f95580b9770 0x7f9558141600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.495 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.483+0000 7f955d07a640 1 --2- 10.20.193.121:0/284806048 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f955809b9b0 0x7f9558162970 unknown :-1 s=CLOSED pgs=143 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.495 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.483+0000 7f955d07a640 1 -- 10.20.193.121:0/284806048 >> 10.20.193.121:0/284806048 conn(0x7f9558057b80 msgr2=0x7f955809b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:20.496 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.483+0000 7f955d07a640 1 -- 10.20.193.121:0/284806048 shutdown_connections 2026-02-13T02:31:20.496 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.483+0000 7f955d07a640 1 -- 10.20.193.121:0/284806048 wait complete. 2026-02-13T02:31:20.502 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-13T02:31:20.567 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.555+0000 7fe19bc71640 1 -- 10.20.193.121:0/3705438398 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fe19409c0c0 msgr2=0x7fe194166940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:20.567 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.555+0000 7fe19bc71640 1 --2- 10.20.193.121:0/3705438398 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fe19409c0c0 0x7fe194166940 secure :-1 s=READY pgs=145 gs=2 cs=0 l=1 c_cookie=14886425354927746184 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe188005eb0 tx=0x7fe18801c9a0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.567 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.555+0000 7fe19bc71640 1 -- 10.20.193.121:0/3705438398 shutdown_connections 2026-02-13T02:31:20.567 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.555+0000 7fe19bc71640 1 --2- 10.20.193.121:0/3705438398 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fe1940b9770 0x7fe1940b9bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.567 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.555+0000 7fe19bc71640 1 --2- 10.20.193.121:0/3705438398 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fe19409c0c0 0x7fe194166940 unknown :-1 s=CLOSED pgs=145 gs=2 cs=0 l=1 c_cookie=14886425354927746184 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.567 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.555+0000 7fe19bc71640 1 -- 10.20.193.121:0/3705438398 >> 10.20.193.121:0/3705438398 conn(0x7fe194057b80 msgr2=0x7fe19409ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:20.567 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.555+0000 7fe19bc71640 1 -- 10.20.193.121:0/3705438398 shutdown_connections 2026-02-13T02:31:20.568 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.555+0000 7fe19bc71640 1 -- 10.20.193.121:0/3705438398 wait complete. 2026-02-13T02:31:20.570 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe19bc71640 1 Processor -- start 2026-02-13T02:31:20.571 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe19bc71640 1 -- start start 2026-02-13T02:31:20.571 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe19bc71640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fe19409c0c0 0x7fe19415c880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:20.571 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe19bc71640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fe1940b9770 0x7fe1940992b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:20.571 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe19bc71640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fe19415c230 0x7fe19405d130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:20.571 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe19bc71640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe1941cc080 con 0x7fe19415c230 2026-02-13T02:31:20.571 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe19bc71640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe1941cbf00 con 0x7fe19409c0c0 2026-02-13T02:31:20.571 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe19bc71640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7fe1941cc200 con 0x7fe1940b9770 2026-02-13T02:31:20.571 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe19a1e7640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fe19415c230 0x7fe19405d130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:20.571 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe19a1e7640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fe19415c230 0x7fe19405d130 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:33706/0 (socket says 10.20.193.121:33706) 2026-02-13T02:31:20.571 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe19a1e7640 1 -- 10.20.193.121:0/3376628203 learned_addr learned my addr 10.20.193.121:0/3376628203 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:20.571 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe1999e6640 1 --2- 10.20.193.121:0/3376628203 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fe19409c0c0 0x7fe19415c880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:20.572 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe19a1e7640 1 -- 10.20.193.121:0/3376628203 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fe1940b9770 msgr2=0x7fe1940992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:20.572 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe19a1e7640 1 --2- 10.20.193.121:0/3376628203 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fe1940b9770 0x7fe1940992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.572 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe19a1e7640 1 -- 10.20.193.121:0/3376628203 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fe19409c0c0 msgr2=0x7fe19415c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:20.572 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe19a1e7640 1 --2- 10.20.193.121:0/3376628203 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fe19409c0c0 0x7fe19415c880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.572 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe19a1e7640 1 -- 10.20.193.121:0/3376628203 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19417c920 con 0x7fe19415c230 2026-02-13T02:31:20.572 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe1999e6640 1 --2- 10.20.193.121:0/3376628203 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fe19409c0c0 0x7fe19415c880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:31:20.572 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe19a1e7640 1 --2- 10.20.193.121:0/3376628203 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fe19415c230 0x7fe19405d130 secure :-1 s=READY pgs=146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe19000a9a0 tx=0x7fe19000e630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:20.572 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe1827fc640 1 -- 10.20.193.121:0/3376628203 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe19000ee60 con 0x7fe19415c230 2026-02-13T02:31:20.572 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe1827fc640 1 -- 10.20.193.121:0/3376628203 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe190008500 con 0x7fe19415c230 2026-02-13T02:31:20.572 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe1827fc640 1 -- 10.20.193.121:0/3376628203 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe190008970 con 0x7fe19415c230 2026-02-13T02:31:20.572 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe19bc71640 1 -- 10.20.193.121:0/3376628203 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe19417cc00 con 0x7fe19415c230 2026-02-13T02:31:20.573 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe19bc71640 1 -- 10.20.193.121:0/3376628203 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe19417d1c0 con 0x7fe19415c230 2026-02-13T02:31:20.573 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe19bc71640 1 -- 10.20.193.121:0/3376628203 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe194166940 con 0x7fe19415c230 2026-02-13T02:31:20.573 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe1827fc640 1 -- 10.20.193.121:0/3376628203 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 5) ==== 100086+0+0 (secure 0 0 0) 0x7fe190013070 con 0x7fe19415c230 2026-02-13T02:31:20.573 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe1827fc640 1 --2- 10.20.193.121:0/3376628203 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fe164074140 0x7fe1640945f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:20.573 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe1999e6640 1 --2- 10.20.193.121:0/3376628203 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fe164074140 0x7fe1640945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:20.573 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe1827fc640 1 -- 10.20.193.121:0/3376628203 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6479+0+0 (secure 0 0 0) 0x7fe1900974b0 con 0x7fe19415c230 2026-02-13T02:31:20.573 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.559+0000 7fe1999e6640 1 --2- 10.20.193.121:0/3376628203 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fe164074140 0x7fe1640945f0 secure :-1 s=READY pgs=56 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe184002770 tx=0x7fe184009040 comp rx=0 tx=0).ready entity=mgr.4155 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:20.574 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.563+0000 7fe1827fc640 1 -- 10.20.193.121:0/3376628203 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (secure 0 0 0) 0x7fe190011070 con 0x7fe19415c230 2026-02-13T02:31:20.660 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.651+0000 7fe19bc71640 1 -- 10.20.193.121:0/3376628203 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe194143260 con 0x7fe19415c230 2026-02-13T02:31:20.661 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.651+0000 7fe1827fc640 1 -- 10.20.193.121:0/3376628203 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18520 (secure 0 0 0) 0x7fe190061a00 con 0x7fe19415c230 2026-02-13T02:31:20.661 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:31:20.661 INFO:teuthology.orchestra.run.trial121.stdout:{"epoch":24,"fsid":"58020caa-1bc7-4445-b2fc-3f075ab46105","created":"2026-02-13T02:30:58.802931+0000","modified":"2026-02-13T02:31:19.473810+0000","last_up_change":"2026-02-13T02:31:06.046386+0000","last_in_change":"2026-02-13T02:31:02.036447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T02:31:06.353015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T02:31:12.964909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T02:31:13.422523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-13T02:31:17.275198+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1bbcd75b-e678-4cb7-b625-1475960a9cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6818","nonce":4064034701},{"type":"v1","addr":"10.20.193.121:6819","nonce":4064034701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6820","nonce":4064034701},{"type":"v1","addr":"10.20.193.121:6821","nonce":4064034701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6824","nonce":4064034701},{"type":"v1","addr":"10.20.193.121:6825","nonce":4064034701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6822","nonce":4064034701},{"type":"v1","addr":"10.20.193.121:6823","nonce":4064034701}]},"public_addr":"10.20.193.121:6819/4064034701","cluster_addr":"10.20.193.121:6821/4064034701","heartbeat_back_addr":"10.20.193.121:6825/4064034701","heartbeat_front_addr":"10.20.193.121:6823/4064034701","state":["exists","up"]},{"osd":1,"uuid":"8e4f3373-8bf0-4119-9e36-38ae77f57ad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6802","nonce":3452928042},{"type":"v1","addr":"10.20.193.121:6803","nonce":3452928042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6805","nonce":3452928042},{"type":"v1","addr":"10.20.193.121:6806","nonce":3452928042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6811","nonce":3452928042},{"type":"v1","addr":"10.20.193.121:6813","nonce":3452928042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6808","nonce":3452928042},{"type":"v1","addr":"10.20.193.121:6810","nonce":3452928042}]},"public_addr":"10.20.193.121:6803/3452928042","cluster_addr":"10.20.193.121:6806/3452928042","heartbeat_back_addr":"10.20.193.121:6813/3452928042","heartbeat_front_addr":"10.20.193.121:6810/3452928042","state":["exists","up"]},{"osd":2,"uuid":"f88cfbd7-657c-42c3-848e-d41286534244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6804","nonce":1907018650},{"type":"v1","addr":"10.20.193.121:6807","nonce":1907018650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6809","nonce":1907018650},{"type":"v1","addr":"10.20.193.121:6812","nonce":1907018650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6816","nonce":1907018650},{"type":"v1","addr":"10.20.193.121:6817","nonce":1907018650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6814","nonce":1907018650},{"type":"v1","addr":"10.20.193.121:6815","nonce":1907018650}]},"public_addr":"10.20.193.121:6807/1907018650","cluster_addr":"10.20.193.121:6812/1907018650","heartbeat_back_addr":"10.20.193.121:6817/1907018650","heartbeat_front_addr":"10.20.193.121:6815/1907018650","state":["exists","up"]},{"osd":3,"uuid":"e4972ad7-8b35-4f37-99b5-37c7eebb40c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6826","nonce":4123684708},{"type":"v1","addr":"10.20.193.121:6827","nonce":4123684708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6828","nonce":4123684708},{"type":"v1","addr":"10.20.193.121:6829","nonce":4123684708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6832","nonce":4123684708},{"type":"v1","addr":"10.20.193.121:6833","nonce":4123684708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6830","nonce":4123684708},{"type":"v1","addr":"10.20.193.121:6831","nonce":4123684708}]},"public_addr":"10.20.193.121:6827/4123684708","cluster_addr":"10.20.193.121:6829/4123684708","heartbeat_back_addr":"10.20.193.121:6833/4123684708","heartbeat_front_addr":"10.20.193.121:6831/4123684708","state":["exists","up"]},{"osd":4,"uuid":"c12b1fa7-7ebd-4fd3-a785-f8e02e0cf3c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6808","nonce":608607716},{"type":"v1","addr":"10.20.193.178:6809","nonce":608607716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6810","nonce":608607716},{"type":"v1","addr":"10.20.193.178:6811","nonce":608607716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6814","nonce":608607716},{"type":"v1","addr":"10.20.193.178:6815","nonce":608607716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6812","nonce":608607716},{"type":"v1","addr":"10.20.193.178:6813","nonce":608607716}]},"public_addr":"10.20.193.178:6809/608607716","cluster_addr":"10.20.193.178:6811/608607716","heartbeat_back_addr":"10.20.193.178:6815/608607716","heartbeat_front_addr":"10.20.193.178:6813/608607716","state":["exists","up"]},{"osd":5,"uuid":"7c8786af-1011-41b5-ac07-20302bd12503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6824","nonce":3784702419},{"type":"v1","addr":"10.20.193.178:6825","nonce":3784702419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6826","nonce":3784702419},{"type":"v1","addr":"10.20.193.178:6827","nonce":3784702419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6830","nonce":3784702419},{"type":"v1","addr":"10.20.193.178:6831","nonce":3784702419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6828","nonce":3784702419},{"type":"v1","addr":"10.20.193.178:6829","nonce":3784702419}]},"public_addr":"10.20.193.178:6825/3784702419","cluster_addr":"10.20.193.178:6827/3784702419","heartbeat_back_addr":"10.20.193.178:6831/3784702419","heartbeat_front_addr":"10.20.193.178:6829/3784702419","state":["exists","up"]},{"osd":6,"uuid":"4da5620f-6851-4da1-898d-22654932a4d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6800","nonce":3993947833},{"type":"v1","addr":"10.20.193.178:6801","nonce":3993947833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6802","nonce":3993947833},{"type":"v1","addr":"10.20.193.178:6803","nonce":3993947833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6806","nonce":3993947833},{"type":"v1","addr":"10.20.193.178:6807","nonce":3993947833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6804","nonce":3993947833},{"type":"v1","addr":"10.20.193.178:6805","nonce":3993947833}]},"public_addr":"10.20.193.178:6801/3993947833","cluster_addr":"10.20.193.178:6803/3993947833","heartbeat_back_addr":"10.20.193.178:6807/3993947833","heartbeat_front_addr":"10.20.193.178:6805/3993947833","state":["exists","up"]},{"osd":7,"uuid":"91841061-fa38-436d-b719-90cbf2f1830d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6816","nonce":1274696415},{"type":"v1","addr":"10.20.193.178:6817","nonce":1274696415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6818","nonce":1274696415},{"type":"v1","addr":"10.20.193.178:6819","nonce":1274696415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6822","nonce":1274696415},{"type":"v1","addr":"10.20.193.178:6823","nonce":1274696415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6820","nonce":1274696415},{"type":"v1","addr":"10.20.193.178:6821","nonce":1274696415}]},"public_addr":"10.20.193.178:6817/1274696415","cluster_addr":"10.20.193.178:6819/1274696415","heartbeat_back_addr":"10.20.193.178:6823/1274696415","heartbeat_front_addr":"10.20.193.178:6821/1274696415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"2","m":"2","plugin":"isa","technique":"reed_sol_van"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T02:31:20.662 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.651+0000 7fe19bc71640 1 -- 10.20.193.121:0/3376628203 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fe164074140 msgr2=0x7fe1640945f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:20.662 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.651+0000 7fe19bc71640 1 --2- 10.20.193.121:0/3376628203 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fe164074140 0x7fe1640945f0 secure :-1 s=READY pgs=56 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe184002770 tx=0x7fe184009040 comp rx=0 tx=0).stop 2026-02-13T02:31:20.663 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.651+0000 7fe19bc71640 1 -- 10.20.193.121:0/3376628203 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fe19415c230 msgr2=0x7fe19405d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:20.663 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.651+0000 7fe19bc71640 1 --2- 10.20.193.121:0/3376628203 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fe19415c230 0x7fe19405d130 secure :-1 s=READY pgs=146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe19000a9a0 tx=0x7fe19000e630 comp rx=0 tx=0).stop 2026-02-13T02:31:20.663 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.651+0000 7fe19bc71640 1 -- 10.20.193.121:0/3376628203 shutdown_connections 2026-02-13T02:31:20.663 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.651+0000 7fe19bc71640 1 --2- 10.20.193.121:0/3376628203 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fe164074140 0x7fe1640945f0 unknown :-1 s=CLOSED pgs=56 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.663 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.651+0000 7fe19bc71640 1 --2- 10.20.193.121:0/3376628203 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fe19415c230 0x7fe19405d130 unknown :-1 s=CLOSED pgs=146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.663 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.651+0000 7fe19bc71640 1 --2- 10.20.193.121:0/3376628203 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fe1940b9770 0x7fe1940992b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.663 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.651+0000 7fe19bc71640 1 --2- 10.20.193.121:0/3376628203 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fe19409c0c0 0x7fe19415c880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.663 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.651+0000 7fe19bc71640 1 -- 10.20.193.121:0/3376628203 >> 10.20.193.121:0/3376628203 conn(0x7fe194057b80 msgr2=0x7fe194142690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:20.663 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.651+0000 7fe19bc71640 1 -- 10.20.193.121:0/3376628203 shutdown_connections 2026-02-13T02:31:20.663 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.651+0000 7fe19bc71640 1 -- 10.20.193.121:0/3376628203 wait complete. 2026-02-13T02:31:20.672 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-13T02:31:20.746 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.735+0000 7f8592f29640 1 -- 10.20.193.121:0/411357111 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f858c0a45a0 msgr2=0x7f858c09dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:20.746 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.735+0000 7f8592f29640 1 --2- 10.20.193.121:0/411357111 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f858c0a45a0 0x7f858c09dd10 secure :-1 s=READY pgs=147 gs=2 cs=0 l=1 c_cookie=10174641668889263334 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f858800a750 tx=0x7f858801db40 comp rx=0 tx=0).stop 2026-02-13T02:31:20.746 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.735+0000 7f8592f29640 1 -- 10.20.193.121:0/411357111 shutdown_connections 2026-02-13T02:31:20.746 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.735+0000 7f8592f29640 1 --2- 10.20.193.121:0/411357111 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f858c0a45a0 0x7f858c09dd10 unknown :-1 s=CLOSED pgs=147 gs=2 cs=0 l=1 c_cookie=10174641668889263334 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.747 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.735+0000 7f8592f29640 1 --2- 10.20.193.121:0/411357111 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f858c0b98d0 0x7f858c0bea50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.747 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.735+0000 7f8592f29640 1 -- 10.20.193.121:0/411357111 >> 10.20.193.121:0/411357111 conn(0x7f858c0549d0 msgr2=0x7f858c0a0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:20.747 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.735+0000 7f8592f29640 1 -- 10.20.193.121:0/411357111 shutdown_connections 2026-02-13T02:31:20.747 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.735+0000 7f8592f29640 1 -- 10.20.193.121:0/411357111 wait complete. 2026-02-13T02:31:20.750 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f8592f29640 1 Processor -- start 2026-02-13T02:31:20.750 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f8592f29640 1 -- start start 2026-02-13T02:31:20.751 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f8592f29640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f858c0a45a0 0x7f858c161e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:20.751 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f8592f29640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f858c0b98d0 0x7f858c16b330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:20.751 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f8592f29640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f858c0ba920 0x7f858c142d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:20.751 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f8592f29640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7f858c16c940 con 0x7f858c0b98d0 2026-02-13T02:31:20.751 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f8592f29640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7f858c16c7c0 con 0x7f858c0a45a0 2026-02-13T02:31:20.751 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f8592f29640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7f858c16cac0 con 0x7f858c0ba920 2026-02-13T02:31:20.751 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f8583fff640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f858c0b98d0 0x7f858c16b330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:20.751 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f8583fff640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f858c0b98d0 0x7f858c16b330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:33720/0 (socket says 10.20.193.121:33720) 2026-02-13T02:31:20.751 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f8583fff640 1 -- 10.20.193.121:0/3519226898 learned_addr learned my addr 10.20.193.121:0/3519226898 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:20.751 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f8590c9e640 1 --2- 10.20.193.121:0/3519226898 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f858c0a45a0 0x7f858c161e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:20.751 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f859149f640 1 --2- 10.20.193.121:0/3519226898 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f858c0ba920 0x7f858c142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:20.752 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f8583fff640 1 -- 10.20.193.121:0/3519226898 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f858c0ba920 msgr2=0x7f858c142d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:20.752 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f8583fff640 1 --2- 10.20.193.121:0/3519226898 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f858c0ba920 0x7f858c142d80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.752 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f8583fff640 1 -- 10.20.193.121:0/3519226898 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f858c0a45a0 msgr2=0x7f858c161e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:20.752 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f8583fff640 1 --2- 10.20.193.121:0/3519226898 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f858c0a45a0 0x7f858c161e70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.752 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f8583fff640 1 -- 10.20.193.121:0/3519226898 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858c0b2ec0 con 0x7f858c0b98d0 2026-02-13T02:31:20.752 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f8590c9e640 1 --2- 10.20.193.121:0/3519226898 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f858c0a45a0 0x7f858c161e70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:31:20.752 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f8583fff640 1 --2- 10.20.193.121:0/3519226898 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f858c0b98d0 0x7f858c16b330 secure :-1 s=READY pgs=148 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f857400c520 tx=0x7f857400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:20.752 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f85817fa640 1 -- 10.20.193.121:0/3519226898 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8574017070 con 0x7f858c0b98d0 2026-02-13T02:31:20.752 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f85817fa640 1 -- 10.20.193.121:0/3519226898 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8574006be0 con 0x7f858c0b98d0 2026-02-13T02:31:20.752 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f8592f29640 1 -- 10.20.193.121:0/3519226898 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f858c0b31a0 con 0x7f858c0b98d0 2026-02-13T02:31:20.752 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f85817fa640 1 -- 10.20.193.121:0/3519226898 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8574007030 con 0x7f858c0b98d0 2026-02-13T02:31:20.752 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f8592f29640 1 -- 10.20.193.121:0/3519226898 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f858c0b3760 con 0x7f858c0b98d0 2026-02-13T02:31:20.753 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f8592f29640 1 -- 10.20.193.121:0/3519226898 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f858c0b46f0 con 0x7f858c0b98d0 2026-02-13T02:31:20.753 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f85817fa640 1 -- 10.20.193.121:0/3519226898 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 5) ==== 100086+0+0 (secure 0 0 0) 0x7f85740071d0 con 0x7f858c0b98d0 2026-02-13T02:31:20.753 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f85817fa640 1 --2- 10.20.193.121:0/3519226898 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f855c074140 0x7f855c0945f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:20.753 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f8590c9e640 1 --2- 10.20.193.121:0/3519226898 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f855c074140 0x7f855c0945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:20.753 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f85817fa640 1 -- 10.20.193.121:0/3519226898 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6479+0+0 (secure 0 0 0) 0x7f8574095aa0 con 0x7f858c0b98d0 2026-02-13T02:31:20.753 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.739+0000 7f8590c9e640 1 --2- 10.20.193.121:0/3519226898 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f855c074140 0x7f855c0945f0 secure :-1 s=READY pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f857c004780 tx=0x7f857c009260 comp rx=0 tx=0).ready entity=mgr.4155 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:20.753 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.743+0000 7f85817fa640 1 -- 10.20.193.121:0/3519226898 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (secure 0 0 0) 0x7f8574021020 con 0x7f858c0b98d0 2026-02-13T02:31:20.835 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.827+0000 7f8592f29640 1 -- 10.20.193.121:0/3519226898 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f858c16cf70 con 0x7f858c0b98d0 2026-02-13T02:31:20.836 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.827+0000 7f85817fa640 1 -- 10.20.193.121:0/3519226898 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18520 (secure 0 0 0) 0x7f857405f960 con 0x7f858c0b98d0 2026-02-13T02:31:20.836 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:31:20.836 INFO:teuthology.orchestra.run.trial121.stdout:{"epoch":24,"fsid":"58020caa-1bc7-4445-b2fc-3f075ab46105","created":"2026-02-13T02:30:58.802931+0000","modified":"2026-02-13T02:31:19.473810+0000","last_up_change":"2026-02-13T02:31:06.046386+0000","last_in_change":"2026-02-13T02:31:02.036447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T02:31:06.353015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T02:31:12.964909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T02:31:13.422523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-13T02:31:17.275198+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1bbcd75b-e678-4cb7-b625-1475960a9cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6818","nonce":4064034701},{"type":"v1","addr":"10.20.193.121:6819","nonce":4064034701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6820","nonce":4064034701},{"type":"v1","addr":"10.20.193.121:6821","nonce":4064034701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6824","nonce":4064034701},{"type":"v1","addr":"10.20.193.121:6825","nonce":4064034701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6822","nonce":4064034701},{"type":"v1","addr":"10.20.193.121:6823","nonce":4064034701}]},"public_addr":"10.20.193.121:6819/4064034701","cluster_addr":"10.20.193.121:6821/4064034701","heartbeat_back_addr":"10.20.193.121:6825/4064034701","heartbeat_front_addr":"10.20.193.121:6823/4064034701","state":["exists","up"]},{"osd":1,"uuid":"8e4f3373-8bf0-4119-9e36-38ae77f57ad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6802","nonce":3452928042},{"type":"v1","addr":"10.20.193.121:6803","nonce":3452928042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6805","nonce":3452928042},{"type":"v1","addr":"10.20.193.121:6806","nonce":3452928042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6811","nonce":3452928042},{"type":"v1","addr":"10.20.193.121:6813","nonce":3452928042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6808","nonce":3452928042},{"type":"v1","addr":"10.20.193.121:6810","nonce":3452928042}]},"public_addr":"10.20.193.121:6803/3452928042","cluster_addr":"10.20.193.121:6806/3452928042","heartbeat_back_addr":"10.20.193.121:6813/3452928042","heartbeat_front_addr":"10.20.193.121:6810/3452928042","state":["exists","up"]},{"osd":2,"uuid":"f88cfbd7-657c-42c3-848e-d41286534244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6804","nonce":1907018650},{"type":"v1","addr":"10.20.193.121:6807","nonce":1907018650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6809","nonce":1907018650},{"type":"v1","addr":"10.20.193.121:6812","nonce":1907018650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6816","nonce":1907018650},{"type":"v1","addr":"10.20.193.121:6817","nonce":1907018650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6814","nonce":1907018650},{"type":"v1","addr":"10.20.193.121:6815","nonce":1907018650}]},"public_addr":"10.20.193.121:6807/1907018650","cluster_addr":"10.20.193.121:6812/1907018650","heartbeat_back_addr":"10.20.193.121:6817/1907018650","heartbeat_front_addr":"10.20.193.121:6815/1907018650","state":["exists","up"]},{"osd":3,"uuid":"e4972ad7-8b35-4f37-99b5-37c7eebb40c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6826","nonce":4123684708},{"type":"v1","addr":"10.20.193.121:6827","nonce":4123684708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6828","nonce":4123684708},{"type":"v1","addr":"10.20.193.121:6829","nonce":4123684708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6832","nonce":4123684708},{"type":"v1","addr":"10.20.193.121:6833","nonce":4123684708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6830","nonce":4123684708},{"type":"v1","addr":"10.20.193.121:6831","nonce":4123684708}]},"public_addr":"10.20.193.121:6827/4123684708","cluster_addr":"10.20.193.121:6829/4123684708","heartbeat_back_addr":"10.20.193.121:6833/4123684708","heartbeat_front_addr":"10.20.193.121:6831/4123684708","state":["exists","up"]},{"osd":4,"uuid":"c12b1fa7-7ebd-4fd3-a785-f8e02e0cf3c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6808","nonce":608607716},{"type":"v1","addr":"10.20.193.178:6809","nonce":608607716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6810","nonce":608607716},{"type":"v1","addr":"10.20.193.178:6811","nonce":608607716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6814","nonce":608607716},{"type":"v1","addr":"10.20.193.178:6815","nonce":608607716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6812","nonce":608607716},{"type":"v1","addr":"10.20.193.178:6813","nonce":608607716}]},"public_addr":"10.20.193.178:6809/608607716","cluster_addr":"10.20.193.178:6811/608607716","heartbeat_back_addr":"10.20.193.178:6815/608607716","heartbeat_front_addr":"10.20.193.178:6813/608607716","state":["exists","up"]},{"osd":5,"uuid":"7c8786af-1011-41b5-ac07-20302bd12503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6824","nonce":3784702419},{"type":"v1","addr":"10.20.193.178:6825","nonce":3784702419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6826","nonce":3784702419},{"type":"v1","addr":"10.20.193.178:6827","nonce":3784702419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6830","nonce":3784702419},{"type":"v1","addr":"10.20.193.178:6831","nonce":3784702419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6828","nonce":3784702419},{"type":"v1","addr":"10.20.193.178:6829","nonce":3784702419}]},"public_addr":"10.20.193.178:6825/3784702419","cluster_addr":"10.20.193.178:6827/3784702419","heartbeat_back_addr":"10.20.193.178:6831/3784702419","heartbeat_front_addr":"10.20.193.178:6829/3784702419","state":["exists","up"]},{"osd":6,"uuid":"4da5620f-6851-4da1-898d-22654932a4d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6800","nonce":3993947833},{"type":"v1","addr":"10.20.193.178:6801","nonce":3993947833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6802","nonce":3993947833},{"type":"v1","addr":"10.20.193.178:6803","nonce":3993947833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6806","nonce":3993947833},{"type":"v1","addr":"10.20.193.178:6807","nonce":3993947833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6804","nonce":3993947833},{"type":"v1","addr":"10.20.193.178:6805","nonce":3993947833}]},"public_addr":"10.20.193.178:6801/3993947833","cluster_addr":"10.20.193.178:6803/3993947833","heartbeat_back_addr":"10.20.193.178:6807/3993947833","heartbeat_front_addr":"10.20.193.178:6805/3993947833","state":["exists","up"]},{"osd":7,"uuid":"91841061-fa38-436d-b719-90cbf2f1830d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6816","nonce":1274696415},{"type":"v1","addr":"10.20.193.178:6817","nonce":1274696415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6818","nonce":1274696415},{"type":"v1","addr":"10.20.193.178:6819","nonce":1274696415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6822","nonce":1274696415},{"type":"v1","addr":"10.20.193.178:6823","nonce":1274696415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6820","nonce":1274696415},{"type":"v1","addr":"10.20.193.178:6821","nonce":1274696415}]},"public_addr":"10.20.193.178:6817/1274696415","cluster_addr":"10.20.193.178:6819/1274696415","heartbeat_back_addr":"10.20.193.178:6823/1274696415","heartbeat_front_addr":"10.20.193.178:6821/1274696415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"2","m":"2","plugin":"isa","technique":"reed_sol_van"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T02:31:20.837 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.827+0000 7f8592f29640 1 -- 10.20.193.121:0/3519226898 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f855c074140 msgr2=0x7f855c0945f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:20.837 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.827+0000 7f8592f29640 1 --2- 10.20.193.121:0/3519226898 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f855c074140 0x7f855c0945f0 secure :-1 s=READY pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f857c004780 tx=0x7f857c009260 comp rx=0 tx=0).stop 2026-02-13T02:31:20.837 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.827+0000 7f8592f29640 1 -- 10.20.193.121:0/3519226898 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f858c0b98d0 msgr2=0x7f858c16b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:20.837 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.827+0000 7f8592f29640 1 --2- 10.20.193.121:0/3519226898 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f858c0b98d0 0x7f858c16b330 secure :-1 s=READY pgs=148 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f857400c520 tx=0x7f857400c9e0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.838 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.827+0000 7f8592f29640 1 -- 10.20.193.121:0/3519226898 shutdown_connections 2026-02-13T02:31:20.838 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.827+0000 7f8592f29640 1 --2- 10.20.193.121:0/3519226898 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f855c074140 0x7f855c0945f0 unknown :-1 s=CLOSED pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.838 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.827+0000 7f8592f29640 1 --2- 10.20.193.121:0/3519226898 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f858c0ba920 0x7f858c142d80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.838 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.827+0000 7f8592f29640 1 --2- 10.20.193.121:0/3519226898 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f858c0b98d0 0x7f858c16b330 unknown :-1 s=CLOSED pgs=148 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.838 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.827+0000 7f8592f29640 1 --2- 10.20.193.121:0/3519226898 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f858c0a45a0 0x7f858c161e70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.838 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.827+0000 7f8592f29640 1 -- 10.20.193.121:0/3519226898 >> 10.20.193.121:0/3519226898 conn(0x7f858c0549d0 msgr2=0x7f858c167340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:20.838 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.827+0000 7f8592f29640 1 -- 10.20.193.121:0/3519226898 shutdown_connections 2026-02-13T02:31:20.838 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.827+0000 7f8592f29640 1 -- 10.20.193.121:0/3519226898 wait complete. 2026-02-13T02:31:20.891 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2026-02-13T02:31:20.962 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.951+0000 7f772abed640 1 -- 10.20.193.121:0/2170027468 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f7724168870 msgr2=0x7f7724168cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:20.962 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.951+0000 7f772abed640 1 --2- 10.20.193.121:0/2170027468 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f7724168870 0x7f7724168cd0 secure :-1 s=READY pgs=149 gs=1 cs=0 l=1 c_cookie=11108029230007927902 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77240a54e0 tx=0x7f770c01c980 comp rx=0 tx=0).stop 2026-02-13T02:31:20.962 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.951+0000 7f772abed640 1 -- 10.20.193.121:0/2170027468 shutdown_connections 2026-02-13T02:31:20.963 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.951+0000 7f772abed640 1 --2- 10.20.193.121:0/2170027468 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f7724056140 0x7f77240565a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.963 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.951+0000 7f772abed640 1 --2- 10.20.193.121:0/2170027468 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f7724168870 0x7f7724168cd0 unknown :-1 s=CLOSED pgs=149 gs=1 cs=0 l=1 c_cookie=11108029230007927902 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.963 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.951+0000 7f772abed640 1 --2- 10.20.193.121:0/2170027468 >> v2:10.20.193.178:3300/0 conn(0x7f77241684a0 0x7f7724058080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.963 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.951+0000 7f772abed640 1 -- 10.20.193.121:0/2170027468 >> 10.20.193.121:0/2170027468 conn(0x7f77240a16e0 msgr2=0x7f77240bbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:20.963 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.951+0000 7f772abed640 1 -- 10.20.193.121:0/2170027468 shutdown_connections 2026-02-13T02:31:20.963 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.951+0000 7f772abed640 1 -- 10.20.193.121:0/2170027468 wait complete. 2026-02-13T02:31:20.966 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f772abed640 1 Processor -- start 2026-02-13T02:31:20.966 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f772abed640 1 -- start start 2026-02-13T02:31:20.966 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f772abed640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f7724056140 0x7f77241317a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:20.966 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f772abed640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f77241684a0 0x7f77240b6d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:20.967 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f772abed640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f7724168870 0x7f772414b5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:20.967 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f772abed640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7f77240544f0 con 0x7f7724056140 2026-02-13T02:31:20.967 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f772abed640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7724054370 con 0x7f7724168870 2026-02-13T02:31:20.967 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f772abed640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7f7724054670 con 0x7f77241684a0 2026-02-13T02:31:20.967 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f7728962640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f7724056140 0x7f77241317a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:20.967 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f7728962640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f7724056140 0x7f77241317a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:33732/0 (socket says 10.20.193.121:33732) 2026-02-13T02:31:20.967 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f7728962640 1 -- 10.20.193.121:0/1757830510 learned_addr learned my addr 10.20.193.121:0/1757830510 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:20.967 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f771bfff640 1 --2- 10.20.193.121:0/1757830510 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f77241684a0 0x7f77240b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:20.967 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f7729163640 1 --2- 10.20.193.121:0/1757830510 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f7724168870 0x7f772414b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:20.967 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f7728962640 1 -- 10.20.193.121:0/1757830510 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f77241684a0 msgr2=0x7f77240b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:20.967 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f7728962640 1 --2- 10.20.193.121:0/1757830510 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f77241684a0 0x7f77240b6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.968 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f7728962640 1 -- 10.20.193.121:0/1757830510 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f7724168870 msgr2=0x7f772414b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:20.968 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f7728962640 1 --2- 10.20.193.121:0/1757830510 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f7724168870 0x7f772414b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:20.968 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f7728962640 1 -- 10.20.193.121:0/1757830510 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77240b8c00 con 0x7f7724056140 2026-02-13T02:31:20.968 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f7728962640 1 --2- 10.20.193.121:0/1757830510 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f7724056140 0x7f77241317a0 secure :-1 s=READY pgs=150 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f771400d980 tx=0x7f771400de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:20.968 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f77197fa640 1 -- 10.20.193.121:0/1757830510 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7714014070 con 0x7f7724056140 2026-02-13T02:31:20.968 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f77197fa640 1 -- 10.20.193.121:0/1757830510 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f771400b840 con 0x7f7724056140 2026-02-13T02:31:20.968 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f772abed640 1 -- 10.20.193.121:0/1757830510 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77240b8ee0 con 0x7f7724056140 2026-02-13T02:31:20.968 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f77197fa640 1 -- 10.20.193.121:0/1757830510 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f771400bc90 con 0x7f7724056140 2026-02-13T02:31:20.968 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f772abed640 1 -- 10.20.193.121:0/1757830510 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77240b94a0 con 0x7f7724056140 2026-02-13T02:31:20.968 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f772abed640 1 -- 10.20.193.121:0/1757830510 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77240565a0 con 0x7f7724056140 2026-02-13T02:31:20.968 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f77197fa640 1 -- 10.20.193.121:0/1757830510 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 5) ==== 100086+0+0 (secure 0 0 0) 0x7f77140026e0 con 0x7f7724056140 2026-02-13T02:31:20.969 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f77197fa640 1 --2- 10.20.193.121:0/1757830510 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f76f4074140 0x7f76f40945f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:20.969 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f77197fa640 1 -- 10.20.193.121:0/1757830510 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6479+0+0 (secure 0 0 0) 0x7f7714096790 con 0x7f7724056140 2026-02-13T02:31:20.969 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f771bfff640 1 --2- 10.20.193.121:0/1757830510 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f76f4074140 0x7f76f40945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:20.969 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.955+0000 7f771bfff640 1 --2- 10.20.193.121:0/1757830510 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f76f4074140 0x7f76f40945f0 secure :-1 s=READY pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f770c0098e0 tx=0x7f770c0b0040 comp rx=0 tx=0).ready entity=mgr.4155 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:20.969 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:20.959+0000 7f77197fa640 1 -- 10.20.193.121:0/1757830510 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (secure 0 0 0) 0x7f7714060690 con 0x7f7724056140 2026-02-13T02:31:21.070 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.059+0000 7f772abed640 1 -- 10.20.193.121:0/1757830510 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77240a4450 con 0x7f7724056140 2026-02-13T02:31:21.071 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.059+0000 7f77197fa640 1 -- 10.20.193.121:0/1757830510 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5261 (secure 0 0 0) 0x7f7714066040 con 0x7f7724056140 2026-02-13T02:31:21.071 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:31:21.071 INFO:teuthology.orchestra.run.trial121.stdout:{"epoch":7,"btime":"2026-02-13T02:31:20:281216+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.121:6835/1203730948","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6834","nonce":1203730948},{"type":"v1","addr":"10.20.193.121:6835","nonce":1203730948}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4341,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.121:6837/3462984922","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6836","nonce":3462984922},{"type":"v1","addr":"10.20.193.121:6837","nonce":3462984922}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4378,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.178:6833/2455821452","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6832","nonce":2455821452},{"type":"v1","addr":"10.20.193.178:6833","nonce":2455821452}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-13T02:31:14.431852+0000","modified":"2026-02-13T02:31:19.473944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4387},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4387":{"gid":4387,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"10.20.193.178:6835/2386750552","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6834","nonce":2386750552},{"type":"v1","addr":"10.20.193.178:6835","nonce":2386750552}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4387,"qdb_cluster":[4387]},"id":1}]} 2026-02-13T02:31:21.073 INFO:teuthology.orchestra.run.trial121.stderr:dumped fsmap epoch 7 2026-02-13T02:31:21.073 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.063+0000 7f772abed640 1 -- 10.20.193.121:0/1757830510 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f76f4074140 msgr2=0x7f76f40945f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:21.073 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.063+0000 7f772abed640 1 --2- 10.20.193.121:0/1757830510 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f76f4074140 0x7f76f40945f0 secure :-1 s=READY pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f770c0098e0 tx=0x7f770c0b0040 comp rx=0 tx=0).stop 2026-02-13T02:31:21.073 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.063+0000 7f772abed640 1 -- 10.20.193.121:0/1757830510 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f7724056140 msgr2=0x7f77241317a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:21.073 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.063+0000 7f772abed640 1 --2- 10.20.193.121:0/1757830510 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f7724056140 0x7f77241317a0 secure :-1 s=READY pgs=150 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f771400d980 tx=0x7f771400de40 comp rx=0 tx=0).stop 2026-02-13T02:31:21.073 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.063+0000 7f772abed640 1 -- 10.20.193.121:0/1757830510 shutdown_connections 2026-02-13T02:31:21.073 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.063+0000 7f772abed640 1 --2- 10.20.193.121:0/1757830510 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f76f4074140 0x7f76f40945f0 unknown :-1 s=CLOSED pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.073 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.063+0000 7f772abed640 1 --2- 10.20.193.121:0/1757830510 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f7724168870 0x7f772414b5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.073 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.063+0000 7f772abed640 1 --2- 10.20.193.121:0/1757830510 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f77241684a0 0x7f77240b6d60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.073 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.063+0000 7f772abed640 1 --2- 10.20.193.121:0/1757830510 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f7724056140 0x7f77241317a0 unknown :-1 s=CLOSED pgs=150 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.074 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.063+0000 7f772abed640 1 -- 10.20.193.121:0/1757830510 >> 10.20.193.121:0/1757830510 conn(0x7f77240a16e0 msgr2=0x7f77240a2280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:21.074 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.063+0000 7f772abed640 1 -- 10.20.193.121:0/1757830510 shutdown_connections 2026-02-13T02:31:21.074 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.063+0000 7f772abed640 1 -- 10.20.193.121:0/1757830510 wait complete. 2026-02-13T02:31:21.082 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-13T02:31:21.149 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8ff1c8640 1 -- 10.20.193.121:0/1687131965 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fb8f81684a0 msgr2=0x7fb8f8058080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:21.149 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8ff1c8640 1 --2- 10.20.193.121:0/1687131965 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fb8f81684a0 0x7fb8f8058080 secure :-1 s=READY pgs=29 gs=3 cs=0 l=1 c_cookie=18309614495964905004 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8f80b2ca0 tx=0x7fb8e801c860 comp rx=0 tx=0).stop 2026-02-13T02:31:21.149 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8ff1c8640 1 -- 10.20.193.121:0/1687131965 shutdown_connections 2026-02-13T02:31:21.149 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8ff1c8640 1 --2- 10.20.193.121:0/1687131965 >> v2:10.20.193.178:3300/0 conn(0x7fb8f8168870 0x7fb8f8168ca0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.149 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8ff1c8640 1 --2- 10.20.193.121:0/1687131965 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fb8f81684a0 0x7fb8f8058080 unknown :-1 s=CLOSED pgs=29 gs=3 cs=0 l=1 c_cookie=18309614495964905004 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.149 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8ff1c8640 1 -- 10.20.193.121:0/1687131965 >> 10.20.193.121:0/1687131965 conn(0x7fb8f80a16e0 msgr2=0x7fb8f80bbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:21.149 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8ff1c8640 1 -- 10.20.193.121:0/1687131965 shutdown_connections 2026-02-13T02:31:21.150 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8ff1c8640 1 -- 10.20.193.121:0/1687131965 wait complete. 2026-02-13T02:31:21.152 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8ff1c8640 1 Processor -- start 2026-02-13T02:31:21.152 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8ff1c8640 1 -- start start 2026-02-13T02:31:21.152 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8ff1c8640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fb8f8056140 0x7fb8f8142ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.153 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8ff1c8640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fb8f81684a0 0x7fb8f816b000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.153 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8ff1c8640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fb8f8168870 0x7fb8f816b540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.153 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8ff1c8640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f80be1d0 con 0x7fb8f81684a0 2026-02-13T02:31:21.153 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8ff1c8640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f80be050 con 0x7fb8f8056140 2026-02-13T02:31:21.153 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8ff1c8640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7fb8f80be350 con 0x7fb8f8168870 2026-02-13T02:31:21.153 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8effff640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fb8f81684a0 0x7fb8f816b000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.153 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8effff640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fb8f81684a0 0x7fb8f816b000 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:33744/0 (socket says 10.20.193.121:33744) 2026-02-13T02:31:21.153 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8effff640 1 -- 10.20.193.121:0/1000153132 learned_addr learned my addr 10.20.193.121:0/1000153132 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:21.153 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8fcf3d640 1 --2- 10.20.193.121:0/1000153132 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fb8f8056140 0x7fb8f8142ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.153 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8fd73e640 1 --2- 10.20.193.121:0/1000153132 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fb8f8168870 0x7fb8f816b540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.153 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8effff640 1 -- 10.20.193.121:0/1000153132 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fb8f8168870 msgr2=0x7fb8f816b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:21.154 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8effff640 1 --2- 10.20.193.121:0/1000153132 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fb8f8168870 0x7fb8f816b540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.154 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8effff640 1 -- 10.20.193.121:0/1000153132 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fb8f8056140 msgr2=0x7fb8f8142ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:21.154 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8effff640 1 --2- 10.20.193.121:0/1000153132 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fb8f8056140 0x7fb8f8142ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.154 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8effff640 1 -- 10.20.193.121:0/1000153132 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f814b500 con 0x7fb8f81684a0 2026-02-13T02:31:21.154 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.139+0000 7fb8effff640 1 --2- 10.20.193.121:0/1000153132 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fb8f81684a0 0x7fb8f816b000 secure :-1 s=READY pgs=152 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8e0005df0 tx=0x7fb8e000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:21.154 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.143+0000 7fb8ed7fa640 1 -- 10.20.193.121:0/1000153132 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8e000cde0 con 0x7fb8f81684a0 2026-02-13T02:31:21.154 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.143+0000 7fb8ed7fa640 1 -- 10.20.193.121:0/1000153132 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8e0004030 con 0x7fb8f81684a0 2026-02-13T02:31:21.154 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.143+0000 7fb8ff1c8640 1 -- 10.20.193.121:0/1000153132 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8f8133340 con 0x7fb8f81684a0 2026-02-13T02:31:21.154 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.143+0000 7fb8ed7fa640 1 -- 10.20.193.121:0/1000153132 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8e0004480 con 0x7fb8f81684a0 2026-02-13T02:31:21.154 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.143+0000 7fb8ff1c8640 1 -- 10.20.193.121:0/1000153132 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8f8133900 con 0x7fb8f81684a0 2026-02-13T02:31:21.154 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.143+0000 7fb8ff1c8640 1 -- 10.20.193.121:0/1000153132 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8f8133130 con 0x7fb8f81684a0 2026-02-13T02:31:21.154 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.143+0000 7fb8ed7fa640 1 -- 10.20.193.121:0/1000153132 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 5) ==== 100086+0+0 (secure 0 0 0) 0x7fb8e0003710 con 0x7fb8f81684a0 2026-02-13T02:31:21.155 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.143+0000 7fb8ed7fa640 1 --2- 10.20.193.121:0/1000153132 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fb8c8074140 0x7fb8c80945f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.156 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.143+0000 7fb8fcf3d640 1 --2- 10.20.193.121:0/1000153132 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fb8c8074140 0x7fb8c80945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.156 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.143+0000 7fb8ed7fa640 1 -- 10.20.193.121:0/1000153132 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6479+0+0 (secure 0 0 0) 0x7fb8e0096b80 con 0x7fb8f81684a0 2026-02-13T02:31:21.156 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.143+0000 7fb8fcf3d640 1 --2- 10.20.193.121:0/1000153132 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fb8c8074140 0x7fb8c80945f0 secure :-1 s=READY pgs=59 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8e801af10 tx=0x7fb8e801b0a0 comp rx=0 tx=0).ready entity=mgr.4155 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:21.156 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.143+0000 7fb8ed7fa640 1 -- 10.20.193.121:0/1000153132 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (secure 0 0 0) 0x7fb8e0060a40 con 0x7fb8f81684a0 2026-02-13T02:31:21.244 INFO:tasks.ceph.mds.d.trial178.stderr:2026-02-13T02:31:21.238+0000 7f80741bb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2026-02-13T02:31:21.244 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.235+0000 7fb8ff1c8640 1 -- 10.20.193.121:0/1000153132 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb8f814c7d0 con 0x7fb8f81684a0 2026-02-13T02:31:21.245 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.235+0000 7fb8ed7fa640 1 -- 10.20.193.121:0/1000153132 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18520 (secure 0 0 0) 0x7fb8e0066370 con 0x7fb8f81684a0 2026-02-13T02:31:21.246 INFO:teuthology.orchestra.run.trial121.stdout: 2026-02-13T02:31:21.246 INFO:teuthology.orchestra.run.trial121.stdout:{"epoch":24,"fsid":"58020caa-1bc7-4445-b2fc-3f075ab46105","created":"2026-02-13T02:30:58.802931+0000","modified":"2026-02-13T02:31:19.473810+0000","last_up_change":"2026-02-13T02:31:06.046386+0000","last_in_change":"2026-02-13T02:31:02.036447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T02:31:06.353015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T02:31:12.964909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T02:31:13.422523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-13T02:31:17.275198+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1bbcd75b-e678-4cb7-b625-1475960a9cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6818","nonce":4064034701},{"type":"v1","addr":"10.20.193.121:6819","nonce":4064034701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6820","nonce":4064034701},{"type":"v1","addr":"10.20.193.121:6821","nonce":4064034701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6824","nonce":4064034701},{"type":"v1","addr":"10.20.193.121:6825","nonce":4064034701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6822","nonce":4064034701},{"type":"v1","addr":"10.20.193.121:6823","nonce":4064034701}]},"public_addr":"10.20.193.121:6819/4064034701","cluster_addr":"10.20.193.121:6821/4064034701","heartbeat_back_addr":"10.20.193.121:6825/4064034701","heartbeat_front_addr":"10.20.193.121:6823/4064034701","state":["exists","up"]},{"osd":1,"uuid":"8e4f3373-8bf0-4119-9e36-38ae77f57ad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6802","nonce":3452928042},{"type":"v1","addr":"10.20.193.121:6803","nonce":3452928042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6805","nonce":3452928042},{"type":"v1","addr":"10.20.193.121:6806","nonce":3452928042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6811","nonce":3452928042},{"type":"v1","addr":"10.20.193.121:6813","nonce":3452928042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6808","nonce":3452928042},{"type":"v1","addr":"10.20.193.121:6810","nonce":3452928042}]},"public_addr":"10.20.193.121:6803/3452928042","cluster_addr":"10.20.193.121:6806/3452928042","heartbeat_back_addr":"10.20.193.121:6813/3452928042","heartbeat_front_addr":"10.20.193.121:6810/3452928042","state":["exists","up"]},{"osd":2,"uuid":"f88cfbd7-657c-42c3-848e-d41286534244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6804","nonce":1907018650},{"type":"v1","addr":"10.20.193.121:6807","nonce":1907018650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6809","nonce":1907018650},{"type":"v1","addr":"10.20.193.121:6812","nonce":1907018650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6816","nonce":1907018650},{"type":"v1","addr":"10.20.193.121:6817","nonce":1907018650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6814","nonce":1907018650},{"type":"v1","addr":"10.20.193.121:6815","nonce":1907018650}]},"public_addr":"10.20.193.121:6807/1907018650","cluster_addr":"10.20.193.121:6812/1907018650","heartbeat_back_addr":"10.20.193.121:6817/1907018650","heartbeat_front_addr":"10.20.193.121:6815/1907018650","state":["exists","up"]},{"osd":3,"uuid":"e4972ad7-8b35-4f37-99b5-37c7eebb40c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6826","nonce":4123684708},{"type":"v1","addr":"10.20.193.121:6827","nonce":4123684708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6828","nonce":4123684708},{"type":"v1","addr":"10.20.193.121:6829","nonce":4123684708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6832","nonce":4123684708},{"type":"v1","addr":"10.20.193.121:6833","nonce":4123684708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.121:6830","nonce":4123684708},{"type":"v1","addr":"10.20.193.121:6831","nonce":4123684708}]},"public_addr":"10.20.193.121:6827/4123684708","cluster_addr":"10.20.193.121:6829/4123684708","heartbeat_back_addr":"10.20.193.121:6833/4123684708","heartbeat_front_addr":"10.20.193.121:6831/4123684708","state":["exists","up"]},{"osd":4,"uuid":"c12b1fa7-7ebd-4fd3-a785-f8e02e0cf3c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6808","nonce":608607716},{"type":"v1","addr":"10.20.193.178:6809","nonce":608607716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6810","nonce":608607716},{"type":"v1","addr":"10.20.193.178:6811","nonce":608607716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6814","nonce":608607716},{"type":"v1","addr":"10.20.193.178:6815","nonce":608607716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6812","nonce":608607716},{"type":"v1","addr":"10.20.193.178:6813","nonce":608607716}]},"public_addr":"10.20.193.178:6809/608607716","cluster_addr":"10.20.193.178:6811/608607716","heartbeat_back_addr":"10.20.193.178:6815/608607716","heartbeat_front_addr":"10.20.193.178:6813/608607716","state":["exists","up"]},{"osd":5,"uuid":"7c8786af-1011-41b5-ac07-20302bd12503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6824","nonce":3784702419},{"type":"v1","addr":"10.20.193.178:6825","nonce":3784702419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6826","nonce":3784702419},{"type":"v1","addr":"10.20.193.178:6827","nonce":3784702419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6830","nonce":3784702419},{"type":"v1","addr":"10.20.193.178:6831","nonce":3784702419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6828","nonce":3784702419},{"type":"v1","addr":"10.20.193.178:6829","nonce":3784702419}]},"public_addr":"10.20.193.178:6825/3784702419","cluster_addr":"10.20.193.178:6827/3784702419","heartbeat_back_addr":"10.20.193.178:6831/3784702419","heartbeat_front_addr":"10.20.193.178:6829/3784702419","state":["exists","up"]},{"osd":6,"uuid":"4da5620f-6851-4da1-898d-22654932a4d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6800","nonce":3993947833},{"type":"v1","addr":"10.20.193.178:6801","nonce":3993947833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6802","nonce":3993947833},{"type":"v1","addr":"10.20.193.178:6803","nonce":3993947833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6806","nonce":3993947833},{"type":"v1","addr":"10.20.193.178:6807","nonce":3993947833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6804","nonce":3993947833},{"type":"v1","addr":"10.20.193.178:6805","nonce":3993947833}]},"public_addr":"10.20.193.178:6801/3993947833","cluster_addr":"10.20.193.178:6803/3993947833","heartbeat_back_addr":"10.20.193.178:6807/3993947833","heartbeat_front_addr":"10.20.193.178:6805/3993947833","state":["exists","up"]},{"osd":7,"uuid":"91841061-fa38-436d-b719-90cbf2f1830d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6816","nonce":1274696415},{"type":"v1","addr":"10.20.193.178:6817","nonce":1274696415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6818","nonce":1274696415},{"type":"v1","addr":"10.20.193.178:6819","nonce":1274696415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6822","nonce":1274696415},{"type":"v1","addr":"10.20.193.178:6823","nonce":1274696415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.178:6820","nonce":1274696415},{"type":"v1","addr":"10.20.193.178:6821","nonce":1274696415}]},"public_addr":"10.20.193.178:6817/1274696415","cluster_addr":"10.20.193.178:6819/1274696415","heartbeat_back_addr":"10.20.193.178:6823/1274696415","heartbeat_front_addr":"10.20.193.178:6821/1274696415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"2","m":"2","plugin":"isa","technique":"reed_sol_van"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T02:31:21.247 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.235+0000 7fb8ff1c8640 1 -- 10.20.193.121:0/1000153132 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fb8c8074140 msgr2=0x7fb8c80945f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:21.247 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.235+0000 7fb8ff1c8640 1 --2- 10.20.193.121:0/1000153132 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fb8c8074140 0x7fb8c80945f0 secure :-1 s=READY pgs=59 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8e801af10 tx=0x7fb8e801b0a0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.247 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.235+0000 7fb8ff1c8640 1 -- 10.20.193.121:0/1000153132 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fb8f81684a0 msgr2=0x7fb8f816b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:21.247 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.235+0000 7fb8ff1c8640 1 --2- 10.20.193.121:0/1000153132 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fb8f81684a0 0x7fb8f816b000 secure :-1 s=READY pgs=152 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8e0005df0 tx=0x7fb8e000ee50 comp rx=0 tx=0).stop 2026-02-13T02:31:21.247 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.235+0000 7fb8ff1c8640 1 -- 10.20.193.121:0/1000153132 shutdown_connections 2026-02-13T02:31:21.247 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.235+0000 7fb8ff1c8640 1 --2- 10.20.193.121:0/1000153132 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fb8c8074140 0x7fb8c80945f0 unknown :-1 s=CLOSED pgs=59 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.247 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.235+0000 7fb8ff1c8640 1 --2- 10.20.193.121:0/1000153132 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fb8f8168870 0x7fb8f816b540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.247 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.235+0000 7fb8ff1c8640 1 --2- 10.20.193.121:0/1000153132 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fb8f81684a0 0x7fb8f816b000 unknown :-1 s=CLOSED pgs=152 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.248 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.235+0000 7fb8ff1c8640 1 --2- 10.20.193.121:0/1000153132 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fb8f8056140 0x7fb8f8142ad0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.248 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.235+0000 7fb8ff1c8640 1 -- 10.20.193.121:0/1000153132 >> 10.20.193.121:0/1000153132 conn(0x7fb8f80a16e0 msgr2=0x7fb8f8054830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:21.248 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.235+0000 7fb8ff1c8640 1 -- 10.20.193.121:0/1000153132 shutdown_connections 2026-02-13T02:31:21.248 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.235+0000 7fb8ff1c8640 1 -- 10.20.193.121:0/1000153132 wait complete. 2026-02-13T02:31:21.659 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False, 'allow_referent_inodes': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2026-02-13T02:31:14.431852+0000', 'modified': '2026-02-13T02:31:19.473944+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4387}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4387': {'gid': 4387, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '10.20.193.178:6835/2386750552', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.178:6834', 'nonce': 2386750552}, {'type': 'v1', 'addr': '10.20.193.178:6835', 'nonce': 2386750552}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4387, 'qdb_cluster': [4387]} 2026-02-13T02:31:21.660 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2026-02-13T02:31:21.660 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2026-02-13T02:31:21.725 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.715+0000 7fa24acec640 1 -- 10.20.193.121:0/4259302536 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fa244058080 msgr2=0x7fa244056140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:21.725 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.715+0000 7fa24acec640 1 --2- 10.20.193.121:0/4259302536 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fa244058080 0x7fa244056140 secure :-1 s=READY pgs=153 gs=2 cs=0 l=1 c_cookie=674361152480514674 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2440bbd50 tx=0x7fa22c01c980 comp rx=0 tx=0).stop 2026-02-13T02:31:21.725 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.715+0000 7fa24acec640 1 -- 10.20.193.121:0/4259302536 shutdown_connections 2026-02-13T02:31:21.726 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.715+0000 7fa24acec640 1 --2- 10.20.193.121:0/4259302536 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fa244056680 0x7fa24409de20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.726 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.715+0000 7fa24acec640 1 --2- 10.20.193.121:0/4259302536 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fa244058080 0x7fa244056140 unknown :-1 s=CLOSED pgs=153 gs=2 cs=0 l=1 c_cookie=674361152480514674 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.726 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.715+0000 7fa24acec640 1 -- 10.20.193.121:0/4259302536 >> 10.20.193.121:0/4259302536 conn(0x7fa2440a16e0 msgr2=0x7fa2440bbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:21.726 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.715+0000 7fa24acec640 1 -- 10.20.193.121:0/4259302536 shutdown_connections 2026-02-13T02:31:21.726 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.715+0000 7fa24acec640 1 -- 10.20.193.121:0/4259302536 wait complete. 2026-02-13T02:31:21.728 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.715+0000 7fa24acec640 1 Processor -- start 2026-02-13T02:31:21.728 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.715+0000 7fa24acec640 1 -- start start 2026-02-13T02:31:21.728 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.715+0000 7fa24acec640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fa244056680 0x7fa24416b160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.729 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.715+0000 7fa24acec640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fa244058080 0x7fa24414e190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.729 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.715+0000 7fa24acec640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fa2441684a0 0x7fa24414e6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.729 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.715+0000 7fa24acec640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa2440be5b0 con 0x7fa244058080 2026-02-13T02:31:21.729 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.715+0000 7fa24acec640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa2440be430 con 0x7fa244056680 2026-02-13T02:31:21.729 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.715+0000 7fa24acec640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7fa2440be730 con 0x7fa2441684a0 2026-02-13T02:31:21.729 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.715+0000 7fa23bfff640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fa244058080 0x7fa24414e190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.729 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.719+0000 7fa23bfff640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fa244058080 0x7fa24414e190 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:33768/0 (socket says 10.20.193.121:33768) 2026-02-13T02:31:21.729 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.719+0000 7fa23bfff640 1 -- 10.20.193.121:0/3808747245 learned_addr learned my addr 10.20.193.121:0/3808747245 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:21.729 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.719+0000 7fa249262640 1 --2- 10.20.193.121:0/3808747245 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fa2441684a0 0x7fa24414e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.729 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.719+0000 7fa23bfff640 1 -- 10.20.193.121:0/3808747245 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fa2441684a0 msgr2=0x7fa24414e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:21.729 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.719+0000 7fa23bfff640 1 --2- 10.20.193.121:0/3808747245 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fa2441684a0 0x7fa24414e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.729 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.719+0000 7fa23bfff640 1 -- 10.20.193.121:0/3808747245 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fa244056680 msgr2=0x7fa24416b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:21.730 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.719+0000 7fa23bfff640 1 --2- 10.20.193.121:0/3808747245 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fa244056680 0x7fa24416b160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.730 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.719+0000 7fa23bfff640 1 -- 10.20.193.121:0/3808747245 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2440a5050 con 0x7fa244058080 2026-02-13T02:31:21.730 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.719+0000 7fa23bfff640 1 --2- 10.20.193.121:0/3808747245 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fa244058080 0x7fa24414e190 secure :-1 s=READY pgs=154 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa22c01cef0 tx=0x7fa22c0a5830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:21.730 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.719+0000 7fa2397fa640 1 -- 10.20.193.121:0/3808747245 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa22c0a5c40 con 0x7fa244058080 2026-02-13T02:31:21.730 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.719+0000 7fa2397fa640 1 -- 10.20.193.121:0/3808747245 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa22c0a5de0 con 0x7fa244058080 2026-02-13T02:31:21.730 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.719+0000 7fa2397fa640 1 -- 10.20.193.121:0/3808747245 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa22c002940 con 0x7fa244058080 2026-02-13T02:31:21.730 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.719+0000 7fa24acec640 1 -- 10.20.193.121:0/3808747245 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa24416bc20 con 0x7fa244058080 2026-02-13T02:31:21.730 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.719+0000 7fa24acec640 1 -- 10.20.193.121:0/3808747245 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa244133e20 con 0x7fa244058080 2026-02-13T02:31:21.730 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.719+0000 7fa2397fa640 1 -- 10.20.193.121:0/3808747245 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 5) ==== 100086+0+0 (secure 0 0 0) 0x7fa22c002ae0 con 0x7fa244058080 2026-02-13T02:31:21.731 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.719+0000 7fa2397fa640 1 --2- 10.20.193.121:0/3808747245 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fa214074140 0x7fa2140945f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.731 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.719+0000 7fa2397fa640 1 -- 10.20.193.121:0/3808747245 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6479+0+0 (secure 0 0 0) 0x7fa22c0b4030 con 0x7fa244058080 2026-02-13T02:31:21.731 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.719+0000 7fa248a61640 1 --2- 10.20.193.121:0/3808747245 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fa214074140 0x7fa2140945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.732 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.719+0000 7fa248a61640 1 --2- 10.20.193.121:0/3808747245 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fa214074140 0x7fa2140945f0 secure :-1 s=READY pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2340037b0 tx=0x7fa234007ab0 comp rx=0 tx=0).ready entity=mgr.4155 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:21.732 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa24db5a000 1 Processor -- start 2026-02-13T02:31:21.732 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa24db5a000 1 -- start start 2026-02-13T02:31:21.734 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa24db5a000 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf152e4930 0x55cf152e4d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.734 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa24db5a000 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x55cf15327ba0 0x55cf1534e6a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.734 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa24db5a000 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x55cf1534ebe0 0x55cf1534efb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.734 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa24db5a000 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x55cf15102710 con 0x55cf152e4930 2026-02-13T02:31:21.734 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa24db5a000 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x55cf150ade00 con 0x55cf1534ebe0 2026-02-13T02:31:21.734 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa24db5a000 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x55cf150fdd70 con 0x55cf15327ba0 2026-02-13T02:31:21.734 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa248a61640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf152e4930 0x55cf152e4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.735 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa248a61640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf152e4930 0x55cf152e4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:33776/0 (socket says 10.20.193.121:33776) 2026-02-13T02:31:21.735 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa248a61640 1 -- 10.20.193.121:0/707744210 learned_addr learned my addr 10.20.193.121:0/707744210 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:21.735 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa23bfff640 1 --2- 10.20.193.121:0/707744210 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x55cf15327ba0 0x55cf1534e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.735 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa249262640 1 --2- 10.20.193.121:0/707744210 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x55cf1534ebe0 0x55cf1534efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.735 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa248a61640 1 -- 10.20.193.121:0/707744210 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x55cf15327ba0 msgr2=0x55cf1534e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T02:31:21.735 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa248a61640 1 --2- 10.20.193.121:0/707744210 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x55cf15327ba0 0x55cf1534e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.735 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa248a61640 1 -- 10.20.193.121:0/707744210 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x55cf1534ebe0 msgr2=0x55cf1534efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T02:31:21.735 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa248a61640 1 --2- 10.20.193.121:0/707744210 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x55cf1534ebe0 0x55cf1534efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.735 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa248a61640 1 -- 10.20.193.121:0/707744210 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf150ab3d0 con 0x55cf152e4930 2026-02-13T02:31:21.735 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa23bfff640 1 --2- 10.20.193.121:0/707744210 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x55cf15327ba0 0x55cf1534e6a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:31:21.735 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa248a61640 1 --2- 10.20.193.121:0/707744210 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf152e4930 0x55cf152e4d00 secure :-1 s=READY pgs=155 gs=1 cs=0 l=1 c_cookie=5161821382215807020 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa234003c30 tx=0x7fa23400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a27932d8fd302c server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:21.735 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa210bde640 1 -- 10.20.193.121:0/707744210 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa234024070 con 0x55cf152e4930 2026-02-13T02:31:21.736 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa210bde640 1 -- 10.20.193.121:0/707744210 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa23400cb40 con 0x55cf152e4930 2026-02-13T02:31:21.736 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa210bde640 1 -- 10.20.193.121:0/707744210 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa234016e60 con 0x55cf152e4930 2026-02-13T02:31:21.736 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa24db5a000 1 -- 10.20.193.121:0/707744210 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf152e4930 msgr2=0x55cf152e4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:21.736 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa24db5a000 1 --2- 10.20.193.121:0/707744210 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf152e4930 0x55cf152e4d00 secure :-1 s=READY pgs=155 gs=1 cs=0 l=1 c_cookie=5161821382215807020 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa234003c30 tx=0x7fa23400f000 comp rx=0 tx=0).stop 2026-02-13T02:31:21.736 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa24db5a000 1 -- 10.20.193.121:0/707744210 shutdown_connections 2026-02-13T02:31:21.736 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa24db5a000 1 --2- 10.20.193.121:0/707744210 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x55cf1534ebe0 0x55cf1534efb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.736 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa24db5a000 1 --2- 10.20.193.121:0/707744210 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x55cf15327ba0 0x55cf1534e6a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.736 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa24db5a000 1 --2- 10.20.193.121:0/707744210 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf152e4930 0x55cf152e4d00 unknown :-1 s=CLOSED pgs=155 gs=1 cs=0 l=1 c_cookie=5161821382215807020 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.736 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa24db5a000 1 -- 10.20.193.121:0/707744210 >> 10.20.193.121:0/707744210 conn(0x55cf152e5510 msgr2=0x55cf15328170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:21.736 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa24db5a000 1 -- 10.20.193.121:0/707744210 shutdown_connections 2026-02-13T02:31:21.736 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.723+0000 7fa24db5a000 1 -- 10.20.193.121:0/707744210 wait complete. 2026-02-13T02:31:21.741 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa24db5a000 1 -- start start 2026-02-13T02:31:21.741 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa24db5a000 1 Processor -- start 2026-02-13T02:31:21.745 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa24db5a000 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x55cf152e4930 0x55cf153063b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.745 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa24db5a000 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf15327ba0 0x55cf15319b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.745 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa24db5a000 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x55cf1534ebe0 0x55cf1531a0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.745 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa24db5a000 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x55cf1530d530 con 0x55cf15327ba0 2026-02-13T02:31:21.745 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa24db5a000 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x55cf153254b0 con 0x55cf152e4930 2026-02-13T02:31:21.745 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa24db5a000 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x55cf15325750 con 0x55cf1534ebe0 2026-02-13T02:31:21.746 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa23bfff640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf15327ba0 0x55cf15319b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.746 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa23bfff640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf15327ba0 0x55cf15319b80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:33790/0 (socket says 10.20.193.121:33790) 2026-02-13T02:31:21.746 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa23bfff640 1 -- 10.20.193.121:0/2208195931 learned_addr learned my addr 10.20.193.121:0/2208195931 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:21.746 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa248a61640 1 --2- 10.20.193.121:0/2208195931 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x55cf152e4930 0x55cf153063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.746 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa249262640 1 --2- 10.20.193.121:0/2208195931 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x55cf1534ebe0 0x55cf1531a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.746 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa23bfff640 1 -- 10.20.193.121:0/2208195931 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x55cf1534ebe0 msgr2=0x55cf1531a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T02:31:21.746 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa23bfff640 1 --2- 10.20.193.121:0/2208195931 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x55cf1534ebe0 0x55cf1531a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.746 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa23bfff640 1 -- 10.20.193.121:0/2208195931 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x55cf152e4930 msgr2=0x55cf153063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T02:31:21.746 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa23bfff640 1 --2- 10.20.193.121:0/2208195931 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x55cf152e4930 0x55cf153063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.746 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa23bfff640 1 -- 10.20.193.121:0/2208195931 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf152e44e0 con 0x55cf15327ba0 2026-02-13T02:31:21.746 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa248a61640 1 --2- 10.20.193.121:0/2208195931 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x55cf152e4930 0x55cf153063b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:31:21.746 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa23bfff640 1 --2- 10.20.193.121:0/2208195931 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf15327ba0 0x55cf15319b80 secure :-1 s=READY pgs=156 gs=1 cs=0 l=1 c_cookie=11584244248033785957 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa22c0f9a10 tx=0x7fa22c0f9500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c380c4836a7865 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:21.747 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa201ffb640 10 client.0 ms_handle_connect on v2:10.20.193.121:3300/0 2026-02-13T02:31:21.747 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa201ffb640 1 -- 10.20.193.121:0/2208195931 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa22c116070 con 0x55cf15327ba0 2026-02-13T02:31:21.747 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa201ffb640 1 -- 10.20.193.121:0/2208195931 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa22c0a9070 con 0x55cf15327ba0 2026-02-13T02:31:21.747 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa24db5a000 1 -- 10.20.193.121:0/2208195931 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf14f65c20 con 0x55cf15327ba0 2026-02-13T02:31:21.747 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa201ffb640 1 -- 10.20.193.121:0/2208195931 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa22c0fa920 con 0x55cf15327ba0 2026-02-13T02:31:21.747 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa24db5a000 10 client.4467 _ll_register_callbacks cb 0x55cf15088290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-13T02:31:21.747 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa24db5a000 1 -- 10.20.193.121:0/2208195931 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cf151212a0 con 0x55cf15327ba0 2026-02-13T02:31:21.747 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa201ffb640 1 -- 10.20.193.121:0/2208195931 <== mon.0 v2:10.20.193.121:3300/0 4 ==== osd_map(24..24 src has 1..24) ==== 6479+0+0 (secure 0 0 0) 0x7fa22c002e00 con 0x55cf15327ba0 2026-02-13T02:31:21.747 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa201ffb640 1 -- 10.20.193.121:0/2208195931 <== mon.0 v2:10.20.193.121:3300/0 5 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fa22c109050 con 0x55cf15327ba0 2026-02-13T02:31:21.747 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa24db5a000 10 client.4467 fetch_fsmap learned FSMap version 7 2026-02-13T02:31:21.747 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa24db5a000 1 -- 10.20.193.121:0/2208195931 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({fsmap=7}) -- 0x55cf150ad450 con 0x55cf15327ba0 2026-02-13T02:31:21.747 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa201ffb640 1 -- 10.20.193.121:0/2208195931 <== mon.0 v2:10.20.193.121:3300/0 6 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7fa22c1046e0 con 0x55cf15327ba0 2026-02-13T02:31:21.748 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa24db5a000 10 client.4467 fetch_fsmap finished waiting for FSMap version 7 2026-02-13T02:31:21.748 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa24db5a000 10 client.4467 resolve_mds: resolved name 'd' to daemon mds.d 2026-02-13T02:31:21.748 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa24db5a000 20 client.4467 populate_metadata read hostname 'trial121' 2026-02-13T02:31:21.748 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa24db5a000 1 --2- 10.20.193.121:0/2208195931 >> [v2:10.20.193.178:6834/2386750552,v1:10.20.193.178:6835/2386750552] conn(0x55cf15318dd0 0x55cf153e92f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.748 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa24db5a000 4 client.4467 mds_command: new command op to 4387 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-13T02:31:21.748 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa24db5a000 1 -- 10.20.193.121:0/2208195931 --> [v2:10.20.193.178:6834/2386750552,v1:10.20.193.178:6835/2386750552] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf151118e0 con 0x55cf15318dd0 2026-02-13T02:31:21.748 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.731+0000 7fa248a61640 1 --2- 10.20.193.121:0/2208195931 >> [v2:10.20.193.178:6834/2386750552,v1:10.20.193.178:6835/2386750552] conn(0x55cf15318dd0 0x55cf153e92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.748 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.735+0000 7fa248a61640 1 --2- 10.20.193.121:0/2208195931 >> [v2:10.20.193.178:6834/2386750552,v1:10.20.193.178:6835/2386750552] conn(0x55cf15318dd0 0x55cf153e92f0 crc :-1 s=READY pgs=12 gs=4 cs=0 l=0 c_cookie=12452498496221539972 s_cookie=6234765928889082823 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acd02967f95eee84 server_cookie=56865694412463c7 in_seq=0 out_seq=0 2026-02-13T02:31:21.748 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.735+0000 7fa201ffb640 10 client.4467 ms_handle_connect on v2:10.20.193.178:6834/2386750552 2026-02-13T02:31:21.748 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.735+0000 7fa201ffb640 1 -- 10.20.193.121:0/2208195931 <== mds.0 v2:10.20.193.178:6834/2386750552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55cf151118e0 con 0x55cf15318dd0 2026-02-13T02:31:21.748 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.735+0000 7fa201ffb640 10 client.4467 handle_command_reply: tid=0 2026-02-13T02:31:21.748 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.735+0000 7fa24db5a000 1 client.4467 shutdown 2026-02-13T02:31:21.749 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.735+0000 7fa24db5a000 1 -- 10.20.193.121:0/2208195931 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf15327ba0 msgr2=0x55cf15319b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:21.749 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.735+0000 7fa24db5a000 1 --2- 10.20.193.121:0/2208195931 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf15327ba0 0x55cf15319b80 secure :-1 s=READY pgs=156 gs=1 cs=0 l=1 c_cookie=11584244248033785957 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa22c0f9a10 tx=0x7fa22c0f9500 comp rx=0 tx=0).stop 2026-02-13T02:31:21.749 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.735+0000 7fa24db5a000 1 -- 10.20.193.121:0/2208195931 shutdown_connections 2026-02-13T02:31:21.749 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.735+0000 7fa24db5a000 1 --2- 10.20.193.121:0/2208195931 >> [v2:10.20.193.178:6834/2386750552,v1:10.20.193.178:6835/2386750552] conn(0x55cf15318dd0 0x55cf153e92f0 crc :-1 s=READY pgs=12 gs=4 cs=0 l=0 c_cookie=12452498496221539972 s_cookie=6234765928889082823 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.749 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.735+0000 7fa24db5a000 1 --2- 10.20.193.121:0/2208195931 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x55cf1534ebe0 0x55cf1531a0c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.749 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.735+0000 7fa201ffb640 0 client.4467 ms_handle_reset on v2:10.20.193.178:6834/2386750552 2026-02-13T02:31:21.749 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.735+0000 7fa24db5a000 1 --2- 10.20.193.121:0/2208195931 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf15327ba0 0x55cf15319b80 unknown :-1 s=CLOSED pgs=156 gs=1 cs=0 l=1 c_cookie=11584244248033785957 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.749 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.735+0000 7fa24db5a000 1 --2- 10.20.193.121:0/2208195931 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x55cf152e4930 0x55cf153063b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.749 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.735+0000 7fa24db5a000 1 -- 10.20.193.121:0/2208195931 >> 10.20.193.121:0/2208195931 conn(0x55cf152e5510 msgr2=0x55cf15327f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:21.749 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.735+0000 7fa24db5a000 1 -- 10.20.193.121:0/2208195931 shutdown_connections 2026-02-13T02:31:21.749 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.735+0000 7fa24db5a000 1 -- 10.20.193.121:0/2208195931 wait complete. 2026-02-13T02:31:21.749 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.735+0000 7fa24db5a000 20 client.4467 trim_cache size 0 max 16384 2026-02-13T02:31:21.753 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa24db5a000 1 Processor -- start 2026-02-13T02:31:21.753 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa24db5a000 1 -- start start 2026-02-13T02:31:21.758 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa24db5a000 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x55cf152e5510 0x55cf15319d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.758 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa24db5a000 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf152e4930 0x55cf1531a2a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.758 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa24db5a000 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x55cf15318dd0 0x55cf1530c950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.758 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa24db5a000 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e400cbd0 con 0x55cf152e4930 2026-02-13T02:31:21.758 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa24db5a000 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e400beb0 con 0x55cf15318dd0 2026-02-13T02:31:21.758 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa24db5a000 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e400c500 con 0x55cf152e5510 2026-02-13T02:31:21.758 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa23bfff640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf152e4930 0x55cf1531a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.758 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa23bfff640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf152e4930 0x55cf1531a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:33794/0 (socket says 10.20.193.121:33794) 2026-02-13T02:31:21.758 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa23bfff640 1 -- 10.20.193.121:0/814721855 learned_addr learned my addr 10.20.193.121:0/814721855 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:21.759 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa248a61640 1 --2- 10.20.193.121:0/814721855 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x55cf152e5510 0x55cf15319d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.759 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa249262640 1 --2- 10.20.193.121:0/814721855 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x55cf15318dd0 0x55cf1530c950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.759 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa23bfff640 1 -- 10.20.193.121:0/814721855 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x55cf152e5510 msgr2=0x55cf15319d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T02:31:21.759 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa23bfff640 1 --2- 10.20.193.121:0/814721855 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x55cf152e5510 0x55cf15319d60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.759 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa23bfff640 1 -- 10.20.193.121:0/814721855 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x55cf15318dd0 msgr2=0x55cf1530c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T02:31:21.759 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa23bfff640 1 --2- 10.20.193.121:0/814721855 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x55cf15318dd0 0x55cf1530c950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.759 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa23bfff640 1 -- 10.20.193.121:0/814721855 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf152e4310 con 0x55cf152e4930 2026-02-13T02:31:21.759 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa249262640 1 --2- 10.20.193.121:0/814721855 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x55cf15318dd0 0x55cf1530c950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:31:21.759 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa23bfff640 1 --2- 10.20.193.121:0/814721855 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf152e4930 0x55cf1531a2a0 secure :-1 s=READY pgs=157 gs=1 cs=0 l=1 c_cookie=12271668781063218051 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa22c01d220 tx=0x7fa22c119000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4db9bd00862383 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:21.759 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa203fff640 1 -- 10.20.193.121:0/814721855 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa22c116040 con 0x55cf152e4930 2026-02-13T02:31:21.760 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa203fff640 1 -- 10.20.193.121:0/814721855 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa22c0a9070 con 0x55cf152e4930 2026-02-13T02:31:21.760 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa203fff640 1 -- 10.20.193.121:0/814721855 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa22c0ff750 con 0x55cf152e4930 2026-02-13T02:31:21.760 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa24db5a000 1 -- 10.20.193.121:0/814721855 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf152e4930 msgr2=0x55cf1531a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:21.760 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa24db5a000 1 --2- 10.20.193.121:0/814721855 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf152e4930 0x55cf1531a2a0 secure :-1 s=READY pgs=157 gs=1 cs=0 l=1 c_cookie=12271668781063218051 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa22c01d220 tx=0x7fa22c119000 comp rx=0 tx=0).stop 2026-02-13T02:31:21.760 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa24db5a000 1 -- 10.20.193.121:0/814721855 shutdown_connections 2026-02-13T02:31:21.760 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa24db5a000 1 --2- 10.20.193.121:0/814721855 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x55cf15318dd0 0x55cf1530c950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.760 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa24db5a000 1 --2- 10.20.193.121:0/814721855 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf152e4930 0x55cf1531a2a0 unknown :-1 s=CLOSED pgs=157 gs=1 cs=0 l=1 c_cookie=12271668781063218051 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.760 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa24db5a000 1 --2- 10.20.193.121:0/814721855 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x55cf152e5510 0x55cf15319d60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.760 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa24db5a000 1 -- 10.20.193.121:0/814721855 >> 10.20.193.121:0/814721855 conn(0x55cf1531b3f0 msgr2=0x55cf15327f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:21.760 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa24db5a000 1 -- 10.20.193.121:0/814721855 shutdown_connections 2026-02-13T02:31:21.760 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.743+0000 7fa24db5a000 1 -- 10.20.193.121:0/814721855 wait complete. 2026-02-13T02:31:21.761 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa24db5a000 1 -- start start 2026-02-13T02:31:21.761 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa24db5a000 1 Processor -- start 2026-02-13T02:31:21.761 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa24db5a000 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x55cf152e4930 0x55cf1530d590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.761 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa24db5a000 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x55cf152e5510 0x55cf1534a450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.761 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa24db5a000 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf15318dd0 0x55cf1534a990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.761 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa24db5a000 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x55cf150b0590 con 0x55cf15318dd0 2026-02-13T02:31:21.761 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa24db5a000 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x55cf15318c50 con 0x55cf152e5510 2026-02-13T02:31:21.761 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa24db5a000 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x55cf153192a0 con 0x55cf152e4930 2026-02-13T02:31:21.761 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa249262640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf15318dd0 0x55cf1534a990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.761 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa249262640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf15318dd0 0x55cf1534a990 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:33800/0 (socket says 10.20.193.121:33800) 2026-02-13T02:31:21.761 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa249262640 1 -- 10.20.193.121:0/2128166661 learned_addr learned my addr 10.20.193.121:0/2128166661 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:21.761 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa23bfff640 1 --2- 10.20.193.121:0/2128166661 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x55cf152e5510 0x55cf1534a450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.762 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa248a61640 1 --2- 10.20.193.121:0/2128166661 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x55cf152e4930 0x55cf1530d590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.762 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa249262640 1 -- 10.20.193.121:0/2128166661 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x55cf152e4930 msgr2=0x55cf1530d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T02:31:21.762 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa249262640 1 --2- 10.20.193.121:0/2128166661 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x55cf152e4930 0x55cf1530d590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.762 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa249262640 1 -- 10.20.193.121:0/2128166661 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x55cf152e5510 msgr2=0x55cf1534a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T02:31:21.762 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa249262640 1 --2- 10.20.193.121:0/2128166661 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x55cf152e5510 0x55cf1534a450 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.762 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa249262640 1 -- 10.20.193.121:0/2128166661 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf15080670 con 0x55cf15318dd0 2026-02-13T02:31:21.762 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa249262640 1 --2- 10.20.193.121:0/2128166661 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf15318dd0 0x55cf1534a990 secure :-1 s=READY pgs=158 gs=1 cs=0 l=1 c_cookie=16442439341638175128 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa24000a190 tx=0x7fa240008f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42f477727404998 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:21.762 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa201ffb640 10 client.0 ms_handle_connect on v2:10.20.193.121:3300/0 2026-02-13T02:31:21.762 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa201ffb640 1 -- 10.20.193.121:0/2128166661 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa24001b020 con 0x55cf15318dd0 2026-02-13T02:31:21.762 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa201ffb640 1 -- 10.20.193.121:0/2128166661 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa240005960 con 0x55cf15318dd0 2026-02-13T02:31:21.762 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa201ffb640 1 -- 10.20.193.121:0/2128166661 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa2400176e0 con 0x55cf15318dd0 2026-02-13T02:31:21.762 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa24db5a000 1 -- 10.20.193.121:0/2128166661 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf150b0320 con 0x55cf15318dd0 2026-02-13T02:31:21.763 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa201ffb640 1 -- 10.20.193.121:0/2128166661 <== mon.0 v2:10.20.193.121:3300/0 4 ==== osd_map(24..24 src has 1..24) ==== 6479+0+0 (secure 0 0 0) 0x7fa240017880 con 0x55cf15318dd0 2026-02-13T02:31:21.763 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa201ffb640 10 client.4473 inactive, discarding osd_map(24..24 src has 1..24) 2026-02-13T02:31:21.763 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa24db5a000 10 client.4473 _ll_register_callbacks cb 0x7fa234016440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-13T02:31:21.763 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa24db5a000 1 -- 10.20.193.121:0/2128166661 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa22c0a9070 con 0x55cf15318dd0 2026-02-13T02:31:21.763 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa201ffb640 1 -- 10.20.193.121:0/2128166661 <== mon.0 v2:10.20.193.121:3300/0 5 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fa240017a80 con 0x55cf15318dd0 2026-02-13T02:31:21.763 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa24db5a000 10 client.4473 fetch_fsmap learned FSMap version 7 2026-02-13T02:31:21.763 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa24db5a000 1 -- 10.20.193.121:0/2128166661 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({fsmap=7}) -- 0x55cf15315890 con 0x55cf15318dd0 2026-02-13T02:31:21.763 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa201ffb640 1 -- 10.20.193.121:0/2128166661 <== mon.0 v2:10.20.193.121:3300/0 6 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7fa240017c20 con 0x55cf15318dd0 2026-02-13T02:31:21.763 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa24db5a000 10 client.4473 fetch_fsmap finished waiting for FSMap version 7 2026-02-13T02:31:21.763 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa24db5a000 10 client.4473 resolve_mds: resolved name 'd' to daemon mds.d 2026-02-13T02:31:21.763 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa24db5a000 20 client.4473 populate_metadata read hostname 'trial121' 2026-02-13T02:31:21.763 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa24db5a000 1 --2- 10.20.193.121:0/2128166661 >> [v2:10.20.193.178:6834/2386750552,v1:10.20.193.178:6835/2386750552] conn(0x55cf15327ba0 0x55cf153a8770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.763 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa24db5a000 4 client.4473 mds_command: new command op to 4387 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-13T02:31:21.764 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa24db5a000 1 -- 10.20.193.121:0/2128166661 --> [v2:10.20.193.178:6834/2386750552,v1:10.20.193.178:6835/2386750552] -- command(tid 0: {"prefix": "status"}) -- 0x55cf1510a5e0 con 0x55cf15327ba0 2026-02-13T02:31:21.764 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa248a61640 1 --2- 10.20.193.121:0/2128166661 >> [v2:10.20.193.178:6834/2386750552,v1:10.20.193.178:6835/2386750552] conn(0x55cf15327ba0 0x55cf153a8770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.764 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa201ffb640 10 client.4473 ms_handle_connect on v2:10.20.193.178:6834/2386750552 2026-02-13T02:31:21.764 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.747+0000 7fa248a61640 1 --2- 10.20.193.121:0/2128166661 >> [v2:10.20.193.178:6834/2386750552,v1:10.20.193.178:6835/2386750552] conn(0x55cf15327ba0 0x55cf153a8770 crc :-1 s=READY pgs=13 gs=4 cs=0 l=0 c_cookie=8579294147631783992 s_cookie=4711635847812297425 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=770fc6927d2e2038 server_cookie=416317d71bd932d1 in_seq=0 out_seq=0 2026-02-13T02:31:21.775 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa201ffb640 1 -- 10.20.193.121:0/2128166661 <== mds.0 v2:10.20.193.178:6834/2386750552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1032 (crc 0 0 0) 0x55cf1510a5e0 con 0x55cf15327ba0 2026-02-13T02:31:21.775 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa201ffb640 10 client.4473 handle_command_reply: tid=0 2026-02-13T02:31:21.775 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa24db5a000 1 client.4473 shutdown 2026-02-13T02:31:21.775 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa24db5a000 1 -- 10.20.193.121:0/2128166661 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf15318dd0 msgr2=0x55cf1534a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:21.775 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa24db5a000 1 --2- 10.20.193.121:0/2128166661 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf15318dd0 0x55cf1534a990 secure :-1 s=READY pgs=158 gs=1 cs=0 l=1 c_cookie=16442439341638175128 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa24000a190 tx=0x7fa240008f80 comp rx=0 tx=0).stop 2026-02-13T02:31:21.775 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa24db5a000 1 -- 10.20.193.121:0/2128166661 shutdown_connections 2026-02-13T02:31:21.775 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa24db5a000 1 --2- 10.20.193.121:0/2128166661 >> [v2:10.20.193.178:6834/2386750552,v1:10.20.193.178:6835/2386750552] conn(0x55cf15327ba0 0x55cf153a8770 crc :-1 s=READY pgs=13 gs=4 cs=0 l=0 c_cookie=8579294147631783992 s_cookie=4711635847812297425 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.775 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa24db5a000 1 --2- 10.20.193.121:0/2128166661 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x55cf15318dd0 0x55cf1534a990 unknown :-1 s=CLOSED pgs=158 gs=1 cs=0 l=1 c_cookie=16442439341638175128 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.775 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa201ffb640 0 client.4473 ms_handle_reset on v2:10.20.193.178:6834/2386750552 2026-02-13T02:31:21.775 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa24db5a000 1 --2- 10.20.193.121:0/2128166661 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x55cf152e5510 0x55cf1534a450 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.776 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa24db5a000 1 --2- 10.20.193.121:0/2128166661 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x55cf152e4930 0x55cf1530d590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.776 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa24db5a000 1 -- 10.20.193.121:0/2128166661 >> 10.20.193.121:0/2128166661 conn(0x55cf1531b3f0 msgr2=0x55cf15327f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:21.776 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa24db5a000 1 -- 10.20.193.121:0/2128166661 shutdown_connections 2026-02-13T02:31:21.776 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa24db5a000 1 -- 10.20.193.121:0/2128166661 wait complete. 2026-02-13T02:31:21.776 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa24db5a000 20 client.4473 trim_cache size 0 max 16384 2026-02-13T02:31:21.776 INFO:teuthology.orchestra.run.trial121.stdout:{ 2026-02-13T02:31:21.776 INFO:teuthology.orchestra.run.trial121.stdout: "cluster_fsid": "58020caa-1bc7-4445-b2fc-3f075ab46105", 2026-02-13T02:31:21.777 INFO:teuthology.orchestra.run.trial121.stdout: "whoami": 0, 2026-02-13T02:31:21.777 INFO:teuthology.orchestra.run.trial121.stdout: "id": 4387, 2026-02-13T02:31:21.777 INFO:teuthology.orchestra.run.trial121.stdout: "want_state": "up:active", 2026-02-13T02:31:21.777 INFO:teuthology.orchestra.run.trial121.stdout: "state": "up:active", 2026-02-13T02:31:21.777 INFO:teuthology.orchestra.run.trial121.stdout: "fs_name": "cephfs", 2026-02-13T02:31:21.777 INFO:teuthology.orchestra.run.trial121.stdout: "rank_uptime": 6.4962710149999996, 2026-02-13T02:31:21.777 INFO:teuthology.orchestra.run.trial121.stdout: "mdsmap_epoch": 7, 2026-02-13T02:31:21.777 INFO:teuthology.orchestra.run.trial121.stdout: "osdmap_epoch": 24, 2026-02-13T02:31:21.777 INFO:teuthology.orchestra.run.trial121.stdout: "osdmap_epoch_barrier": 24, 2026-02-13T02:31:21.777 INFO:teuthology.orchestra.run.trial121.stdout: "uptime": 11.468825789, 2026-02-13T02:31:21.777 INFO:teuthology.orchestra.run.trial121.stdout: "sysinfo": { 2026-02-13T02:31:21.777 INFO:teuthology.orchestra.run.trial121.stdout: "arch": "x86_64", 2026-02-13T02:31:21.778 INFO:teuthology.orchestra.run.trial121.stdout: "ceph_release": "tentacle", 2026-02-13T02:31:21.778 INFO:teuthology.orchestra.run.trial121.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev - None)", 2026-02-13T02:31:21.778 INFO:teuthology.orchestra.run.trial121.stdout: "ceph_version_short": "20.3.0-5241-g8f8d3829", 2026-02-13T02:31:21.778 INFO:teuthology.orchestra.run.trial121.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T02:31:21.778 INFO:teuthology.orchestra.run.trial121.stdout: "distro": "ubuntu", 2026-02-13T02:31:21.778 INFO:teuthology.orchestra.run.trial121.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T02:31:21.778 INFO:teuthology.orchestra.run.trial121.stdout: "distro_version": "22.04", 2026-02-13T02:31:21.778 INFO:teuthology.orchestra.run.trial121.stdout: "hostname": "trial178", 2026-02-13T02:31:21.778 INFO:teuthology.orchestra.run.trial121.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T02:31:21.778 INFO:teuthology.orchestra.run.trial121.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T02:31:21.778 INFO:teuthology.orchestra.run.trial121.stdout: "mem_swap_kb": "8388604", 2026-02-13T02:31:21.779 INFO:teuthology.orchestra.run.trial121.stdout: "mem_total_kb": "130961700", 2026-02-13T02:31:21.779 INFO:teuthology.orchestra.run.trial121.stdout: "os": "Linux" 2026-02-13T02:31:21.779 INFO:teuthology.orchestra.run.trial121.stdout: }, 2026-02-13T02:31:21.779 INFO:teuthology.orchestra.run.trial121.stdout: "endian": "little" 2026-02-13T02:31:21.779 INFO:teuthology.orchestra.run.trial121.stdout:} 2026-02-13T02:31:21.780 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa24acec640 1 -- 10.20.193.121:0/3808747245 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fa214074140 msgr2=0x7fa2140945f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:21.780 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa24acec640 1 --2- 10.20.193.121:0/3808747245 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fa214074140 0x7fa2140945f0 secure :-1 s=READY pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2340037b0 tx=0x7fa234007ab0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.780 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa24acec640 1 -- 10.20.193.121:0/3808747245 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fa244058080 msgr2=0x7fa24414e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:21.780 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa24acec640 1 --2- 10.20.193.121:0/3808747245 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fa244058080 0x7fa24414e190 secure :-1 s=READY pgs=154 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa22c01cef0 tx=0x7fa22c0a5830 comp rx=0 tx=0).stop 2026-02-13T02:31:21.780 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa24acec640 1 -- 10.20.193.121:0/3808747245 shutdown_connections 2026-02-13T02:31:21.780 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa24acec640 1 --2- 10.20.193.121:0/3808747245 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7fa214074140 0x7fa2140945f0 unknown :-1 s=CLOSED pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.780 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa24acec640 1 --2- 10.20.193.121:0/3808747245 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7fa2441684a0 0x7fa24414e6d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.780 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa24acec640 1 --2- 10.20.193.121:0/3808747245 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7fa244058080 0x7fa24414e190 unknown :-1 s=CLOSED pgs=154 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.780 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa24acec640 1 --2- 10.20.193.121:0/3808747245 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7fa244056680 0x7fa24416b160 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.781 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.763+0000 7fa24acec640 1 -- 10.20.193.121:0/3808747245 >> 10.20.193.121:0/3808747245 conn(0x7fa2440a16e0 msgr2=0x7fa2440a4940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:21.781 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.767+0000 7fa24acec640 1 -- 10.20.193.121:0/3808747245 shutdown_connections 2026-02-13T02:31:21.781 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.767+0000 7fa24acec640 1 -- 10.20.193.121:0/3808747245 wait complete. 2026-02-13T02:31:21.787 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2026-02-13T02:31:21.787 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2026-02-13T02:31:21.787 DEBUG:teuthology.orchestra.run.trial121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2026-02-13T02:31:21.858 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.847+0000 7f87194cf640 1 -- 10.20.193.121:0/443496697 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f87141684a0 msgr2=0x7f8714058080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:21.858 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.847+0000 7f87194cf640 1 --2- 10.20.193.121:0/443496697 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f87141684a0 0x7f8714058080 secure :-1 s=READY pgs=160 gs=2 cs=0 l=1 c_cookie=5387171169788062055 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87140b6390 tx=0x7f870801c8c0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.858 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.847+0000 7f87194cf640 1 -- 10.20.193.121:0/443496697 shutdown_connections 2026-02-13T02:31:21.858 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.847+0000 7f87194cf640 1 --2- 10.20.193.121:0/443496697 >> v2:10.20.193.178:3300/0 conn(0x7f8714056850 0x7f8714168cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.858 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.847+0000 7f87194cf640 1 --2- 10.20.193.121:0/443496697 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f87141684a0 0x7f8714058080 unknown :-1 s=CLOSED pgs=160 gs=2 cs=0 l=1 c_cookie=5387171169788062055 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.858 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.847+0000 7f87194cf640 1 -- 10.20.193.121:0/443496697 >> 10.20.193.121:0/443496697 conn(0x7f87140a16e0 msgr2=0x7f87140bbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:21.858 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.847+0000 7f87194cf640 1 -- 10.20.193.121:0/443496697 shutdown_connections 2026-02-13T02:31:21.859 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.847+0000 7f87194cf640 1 -- 10.20.193.121:0/443496697 wait complete. 2026-02-13T02:31:21.861 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f87194cf640 1 Processor -- start 2026-02-13T02:31:21.861 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f87194cf640 1 -- start start 2026-02-13T02:31:21.861 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f87194cf640 1 --2- >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f8714056850 0x7f87140b7bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.861 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f87194cf640 1 --2- >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f87141684a0 0x7f871414e3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.862 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f87194cf640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f8714168870 0x7f8714135150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.862 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f87194cf640 1 -- --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_getmap magic: 0 -- 0x7f87140bd7b0 con 0x7f8714168870 2026-02-13T02:31:21.862 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f87194cf640 1 -- --> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] -- mon_getmap magic: 0 -- 0x7f87140bd630 con 0x7f87141684a0 2026-02-13T02:31:21.862 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f87194cf640 1 -- --> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] -- mon_getmap magic: 0 -- 0x7f87140bd930 con 0x7f8714056850 2026-02-13T02:31:21.862 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f87137fe640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f8714168870 0x7f8714135150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.862 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f87137fe640 1 --2- >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f8714168870 0x7f8714135150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.121:3300/0 says I am v2:10.20.193.121:33812/0 (socket says 10.20.193.121:33812) 2026-02-13T02:31:21.862 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f87137fe640 1 -- 10.20.193.121:0/1731406208 learned_addr learned my addr 10.20.193.121:0/1731406208 (peer_addr_for_me v2:10.20.193.121:0/0) 2026-02-13T02:31:21.862 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f8712ffd640 1 --2- 10.20.193.121:0/1731406208 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f8714056850 0x7f87140b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.862 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f87127fc640 1 --2- 10.20.193.121:0/1731406208 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f87141684a0 0x7f871414e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.862 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f87137fe640 1 -- 10.20.193.121:0/1731406208 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f8714056850 msgr2=0x7f87140b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:21.862 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f87137fe640 1 --2- 10.20.193.121:0/1731406208 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f8714056850 0x7f87140b7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.863 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f87137fe640 1 -- 10.20.193.121:0/1731406208 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f87141684a0 msgr2=0x7f871414e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:21.863 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f87137fe640 1 --2- 10.20.193.121:0/1731406208 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f87141684a0 0x7f871414e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.863 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f87137fe640 1 -- 10.20.193.121:0/1731406208 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87140b6e00 con 0x7f8714168870 2026-02-13T02:31:21.863 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f87127fc640 1 --2- 10.20.193.121:0/1731406208 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f87141684a0 0x7f871414e3f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:31:21.863 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f87137fe640 1 --2- 10.20.193.121:0/1731406208 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f8714168870 0x7f8714135150 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f870400a9a0 tx=0x7f870400e630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:21.863 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f86f37fe640 1 -- 10.20.193.121:0/1731406208 <== mon.0 v2:10.20.193.121:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f870400ee60 con 0x7f8714168870 2026-02-13T02:31:21.863 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f86f37fe640 1 -- 10.20.193.121:0/1731406208 <== mon.0 v2:10.20.193.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8704008500 con 0x7f8714168870 2026-02-13T02:31:21.863 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f86f37fe640 1 -- 10.20.193.121:0/1731406208 <== mon.0 v2:10.20.193.121:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8704008970 con 0x7f8714168870 2026-02-13T02:31:21.863 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f87194cf640 1 -- 10.20.193.121:0/1731406208 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87140b70e0 con 0x7f8714168870 2026-02-13T02:31:21.863 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f87194cf640 1 -- 10.20.193.121:0/1731406208 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87140b76a0 con 0x7f8714168870 2026-02-13T02:31:21.863 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f87194cf640 1 -- 10.20.193.121:0/1731406208 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f871414e990 con 0x7f8714168870 2026-02-13T02:31:21.864 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f86f37fe640 1 -- 10.20.193.121:0/1731406208 <== mon.0 v2:10.20.193.121:3300/0 4 ==== mgrmap(e 5) ==== 100086+0+0 (secure 0 0 0) 0x7f8704013070 con 0x7f8714168870 2026-02-13T02:31:21.864 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f86f37fe640 1 --2- 10.20.193.121:0/1731406208 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f86e0074140 0x7f86e00945f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:31:21.865 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f8712ffd640 1 --2- 10.20.193.121:0/1731406208 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f86e0074140 0x7f86e00945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:31:21.865 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f86f37fe640 1 -- 10.20.193.121:0/1731406208 <== mon.0 v2:10.20.193.121:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6479+0+0 (secure 0 0 0) 0x7f8704096f40 con 0x7f8714168870 2026-02-13T02:31:21.865 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.851+0000 7f8712ffd640 1 --2- 10.20.193.121:0/1731406208 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f86e0074140 0x7f86e00945f0 secure :-1 s=READY pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8708002410 tx=0x7f87080b0040 comp rx=0 tx=0).ready entity=mgr.4155 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:31:21.865 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.855+0000 7f86f37fe640 1 -- 10.20.193.121:0/1731406208 <== mon.0 v2:10.20.193.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (secure 0 0 0) 0x7f8704011070 con 0x7f8714168870 2026-02-13T02:31:21.966 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.955+0000 7f87194cf640 1 -- 10.20.193.121:0/1731406208 --> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8714168cd0 con 0x7f8714168870 2026-02-13T02:31:21.966 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.955+0000 7f86f37fe640 1 -- 10.20.193.121:0/1731406208 <== mon.0 v2:10.20.193.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f8704060da0 con 0x7f8714168870 2026-02-13T02:31:21.967 INFO:teuthology.orchestra.run.trial121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2026-02-13T02:31:21.967 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.959+0000 7f87194cf640 1 -- 10.20.193.121:0/1731406208 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f86e0074140 msgr2=0x7f86e00945f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:21.968 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.959+0000 7f87194cf640 1 --2- 10.20.193.121:0/1731406208 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f86e0074140 0x7f86e00945f0 secure :-1 s=READY pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8708002410 tx=0x7f87080b0040 comp rx=0 tx=0).stop 2026-02-13T02:31:21.968 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.959+0000 7f87194cf640 1 -- 10.20.193.121:0/1731406208 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f8714168870 msgr2=0x7f8714135150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:31:21.968 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.959+0000 7f87194cf640 1 --2- 10.20.193.121:0/1731406208 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f8714168870 0x7f8714135150 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f870400a9a0 tx=0x7f870400e630 comp rx=0 tx=0).stop 2026-02-13T02:31:21.968 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.959+0000 7f87194cf640 1 -- 10.20.193.121:0/1731406208 shutdown_connections 2026-02-13T02:31:21.968 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.959+0000 7f87194cf640 1 --2- 10.20.193.121:0/1731406208 >> [v2:10.20.193.121:6800/1356598294,v1:10.20.193.121:6801/1356598294] conn(0x7f86e0074140 0x7f86e00945f0 unknown :-1 s=CLOSED pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.968 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.959+0000 7f87194cf640 1 --2- 10.20.193.121:0/1731406208 >> [v2:10.20.193.121:3300/0,v1:10.20.193.121:6789/0] conn(0x7f8714168870 0x7f8714135150 unknown :-1 s=CLOSED pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.968 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.959+0000 7f87194cf640 1 --2- 10.20.193.121:0/1731406208 >> [v2:10.20.193.178:3300/0,v1:10.20.193.178:6789/0] conn(0x7f87141684a0 0x7f871414e3f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.968 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.959+0000 7f87194cf640 1 --2- 10.20.193.121:0/1731406208 >> [v2:10.20.193.178:3301/0,v1:10.20.193.178:6790/0] conn(0x7f8714056850 0x7f87140b7bc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:31:21.968 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.959+0000 7f87194cf640 1 -- 10.20.193.121:0/1731406208 >> 10.20.193.121:0/1731406208 conn(0x7f87140a16e0 msgr2=0x7f871416b380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:31:21.968 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.959+0000 7f87194cf640 1 -- 10.20.193.121:0/1731406208 shutdown_connections 2026-02-13T02:31:21.968 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:21.959+0000 7f87194cf640 1 -- 10.20.193.121:0/1731406208 wait complete. 2026-02-13T02:31:21.978 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2026-02-13T02:31:21.979 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2026-02-13T02:31:21.979 INFO:tasks.cephfs.mount:self.client_remote.hostname = trial121.front.sepia.ceph.com 2026-02-13T02:31:21.979 INFO:tasks.cephfs.mount:self.client.name = client.admin 2026-02-13T02:31:21.979 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2026-02-13T02:31:21.979 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2026-02-13T02:31:21.979 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2026-02-13T02:31:21.979 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2026-02-13T02:31:21.979 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2026-02-13T02:31:21.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:21.980 DEBUG:teuthology.orchestra.run.trial121:> ip addr 2026-02-13T02:31:21.984 INFO:teuthology.orchestra.run.trial121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2026-02-13T02:31:21.985 INFO:teuthology.orchestra.run.trial121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2026-02-13T02:31:21.985 INFO:teuthology.orchestra.run.trial121.stdout: inet 127.0.0.1/8 scope host lo 2026-02-13T02:31:21.985 INFO:teuthology.orchestra.run.trial121.stdout: valid_lft forever preferred_lft forever 2026-02-13T02:31:21.985 INFO:teuthology.orchestra.run.trial121.stdout: inet6 ::1/128 scope host 2026-02-13T02:31:21.985 INFO:teuthology.orchestra.run.trial121.stdout: valid_lft forever preferred_lft forever 2026-02-13T02:31:21.985 INFO:teuthology.orchestra.run.trial121.stdout:2: enp1s0f0: mtu 1500 qdisc mq state UP group default qlen 1000 2026-02-13T02:31:21.985 INFO:teuthology.orchestra.run.trial121.stdout: link/ether 90:5a:08:77:61:fc brd ff:ff:ff:ff:ff:ff 2026-02-13T02:31:21.985 INFO:teuthology.orchestra.run.trial121.stdout: inet 10.20.193.121/20 metric 100 brd 10.20.207.255 scope global dynamic enp1s0f0 2026-02-13T02:31:21.985 INFO:teuthology.orchestra.run.trial121.stdout: valid_lft 705sec preferred_lft 705sec 2026-02-13T02:31:21.986 INFO:teuthology.orchestra.run.trial121.stdout: inet6 fe80::925a:8ff:fe77:61fc/64 scope link 2026-02-13T02:31:21.986 INFO:teuthology.orchestra.run.trial121.stdout: valid_lft forever preferred_lft forever 2026-02-13T02:31:21.986 INFO:teuthology.orchestra.run.trial121.stdout:3: enp1s0f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2026-02-13T02:31:21.986 INFO:teuthology.orchestra.run.trial121.stdout: link/ether 90:5a:08:77:61:fd brd ff:ff:ff:ff:ff:ff 2026-02-13T02:31:21.986 INFO:teuthology.orchestra.run.trial121.stdout:4: usb0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2026-02-13T02:31:21.986 INFO:teuthology.orchestra.run.trial121.stdout: link/ether 36:05:6d:95:c5:63 brd ff:ff:ff:ff:ff:ff 2026-02-13T02:31:21.986 INFO:teuthology.orchestra.run.trial121.stdout:5: docker0: mtu 1500 qdisc noqueue state DOWN group default 2026-02-13T02:31:21.986 INFO:teuthology.orchestra.run.trial121.stdout: link/ether a2:81:3c:90:c4:73 brd ff:ff:ff:ff:ff:ff 2026-02-13T02:31:21.986 INFO:teuthology.orchestra.run.trial121.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2026-02-13T02:31:21.986 INFO:teuthology.orchestra.run.trial121.stdout: valid_lft forever preferred_lft forever 2026-02-13T02:31:21.987 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.159.254/20 2026-02-13T02:31:21.987 DEBUG:teuthology.orchestra.run.trial121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-13T02:31:21.987 DEBUG:teuthology.orchestra.run.trial121:> set -e 2026-02-13T02:31:21.987 DEBUG:teuthology.orchestra.run.trial121:> sudo ip link add name ceph-brx type bridge 2026-02-13T02:31:21.987 DEBUG:teuthology.orchestra.run.trial121:> sudo ip addr flush dev ceph-brx 2026-02-13T02:31:21.988 DEBUG:teuthology.orchestra.run.trial121:> sudo ip link set ceph-brx up 2026-02-13T02:31:21.988 DEBUG:teuthology.orchestra.run.trial121:> sudo ip addr add 192.168.159.254/20 brd 192.168.159.255 dev ceph-brx 2026-02-13T02:31:21.988 DEBUG:teuthology.orchestra.run.trial121:> ') 2026-02-13T02:31:22.047 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-13T02:31:22.071 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-13T02:31:22.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:22.075 DEBUG:teuthology.orchestra.run.trial121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2026-02-13T02:31:22.130 INFO:teuthology.orchestra.run.trial121.stdout:1 2026-02-13T02:31:22.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:22.132 DEBUG:teuthology.orchestra.run.trial121:> ip r 2026-02-13T02:31:22.178 INFO:teuthology.orchestra.run.trial121.stdout:default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.121 metric 100 2026-02-13T02:31:22.178 INFO:teuthology.orchestra.run.trial121.stdout:10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.121 metric 100 2026-02-13T02:31:22.178 INFO:teuthology.orchestra.run.trial121.stdout:10.20.192.1 dev enp1s0f0 proto dhcp scope link src 10.20.193.121 metric 100 2026-02-13T02:31:22.179 INFO:teuthology.orchestra.run.trial121.stdout:10.20.192.11 dev enp1s0f0 proto dhcp scope link src 10.20.193.121 metric 100 2026-02-13T02:31:22.179 INFO:teuthology.orchestra.run.trial121.stdout:172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2026-02-13T02:31:22.179 INFO:teuthology.orchestra.run.trial121.stdout:192.168.144.0/20 dev ceph-brx proto kernel scope link src 192.168.159.254 linkdown 2026-02-13T02:31:22.179 DEBUG:teuthology.orchestra.run.trial121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-13T02:31:22.180 DEBUG:teuthology.orchestra.run.trial121:> set -e 2026-02-13T02:31:22.180 DEBUG:teuthology.orchestra.run.trial121:> 2026-02-13T02:31:22.180 DEBUG:teuthology.orchestra.run.trial121:> # Ensure filter table exists. Ignore error if it already does. 2026-02-13T02:31:22.180 DEBUG:teuthology.orchestra.run.trial121:> sudo nft add table ip filter > /dev/null 2>&1 || true 2026-02-13T02:31:22.180 DEBUG:teuthology.orchestra.run.trial121:> sudo nft add chain ip filter forward { type filter hook forward priority 0 \; } > /dev/null 2>&1 || true 2026-02-13T02:31:22.180 DEBUG:teuthology.orchestra.run.trial121:> 2026-02-13T02:31:22.180 DEBUG:teuthology.orchestra.run.trial121:> # Ensure nat table exists. Ignore error if it already does. 2026-02-13T02:31:22.180 DEBUG:teuthology.orchestra.run.trial121:> sudo nft add table ip nat > /dev/null 2>&1 || true 2026-02-13T02:31:22.180 DEBUG:teuthology.orchestra.run.trial121:> 2026-02-13T02:31:22.180 DEBUG:teuthology.orchestra.run.trial121:> # Ensure postrouting chain exists. Ignore error if it already does. 2026-02-13T02:31:22.180 DEBUG:teuthology.orchestra.run.trial121:> sudo nft add chain ip nat postrouting { type nat hook postrouting priority 100 \; } > /dev/null 2>&1 || true 2026-02-13T02:31:22.180 DEBUG:teuthology.orchestra.run.trial121:> 2026-02-13T02:31:22.181 DEBUG:teuthology.orchestra.run.trial121:> # Add the forwarding rules (to filter table, forward chain) 2026-02-13T02:31:22.181 DEBUG:teuthology.orchestra.run.trial121:> sudo nft add rule ip filter forward iifname ceph-brx oifname enp1s0f0 accept 2026-02-13T02:31:22.181 DEBUG:teuthology.orchestra.run.trial121:> sudo nft add rule ip filter forward iifname enp1s0f0 oifname ceph-brx accept 2026-02-13T02:31:22.181 DEBUG:teuthology.orchestra.run.trial121:> 2026-02-13T02:31:22.181 DEBUG:teuthology.orchestra.run.trial121:> # Add the NAT rule 2026-02-13T02:31:22.181 DEBUG:teuthology.orchestra.run.trial121:> sudo nft add rule ip nat postrouting ip saddr 192.168.159.254/20 oifname enp1s0f0 masquerade 2026-02-13T02:31:22.181 DEBUG:teuthology.orchestra.run.trial121:> ') 2026-02-13T02:31:22.242 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-13T02:31:22.352 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-13T02:31:22.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:22.356 DEBUG:teuthology.orchestra.run.trial121:> ip netns list 2026-02-13T02:31:22.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:22.403 DEBUG:teuthology.orchestra.run.trial121:> ip netns list-id 2026-02-13T02:31:22.446 DEBUG:teuthology.orchestra.run.trial121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-13T02:31:22.447 DEBUG:teuthology.orchestra.run.trial121:> set -e 2026-02-13T02:31:22.447 DEBUG:teuthology.orchestra.run.trial121:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:22.447 DEBUG:teuthology.orchestra.run.trial121:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2026-02-13T02:31:22.447 DEBUG:teuthology.orchestra.run.trial121:> ') 2026-02-13T02:31:22.506 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-13T02:31:22.521 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-13T02:31:22.524 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.144.1/20 2026-02-13T02:31:22.525 DEBUG:teuthology.orchestra.run.trial121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-13T02:31:22.525 DEBUG:teuthology.orchestra.run.trial121:> set -e 2026-02-13T02:31:22.525 DEBUG:teuthology.orchestra.run.trial121:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2026-02-13T02:31:22.525 DEBUG:teuthology.orchestra.run.trial121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.144.1/20 brd 192.168.159.255 dev veth0 2026-02-13T02:31:22.525 DEBUG:teuthology.orchestra.run.trial121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2026-02-13T02:31:22.525 DEBUG:teuthology.orchestra.run.trial121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2026-02-13T02:31:22.525 DEBUG:teuthology.orchestra.run.trial121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.159.254 2026-02-13T02:31:22.525 DEBUG:teuthology.orchestra.run.trial121:> ') 2026-02-13T02:31:22.586 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-13T02:31:22.623 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-13T02:31:22.628 DEBUG:teuthology.orchestra.run.trial121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-13T02:31:22.628 DEBUG:teuthology.orchestra.run.trial121:> set -e 2026-02-13T02:31:22.628 DEBUG:teuthology.orchestra.run.trial121:> sudo ip link set brx.0 up 2026-02-13T02:31:22.628 DEBUG:teuthology.orchestra.run.trial121:> sudo ip link set dev brx.0 master ceph-brx 2026-02-13T02:31:22.628 DEBUG:teuthology.orchestra.run.trial121:> ') 2026-02-13T02:31:22.690 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-13T02:31:22.705 INFO:teuthology.orchestra.run.trial121.stderr:2026-02-13T02:31:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-13T02:31:22.708 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2026-02-13T02:31:22.708 INFO:teuthology.orchestra.run:Running command with timeout 60 2026-02-13T02:31:22.708 DEBUG:teuthology.orchestra.run.trial121:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2026-02-13T02:31:22.754 INFO:teuthology.orchestra.run.trial121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2026-02-13T02:31:22.754 INFO:teuthology.orchestra.run:Running command with timeout 60 2026-02-13T02:31:22.755 DEBUG:teuthology.orchestra.run.trial121:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2026-02-13T02:31:22.798 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:22.847 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:22.895 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:22.895 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:22.895 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:22.895 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:22.895 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:22.895 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:22.895 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:22.895 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:22.895 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:22.896 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:22.896 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:22.896 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:22.896 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:22.896 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:22.896 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:22.896 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:22.896 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:22.896 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:22.896 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:22.896 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:22.897 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:22.897 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:22.897 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:22.897 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:22.897 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:22.897 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:22.897 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:22.897 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:22.897 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:22.897 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:22.897 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:22.897 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:22.898 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:22.898 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:22.898 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:22.898 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:22.898 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:22.898 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:22.898 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:22.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:22.899 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:22.946 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2026-02-13T02:31:22.946 DEBUG:teuthology.orchestra.run.trial121:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2026-02-13T02:31:22.992 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:23.001 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:23.034 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.trial121.stderr:2026-02-13T02:31:23.023+0000 7f5299021680 -1 init, newargv = 0x5607c9386470 newargc=15 2026-02-13T02:31:23.035 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.trial121.stderr:ceph-fuse[19626]: starting ceph client 2026-02-13T02:31:23.039 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:23.039 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:23.039 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:23.039 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:23.039 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:23.039 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:23.039 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:23.039 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:23.040 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:23.040 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:23.040 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:23.040 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:23.040 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:23.040 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:23.040 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:23.040 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:23.040 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:23.040 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:23.040 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:23.040 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:23.040 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:23.041 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:23.041 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:23.041 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:23.041 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:23.041 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:23.041 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:23.041 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:23.041 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:23.041 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:23.041 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:23.041 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:23.041 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:23.042 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:23.042 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:23.042 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:23.042 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:23.042 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:23.042 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:23.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:23.043 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:24.191 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:24.201 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:24.247 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:24.247 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:24.247 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:24.247 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:24.247 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:24.247 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:24.248 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:24.248 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:24.248 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:24.248 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:24.248 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:24.248 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:24.248 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:24.248 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:24.248 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:24.248 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:24.248 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:24.248 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:24.249 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:24.249 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:24.249 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:24.249 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:24.249 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:24.249 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:24.249 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:24.249 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:24.249 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:24.249 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:24.249 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:24.249 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:24.249 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:24.250 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:24.250 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:24.250 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:24.250 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:24.250 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:24.250 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:24.250 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:24.250 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:24.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:24.251 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:25.357 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:PerfHandler: tick 2026-02-13T02:31:25.357 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:TaskHandler: tick 2026-02-13T02:31:25.399 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:25.408 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:25.455 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:25.455 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:25.455 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:25.455 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:25.455 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:25.455 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:25.455 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:25.455 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:25.455 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:25.456 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:25.456 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:25.456 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:25.456 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:25.456 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:25.456 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:25.456 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:25.456 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:25.456 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:25.456 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:25.456 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:25.456 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:25.457 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:25.457 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:25.457 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:25.457 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:25.457 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:25.457 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:25.457 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:25.457 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:25.457 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:25.457 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:25.457 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:25.457 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:25.458 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:25.458 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:25.458 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:25.458 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:25.458 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:25.458 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:25.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:25.459 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:26.607 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:26.618 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:26.667 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:26.667 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:26.667 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:26.667 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:26.667 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:26.667 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:26.667 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:26.668 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:26.668 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:26.668 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:26.668 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:26.668 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:26.668 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:26.668 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:26.668 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:26.668 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:26.668 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:26.668 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:26.668 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:26.669 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:26.669 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:26.669 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:26.669 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:26.669 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:26.669 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:26.669 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:26.669 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:26.669 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:26.669 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:26.669 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:26.669 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:26.670 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:26.670 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:26.670 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:26.670 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:26.670 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:26.670 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:26.670 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:26.670 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:26.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:26.671 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:27.819 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:27.831 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:27.879 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:27.879 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:27.879 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:27.879 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:27.879 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:27.879 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:27.879 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:27.879 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:27.880 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:27.880 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:27.880 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:27.880 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:27.880 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:27.880 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:27.880 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:27.880 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:27.880 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:27.880 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:27.880 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:27.880 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:27.880 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:27.880 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:27.881 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:27.881 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:27.881 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:27.881 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:27.881 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:27.881 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:27.881 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:27.881 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:27.881 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:27.881 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:27.881 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:27.881 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:27.881 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:27.881 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:27.882 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:27.882 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:27.882 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:27.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:27.883 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:29.031 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:29.042 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:29.086 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:29.087 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:29.087 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:29.087 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:29.087 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:29.087 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:29.087 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:29.087 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:29.087 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:29.087 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:29.088 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:29.088 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:29.088 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:29.088 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:29.088 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:29.088 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:29.088 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:29.088 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:29.088 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:29.088 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:29.088 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:29.089 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:29.089 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:29.089 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:29.089 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:29.089 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:29.089 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:29.089 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:29.089 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:29.089 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:29.089 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:29.089 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:29.089 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:29.089 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:29.090 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:29.090 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:29.090 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:29.090 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:29.090 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:29.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:29.091 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:30.240 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:30.251 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:30.300 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:30.300 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:30.301 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:30.301 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:30.301 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:30.301 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:30.301 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:30.301 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:30.301 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:30.302 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:30.302 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:30.302 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:30.302 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:30.302 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:30.302 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:30.302 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:30.302 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:30.302 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:30.303 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:30.303 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:30.303 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:30.303 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:30.303 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:30.303 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:30.303 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:30.303 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:30.304 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:30.304 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:30.304 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:30.304 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:30.304 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:30.304 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:30.304 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:30.304 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:30.305 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:30.305 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:30.305 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:30.305 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:30.305 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:30.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:30.306 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:30.355 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-13T02:31:30.355 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-13T02:31:30.357 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:PerfHandler: tick 2026-02-13T02:31:30.358 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:TaskHandler: tick 2026-02-13T02:31:30.358 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-13T02:31:30.358 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-13T02:31:30.360 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-13T02:31:30.360 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-13T02:31:31.446 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:31.457 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:31.503 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:31.503 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:31.503 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:31.503 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:31.503 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:31.503 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:31.503 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:31.504 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:31.504 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:31.504 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:31.504 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:31.504 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:31.504 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:31.504 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:31.504 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:31.504 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:31.504 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:31.504 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:31.504 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:31.505 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:31.505 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:31.505 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:31.505 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:31.505 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:31.505 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:31.505 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:31.505 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:31.505 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:31.505 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:31.505 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:31.505 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:31.506 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:31.506 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:31.506 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:31.506 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:31.506 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:31.506 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:31.506 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:31.506 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:31.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:31.507 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:32.655 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:32.666 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:32.711 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:32.711 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:32.711 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:32.711 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:32.711 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:32.711 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:32.712 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:32.712 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:32.712 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:32.712 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:32.712 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:32.712 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:32.712 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:32.712 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:32.712 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:32.712 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:32.713 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:32.713 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:32.713 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:32.713 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:32.713 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:32.713 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:32.713 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:32.713 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:32.713 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:32.713 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:32.713 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:32.714 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:32.714 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:32.714 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:32.714 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:32.714 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:32.714 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:32.714 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:32.714 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:32.714 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:32.714 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:32.714 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:32.714 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:32.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:32.716 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:33.863 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:33.874 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:33.919 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:33.919 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:33.919 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:33.919 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:33.919 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:33.919 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:33.919 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:33.919 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:33.920 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:33.920 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:33.920 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:33.920 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:33.920 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:33.920 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:33.920 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:33.920 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:33.920 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:33.920 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:33.920 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:33.920 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:33.921 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:33.921 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:33.921 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:33.921 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:33.921 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:33.921 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:33.921 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:33.921 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:33.921 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:33.921 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:33.921 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:33.921 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:33.921 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:33.922 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:33.922 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:33.922 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:33.922 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:33.922 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:33.922 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:33.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:33.923 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:34.251 DEBUG:teuthology.orchestra.run.trial121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-13T02:31:34.253 DEBUG:teuthology.orchestra.run.trial178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-13T02:31:35.072 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:35.082 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:35.127 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:35.127 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:35.127 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:35.127 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:35.128 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:35.128 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:35.128 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:35.128 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:35.128 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:35.128 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:35.128 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:35.128 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:35.128 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:35.128 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:35.128 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:35.128 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:35.129 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:35.129 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:35.129 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:35.129 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:35.129 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:35.129 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:35.129 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:35.129 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:35.129 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:35.129 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:35.129 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:35.129 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:35.129 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:35.129 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:35.130 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:35.130 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:35.130 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:35.130 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:35.130 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:35.130 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:35.130 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:35.130 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:35.130 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:35.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:35.132 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:35.358 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:PerfHandler: tick 2026-02-13T02:31:35.358 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:TaskHandler: tick 2026-02-13T02:31:36.280 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:36.290 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:36.339 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:36.339 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:36.339 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:36.339 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:36.339 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:36.339 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:36.340 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:36.340 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:36.340 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:36.340 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:36.340 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:36.340 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:36.340 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:36.340 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:36.340 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:36.340 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:36.340 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:36.340 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:36.341 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:36.341 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:36.341 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:36.341 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:36.341 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:36.341 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:36.341 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:36.341 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:36.341 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:36.341 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:36.341 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:36.341 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:36.341 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:36.342 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:36.342 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:36.342 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:36.342 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:36.342 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:36.342 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:36.342 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:36.342 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:36.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:36.343 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:37.492 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:37.503 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:37.551 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:37.551 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:37.551 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:37.552 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:37.552 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:37.552 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:37.552 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:37.552 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:37.552 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:37.552 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:37.552 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:37.552 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:37.552 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:37.552 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:37.552 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:37.553 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:37.553 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:37.553 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:37.553 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:37.553 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:37.553 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:37.553 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:37.553 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:37.553 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:37.553 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:37.553 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:37.553 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:37.554 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:37.554 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:37.554 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:37.554 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:37.554 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:37.554 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:37.554 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:37.554 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:37.554 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:37.554 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:37.554 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:37.554 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:37.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:37.556 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:38.704 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:38.715 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:38.763 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:38.763 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:38.763 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:38.763 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:38.763 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:38.763 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:38.764 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:38.764 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:38.764 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:38.764 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:38.764 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:38.764 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:38.764 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:38.764 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:38.764 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:38.764 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:38.764 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:38.764 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:38.764 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:38.765 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:38.765 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:38.765 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:38.765 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:38.765 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:38.765 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:38.765 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:38.765 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:38.765 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:38.765 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:38.765 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:38.765 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:38.766 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:38.766 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:38.766 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:38.766 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:38.766 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:38.766 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:38.766 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:38.766 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:38.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:38.767 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:39.920 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:39.930 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:39.983 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:39.983 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:39.983 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:39.983 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:39.984 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:39.984 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:39.984 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:39.984 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:39.984 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:39.984 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:39.984 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:39.984 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:39.984 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:39.984 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:39.985 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:39.985 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:39.985 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:39.985 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:39.985 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:39.985 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:39.985 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:39.985 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:39.985 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:39.985 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:39.985 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:39.985 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:39.986 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:39.986 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:39.986 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:39.986 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:39.986 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:39.986 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:39.986 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:39.986 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:39.986 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:39.986 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:39.986 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:39.987 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:39.987 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:39.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:39.988 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:40.359 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:PerfHandler: tick 2026-02-13T02:31:40.359 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:TaskHandler: tick 2026-02-13T02:31:41.132 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:41.143 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:41.191 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:41.191 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:41.192 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:41.192 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:41.192 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:41.192 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:41.192 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:41.192 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:41.192 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:41.192 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:41.192 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:41.192 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:41.193 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:41.193 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:41.193 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:41.193 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:41.193 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:41.193 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:41.193 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:41.193 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:41.193 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:41.193 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:41.194 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:41.194 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:41.194 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:41.194 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:41.194 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:41.194 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:41.194 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:41.194 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:41.194 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:41.194 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:41.194 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:41.195 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:41.195 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:41.195 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:41.195 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:41.195 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:41.195 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:41.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:41.197 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:42.344 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:42.353 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:42.399 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:42.399 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:42.399 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:42.399 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:42.400 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:42.400 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:42.400 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:42.400 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:42.400 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:42.400 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:42.400 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:42.400 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:42.401 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:42.401 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:42.401 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:42.401 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:42.401 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:42.401 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:42.401 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:42.401 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:42.401 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:42.401 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:42.401 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:42.401 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:42.401 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:42.402 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:42.402 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:42.402 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:42.402 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:42.402 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:42.402 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:42.402 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:42.402 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:42.402 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:42.402 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:42.402 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:42.402 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:42.403 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:42.403 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:42.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:42.404 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:43.552 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:43.564 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:43.611 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:43.611 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:43.611 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:43.611 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:43.611 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:43.612 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:43.612 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:43.612 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:43.612 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:43.612 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:43.612 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:43.612 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:43.612 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:43.612 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:43.612 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:43.612 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:43.613 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:43.613 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:43.613 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:43.613 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:43.613 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:43.613 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:43.613 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:43.613 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:43.613 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:43.613 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:43.613 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:43.614 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:43.614 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:43.614 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:43.614 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:43.614 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:43.614 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:43.614 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:43.614 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:43.614 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:43.614 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:43.614 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:43.614 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:43.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:43.616 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:44.764 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:44.774 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:44.819 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:44.819 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:44.819 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:44.819 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:44.820 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:44.820 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:44.820 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:44.820 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:44.820 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:44.820 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:44.820 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:44.820 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:44.820 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:44.820 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:44.820 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:44.820 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:44.821 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:44.821 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:44.821 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:44.821 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:44.821 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:44.821 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:44.821 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:44.821 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:44.821 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:44.821 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:44.821 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:44.821 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:44.822 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:44.822 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:44.822 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:44.822 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:44.822 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:44.822 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:44.822 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:44.822 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:44.822 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:44.822 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:44.822 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:44.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:44.824 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:45.359 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:PerfHandler: tick 2026-02-13T02:31:45.359 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:TaskHandler: tick 2026-02-13T02:31:45.971 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:45.981 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:46.027 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:46.027 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:46.027 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:46.027 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:46.028 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:46.028 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:46.028 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:46.028 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:46.028 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:46.028 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:46.028 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:46.028 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:46.028 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:46.028 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:46.028 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:46.029 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:46.029 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:46.029 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:46.029 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:46.029 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:46.029 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:46.029 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:46.029 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:46.029 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:46.029 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:46.029 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:46.029 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:46.030 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:46.030 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:46.030 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:46.030 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:46.030 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:46.030 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:46.030 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:46.030 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:46.030 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:46.030 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:46.030 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:46.031 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:46.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:46.032 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:47.180 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:47.191 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:47.239 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:47.239 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:47.239 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:47.239 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:47.239 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:47.239 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:47.240 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:47.240 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:47.240 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:47.240 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:47.240 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:47.240 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:47.240 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:47.240 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:47.240 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:47.240 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:47.240 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:47.241 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:47.241 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:47.241 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:47.241 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:47.241 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:47.241 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:47.241 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:47.241 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:47.241 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:47.241 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:47.241 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:47.241 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:47.242 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:47.242 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:47.242 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:47.242 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:47.242 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:47.242 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:47.242 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:47.242 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:47.242 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:47.242 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:47.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:47.244 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:48.392 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:48.402 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:48.447 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:48.447 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:48.447 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:48.447 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:48.448 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:48.448 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:48.448 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:48.448 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:48.448 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:48.448 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:48.448 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:48.448 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:48.448 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:48.448 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:48.448 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:48.448 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:48.449 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:48.449 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:48.449 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:48.449 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:48.449 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:48.449 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:48.449 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:48.449 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:48.449 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:48.449 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:48.449 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:48.449 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:48.450 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:48.450 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:48.450 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:48.450 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:48.450 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:48.450 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:48.450 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:48.450 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:48.450 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:48.450 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:48.450 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:48.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:48.452 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:49.599 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:49.609 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:49.655 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:49.655 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:49.655 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:49.656 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:49.656 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:49.656 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:49.656 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:49.656 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:49.656 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:49.656 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:49.656 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:49.656 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:49.656 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:49.656 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:49.657 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:49.657 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:49.657 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:49.657 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:49.657 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:49.657 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:49.657 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:49.657 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:49.657 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:49.657 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:49.657 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:49.657 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:49.657 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:49.658 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:49.658 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:49.658 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:49.658 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:49.658 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:49.658 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:49.658 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:49.658 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:49.658 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:49.658 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:49.658 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:49.658 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:49.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:49.660 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:50.359 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:PerfHandler: tick 2026-02-13T02:31:50.359 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:TaskHandler: tick 2026-02-13T02:31:50.808 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:50.818 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:50.863 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:50.863 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:50.863 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:50.863 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:50.863 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:50.864 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:50.864 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:50.864 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:50.864 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:50.864 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:50.864 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:50.864 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:50.864 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:50.864 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:50.864 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:50.864 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:50.864 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:50.865 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:50.865 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:50.865 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:50.865 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:50.865 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:50.865 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:50.865 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:50.865 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:50.865 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:50.865 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:50.865 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:50.865 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:50.866 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:50.866 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:50.866 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:50.866 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:50.866 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:50.866 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:50.866 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:50.866 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:50.866 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:50.866 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:50.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:50.868 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:52.016 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:52.026 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:52.071 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:52.071 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:52.071 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:52.071 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:52.072 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:52.072 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:52.072 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:52.072 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:52.072 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:52.072 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:52.072 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:52.072 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:52.072 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:52.072 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:52.072 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:52.072 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:52.073 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:52.073 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:52.073 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:52.073 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:52.073 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:52.073 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:52.073 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:52.073 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:52.073 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:52.073 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:52.073 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:52.073 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:52.074 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:52.074 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:52.074 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:52.074 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:52.074 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:52.074 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:52.074 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:52.074 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:52.074 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:52.074 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:52.074 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:52.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:52.076 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:53.223 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:53.235 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:53.279 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:53.279 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:53.279 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:53.279 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:53.280 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:53.280 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:53.280 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:53.280 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:53.280 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:53.280 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:53.280 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:53.280 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:53.280 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:53.280 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:53.280 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:53.281 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:53.281 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:53.281 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:53.281 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:53.281 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:53.281 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:53.281 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:53.281 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:53.281 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:53.281 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:53.281 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:53.281 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:53.281 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:53.282 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:53.282 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:53.282 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:53.282 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:53.282 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:53.282 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:53.282 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:53.282 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:53.282 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:53.282 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:53.282 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:53.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:53.284 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:54.431 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:54.441 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:54.487 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:54.487 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:54.487 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:54.487 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:54.488 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:54.488 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:54.488 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:54.488 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:54.488 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:54.488 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:54.488 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:54.488 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:54.488 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:54.488 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:54.488 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:54.488 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:54.489 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:54.489 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:54.489 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:54.489 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:54.489 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:54.489 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:54.489 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:54.489 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:54.489 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:54.489 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:54.489 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:54.489 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:54.490 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:54.490 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:54.490 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:54.490 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:54.490 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:54.490 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:54.490 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:54.490 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:54.490 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:54.490 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:54.490 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:54.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:54.492 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:55.359 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:PerfHandler: tick 2026-02-13T02:31:55.360 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:TaskHandler: tick 2026-02-13T02:31:55.643 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:55.653 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:55.699 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:55.699 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:55.699 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:55.699 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:55.699 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:55.699 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:55.700 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:55.700 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:55.700 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:55.700 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:55.700 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:55.700 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:55.700 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:55.700 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:55.700 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:55.700 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:55.700 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:55.700 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:55.701 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:55.701 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:55.701 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:55.701 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:55.701 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:55.701 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:55.701 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:55.701 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:55.701 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:55.701 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:55.701 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:55.701 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:55.701 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:55.702 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:55.702 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:55.702 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:55.702 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:55.702 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:55.702 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:55.702 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:55.702 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:55.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:55.703 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:56.852 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:56.862 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:56.907 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:56.907 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:56.907 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:56.907 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:56.908 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:56.908 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:56.908 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:56.908 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:56.908 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:56.908 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:56.908 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:56.908 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:56.908 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:56.908 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:56.908 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:56.908 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:56.909 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:56.909 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:56.909 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:56.909 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:56.909 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:56.909 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:56.909 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:56.909 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:56.909 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:56.909 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:56.909 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:56.909 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:56.910 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:56.910 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:56.910 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:56.910 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:56.910 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:56.910 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:56.910 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:56.910 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:56.910 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:56.910 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:56.910 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:56.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:56.912 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:58.059 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:58.069 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:58.115 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:58.115 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:58.115 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:58.116 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:58.116 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:58.116 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:58.116 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:58.116 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:58.116 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:58.116 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:58.116 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:58.116 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:58.116 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:58.116 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:58.116 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:58.117 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:58.117 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:58.117 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:58.117 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:58.117 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:58.117 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:58.117 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:58.117 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:58.117 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:58.117 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:58.117 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:58.117 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:58.118 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:58.118 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:58.118 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:58.118 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:58.118 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:58.118 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:58.118 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:58.118 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:58.118 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:58.118 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:58.118 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:58.118 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:58.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:58.120 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:31:59.267 DEBUG:teuthology.orchestra.run.trial121:> sudo modprobe fuse 2026-02-13T02:31:59.278 DEBUG:teuthology.orchestra.run.trial121:> cat /proc/self/mounts | awk '{print $2}' 2026-02-13T02:31:59.322 INFO:teuthology.orchestra.run.trial121.stdout:/sys 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/proc 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/dev 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/dev/pts 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/run 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/ 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/security 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/dev/shm 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/run/lock 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/cgroup 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/pstore 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/sys/firmware/efi/efivars 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/bpf 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/dev/hugepages 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/dev/mqueue 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/debug 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/tracing 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/proc/fs/nfsd 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/sys/fs/fuse/connections 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/sys/kernel/config 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/run/credentials/systemd-sysusers.service 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/snap/core20/2686 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/snap/lxd/36918 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/snap/snapd/25935 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/boot/efi 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/proc/sys/fs/binfmt_misc 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/run/rpc_pipefs 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/run/snapd/ns/lxd.mnt 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/run/user/1000 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-0 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-1 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-2 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/var/lib/ceph/osd/ceph-3 2026-02-13T02:31:59.323 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns 2026-02-13T02:31:59.324 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:59.324 INFO:teuthology.orchestra.run.trial121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-13T02:31:59.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:31:59.324 DEBUG:teuthology.orchestra.run.trial121:> ls /sys/fs/fuse/connections 2026-02-13T02:32:00.350 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:Waking up [active, now 2026-02-13_02:32:00] 2026-02-13T02:32:00.350 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:Running 2026-02-13T02:32:00.351 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:Optimize plan auto_2026-02-13_02:32:00, mode upmap, max misplaced 0.050000 2026-02-13T02:32:00.352 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:unknown 0.000000 degraded 0.000000 inactive 0.000000 misplaced 0 2026-02-13T02:32:00.352 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:do_upmap 2026-02-13T02:32:00.352 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:pools ['cephfs_metadata', 'cephfs_data_ec', 'cephfs_data', '.mgr'] 2026-02-13T02:32:00.352 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:prepared 8/10 upmap changes 2026-02-13T02:32:00.352 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:Executing plan auto_2026-02-13_02:32:00 2026-02-13T02:32:00.352 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:ceph osd pg-upmap-items 3.2 mappings [{'from': 3, 'to': 2}] 2026-02-13T02:32:00.353 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:_maybe_adjust 2026-02-13T02:32:00.355 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:pool: { 2026-02-13T02:32:00.355 INFO:tasks.ceph.mgr.y.trial121.stderr: ".mgr": { 2026-02-13T02:32:00.355 INFO:tasks.ceph.mgr.y.trial121.stderr: "application_metadata": { 2026-02-13T02:32:00.355 INFO:tasks.ceph.mgr.y.trial121.stderr: "mgr": {} 2026-02-13T02:32:00.355 INFO:tasks.ceph.mgr.y.trial121.stderr: }, 2026-02-13T02:32:00.355 INFO:tasks.ceph.mgr.y.trial121.stderr: "auid": 0, 2026-02-13T02:32:00.355 INFO:tasks.ceph.mgr.y.trial121.stderr: "cache_min_evict_age": 0, 2026-02-13T02:32:00.355 INFO:tasks.ceph.mgr.y.trial121.stderr: "cache_min_flush_age": 0, 2026-02-13T02:32:00.356 INFO:tasks.ceph.mgr.y.trial121.stderr: "cache_mode": "none", 2026-02-13T02:32:00.356 INFO:tasks.ceph.mgr.y.trial121.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-13T02:32:00.356 INFO:tasks.ceph.mgr.y.trial121.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-13T02:32:00.356 INFO:tasks.ceph.mgr.y.trial121.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-13T02:32:00.356 INFO:tasks.ceph.mgr.y.trial121.stderr: "create_time": "2026-02-13T02:31:06.353015+0000", 2026-02-13T02:32:00.356 INFO:tasks.ceph.mgr.y.trial121.stderr: "crush_rule": 0, 2026-02-13T02:32:00.356 INFO:tasks.ceph.mgr.y.trial121.stderr: "erasure_code_profile": "", 2026-02-13T02:32:00.356 INFO:tasks.ceph.mgr.y.trial121.stderr: "expected_num_objects": 0, 2026-02-13T02:32:00.356 INFO:tasks.ceph.mgr.y.trial121.stderr: "fast_read": false, 2026-02-13T02:32:00.356 INFO:tasks.ceph.mgr.y.trial121.stderr: "flags": 1, 2026-02-13T02:32:00.356 INFO:tasks.ceph.mgr.y.trial121.stderr: "flags_names": "hashpspool", 2026-02-13T02:32:00.357 INFO:tasks.ceph.mgr.y.trial121.stderr: "grade_table": [], 2026-02-13T02:32:00.357 INFO:tasks.ceph.mgr.y.trial121.stderr: "hit_set_count": 0, 2026-02-13T02:32:00.357 INFO:tasks.ceph.mgr.y.trial121.stderr: "hit_set_grade_decay_rate": 0, 2026-02-13T02:32:00.357 INFO:tasks.ceph.mgr.y.trial121.stderr: "hit_set_params": { 2026-02-13T02:32:00.357 INFO:tasks.ceph.mgr.y.trial121.stderr: "type": "none" 2026-02-13T02:32:00.357 INFO:tasks.ceph.mgr.y.trial121.stderr: }, 2026-02-13T02:32:00.357 INFO:tasks.ceph.mgr.y.trial121.stderr: "hit_set_period": 0, 2026-02-13T02:32:00.357 INFO:tasks.ceph.mgr.y.trial121.stderr: "hit_set_search_last_n": 0, 2026-02-13T02:32:00.357 INFO:tasks.ceph.mgr.y.trial121.stderr: "is_stretch_pool": false, 2026-02-13T02:32:00.357 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_change": "16", 2026-02-13T02:32:00.357 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_force_op_resend": "0", 2026-02-13T02:32:00.357 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_force_op_resend_preluminous": "0", 2026-02-13T02:32:00.357 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-13T02:32:00.358 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_pg_merge_meta": { 2026-02-13T02:32:00.358 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_epoch_clean": 0, 2026-02-13T02:32:00.358 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_epoch_started": 0, 2026-02-13T02:32:00.358 INFO:tasks.ceph.mgr.y.trial121.stderr: "ready_epoch": 0, 2026-02-13T02:32:00.358 INFO:tasks.ceph.mgr.y.trial121.stderr: "source_pgid": "0.0", 2026-02-13T02:32:00.358 INFO:tasks.ceph.mgr.y.trial121.stderr: "source_version": "0'0", 2026-02-13T02:32:00.358 INFO:tasks.ceph.mgr.y.trial121.stderr: "target_version": "0'0" 2026-02-13T02:32:00.358 INFO:tasks.ceph.mgr.y.trial121.stderr: }, 2026-02-13T02:32:00.358 INFO:tasks.ceph.mgr.y.trial121.stderr: "min_read_recency_for_promote": 0, 2026-02-13T02:32:00.358 INFO:tasks.ceph.mgr.y.trial121.stderr: "min_size": 1, 2026-02-13T02:32:00.358 INFO:tasks.ceph.mgr.y.trial121.stderr: "min_write_recency_for_promote": 0, 2026-02-13T02:32:00.358 INFO:tasks.ceph.mgr.y.trial121.stderr: "nonprimary_shards": "{}", 2026-02-13T02:32:00.359 INFO:tasks.ceph.mgr.y.trial121.stderr: "object_hash": 2, 2026-02-13T02:32:00.359 INFO:tasks.ceph.mgr.y.trial121.stderr: "options": { 2026-02-13T02:32:00.359 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_num_max": 32, 2026-02-13T02:32:00.359 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_num_min": 1 2026-02-13T02:32:00.359 INFO:tasks.ceph.mgr.y.trial121.stderr: }, 2026-02-13T02:32:00.359 INFO:tasks.ceph.mgr.y.trial121.stderr: "peering_crush_bucket_barrier": 0, 2026-02-13T02:32:00.359 INFO:tasks.ceph.mgr.y.trial121.stderr: "peering_crush_bucket_count": 0, 2026-02-13T02:32:00.359 INFO:tasks.ceph.mgr.y.trial121.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-13T02:32:00.359 INFO:tasks.ceph.mgr.y.trial121.stderr: "peering_crush_bucket_target": 0, 2026-02-13T02:32:00.359 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_autoscale_mode": "off", 2026-02-13T02:32:00.359 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_num": 1, 2026-02-13T02:32:00.359 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_num_pending": 1, 2026-02-13T02:32:00.359 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_num_target": 1, 2026-02-13T02:32:00.360 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_placement_num": 1, 2026-02-13T02:32:00.360 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_placement_num_target": 1, 2026-02-13T02:32:00.360 INFO:tasks.ceph.mgr.y.trial121.stderr: "pool": 1, 2026-02-13T02:32:00.360 INFO:tasks.ceph.mgr.y.trial121.stderr: "pool_name": ".mgr", 2026-02-13T02:32:00.360 INFO:tasks.ceph.mgr.y.trial121.stderr: "pool_snaps": [], 2026-02-13T02:32:00.360 INFO:tasks.ceph.mgr.y.trial121.stderr: "quota_max_bytes": 0, 2026-02-13T02:32:00.360 INFO:tasks.ceph.mgr.y.trial121.stderr: "quota_max_objects": 0, 2026-02-13T02:32:00.360 INFO:tasks.ceph.mgr.y.trial121.stderr: "read_balance": { 2026-02-13T02:32:00.360 INFO:tasks.ceph.mgr.y.trial121.stderr: "average_primary_affinity": 1.0, 2026-02-13T02:32:00.360 INFO:tasks.ceph.mgr.y.trial121.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-13T02:32:00.360 INFO:tasks.ceph.mgr.y.trial121.stderr: "optimal_score": 0.25, 2026-02-13T02:32:00.360 INFO:tasks.ceph.mgr.y.trial121.stderr: "primary_affinity_weighted": 1.0, 2026-02-13T02:32:00.360 INFO:tasks.ceph.mgr.y.trial121.stderr: "raw_score_acting": 2.0, 2026-02-13T02:32:00.361 INFO:tasks.ceph.mgr.y.trial121.stderr: "raw_score_stable": 2.0, 2026-02-13T02:32:00.361 INFO:tasks.ceph.mgr.y.trial121.stderr: "score_acting": 8.0, 2026-02-13T02:32:00.361 INFO:tasks.ceph.mgr.y.trial121.stderr: "score_stable": 8.0, 2026-02-13T02:32:00.361 INFO:tasks.ceph.mgr.y.trial121.stderr: "score_type": "Fair distribution" 2026-02-13T02:32:00.361 INFO:tasks.ceph.mgr.y.trial121.stderr: }, 2026-02-13T02:32:00.361 INFO:tasks.ceph.mgr.y.trial121.stderr: "read_tier": -1, 2026-02-13T02:32:00.361 INFO:tasks.ceph.mgr.y.trial121.stderr: "removed_snaps": "[]", 2026-02-13T02:32:00.361 INFO:tasks.ceph.mgr.y.trial121.stderr: "size": 2, 2026-02-13T02:32:00.361 INFO:tasks.ceph.mgr.y.trial121.stderr: "snap_epoch": 0, 2026-02-13T02:32:00.361 INFO:tasks.ceph.mgr.y.trial121.stderr: "snap_mode": "selfmanaged", 2026-02-13T02:32:00.361 INFO:tasks.ceph.mgr.y.trial121.stderr: "snap_seq": 0, 2026-02-13T02:32:00.361 INFO:tasks.ceph.mgr.y.trial121.stderr: "stripe_width": 0, 2026-02-13T02:32:00.361 INFO:tasks.ceph.mgr.y.trial121.stderr: "target_max_bytes": 0, 2026-02-13T02:32:00.362 INFO:tasks.ceph.mgr.y.trial121.stderr: "target_max_objects": 0, 2026-02-13T02:32:00.362 INFO:tasks.ceph.mgr.y.trial121.stderr: "tier_of": -1, 2026-02-13T02:32:00.362 INFO:tasks.ceph.mgr.y.trial121.stderr: "tiers": [], 2026-02-13T02:32:00.362 INFO:tasks.ceph.mgr.y.trial121.stderr: "type": 1, 2026-02-13T02:32:00.362 INFO:tasks.ceph.mgr.y.trial121.stderr: "use_gmt_hitset": true, 2026-02-13T02:32:00.362 INFO:tasks.ceph.mgr.y.trial121.stderr: "write_tier": -1 2026-02-13T02:32:00.362 INFO:tasks.ceph.mgr.y.trial121.stderr: }, 2026-02-13T02:32:00.362 INFO:tasks.ceph.mgr.y.trial121.stderr: "cephfs_data": { 2026-02-13T02:32:00.362 INFO:tasks.ceph.mgr.y.trial121.stderr: "application_metadata": { 2026-02-13T02:32:00.362 INFO:tasks.ceph.mgr.y.trial121.stderr: "cephfs": { 2026-02-13T02:32:00.362 INFO:tasks.ceph.mgr.y.trial121.stderr: "data": "cephfs" 2026-02-13T02:32:00.362 INFO:tasks.ceph.mgr.y.trial121.stderr: } 2026-02-13T02:32:00.362 INFO:tasks.ceph.mgr.y.trial121.stderr: }, 2026-02-13T02:32:00.363 INFO:tasks.ceph.mgr.y.trial121.stderr: "auid": 0, 2026-02-13T02:32:00.363 INFO:tasks.ceph.mgr.y.trial121.stderr: "cache_min_evict_age": 0, 2026-02-13T02:32:00.363 INFO:tasks.ceph.mgr.y.trial121.stderr: "cache_min_flush_age": 0, 2026-02-13T02:32:00.363 INFO:tasks.ceph.mgr.y.trial121.stderr: "cache_mode": "none", 2026-02-13T02:32:00.363 INFO:tasks.ceph.mgr.y.trial121.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-13T02:32:00.363 INFO:tasks.ceph.mgr.y.trial121.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-13T02:32:00.363 INFO:tasks.ceph.mgr.y.trial121.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-13T02:32:00.363 INFO:tasks.ceph.mgr.y.trial121.stderr: "create_time": "2026-02-13T02:31:13.422523+0000", 2026-02-13T02:32:00.363 INFO:tasks.ceph.mgr.y.trial121.stderr: "crush_rule": 0, 2026-02-13T02:32:00.363 INFO:tasks.ceph.mgr.y.trial121.stderr: "erasure_code_profile": "", 2026-02-13T02:32:00.363 INFO:tasks.ceph.mgr.y.trial121.stderr: "expected_num_objects": 0, 2026-02-13T02:32:00.363 INFO:tasks.ceph.mgr.y.trial121.stderr: "fast_read": false, 2026-02-13T02:32:00.364 INFO:tasks.ceph.mgr.y.trial121.stderr: "flags": 1, 2026-02-13T02:32:00.364 INFO:tasks.ceph.mgr.y.trial121.stderr: "flags_names": "hashpspool", 2026-02-13T02:32:00.364 INFO:tasks.ceph.mgr.y.trial121.stderr: "grade_table": [], 2026-02-13T02:32:00.364 INFO:tasks.ceph.mgr.y.trial121.stderr: "hit_set_count": 0, 2026-02-13T02:32:00.364 INFO:tasks.ceph.mgr.y.trial121.stderr: "hit_set_grade_decay_rate": 0, 2026-02-13T02:32:00.364 INFO:tasks.ceph.mgr.y.trial121.stderr: "hit_set_params": { 2026-02-13T02:32:00.364 INFO:tasks.ceph.mgr.y.trial121.stderr: "type": "none" 2026-02-13T02:32:00.364 INFO:tasks.ceph.mgr.y.trial121.stderr: }, 2026-02-13T02:32:00.364 INFO:tasks.ceph.mgr.y.trial121.stderr: "hit_set_period": 0, 2026-02-13T02:32:00.364 INFO:tasks.ceph.mgr.y.trial121.stderr: "hit_set_search_last_n": 0, 2026-02-13T02:32:00.364 INFO:tasks.ceph.mgr.y.trial121.stderr: "is_stretch_pool": false, 2026-02-13T02:32:00.364 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_change": "20", 2026-02-13T02:32:00.364 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_force_op_resend": "0", 2026-02-13T02:32:00.365 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_force_op_resend_preluminous": "0", 2026-02-13T02:32:00.365 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-13T02:32:00.365 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_pg_merge_meta": { 2026-02-13T02:32:00.365 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_epoch_clean": 0, 2026-02-13T02:32:00.365 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_epoch_started": 0, 2026-02-13T02:32:00.365 INFO:tasks.ceph.mgr.y.trial121.stderr: "ready_epoch": 0, 2026-02-13T02:32:00.365 INFO:tasks.ceph.mgr.y.trial121.stderr: "source_pgid": "0.0", 2026-02-13T02:32:00.365 INFO:tasks.ceph.mgr.y.trial121.stderr: "source_version": "0'0", 2026-02-13T02:32:00.365 INFO:tasks.ceph.mgr.y.trial121.stderr: "target_version": "0'0" 2026-02-13T02:32:00.365 INFO:tasks.ceph.mgr.y.trial121.stderr: }, 2026-02-13T02:32:00.365 INFO:tasks.ceph.mgr.y.trial121.stderr: "min_read_recency_for_promote": 0, 2026-02-13T02:32:00.365 INFO:tasks.ceph.mgr.y.trial121.stderr: "min_size": 1, 2026-02-13T02:32:00.365 INFO:tasks.ceph.mgr.y.trial121.stderr: "min_write_recency_for_promote": 0, 2026-02-13T02:32:00.366 INFO:tasks.ceph.mgr.y.trial121.stderr: "nonprimary_shards": "{}", 2026-02-13T02:32:00.366 INFO:tasks.ceph.mgr.y.trial121.stderr: "object_hash": 2, 2026-02-13T02:32:00.366 INFO:tasks.ceph.mgr.y.trial121.stderr: "options": { 2026-02-13T02:32:00.366 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_num_min": 64, 2026-02-13T02:32:00.366 INFO:tasks.ceph.mgr.y.trial121.stderr: "target_size_ratio": 0.05000000074505806 2026-02-13T02:32:00.366 INFO:tasks.ceph.mgr.y.trial121.stderr: }, 2026-02-13T02:32:00.366 INFO:tasks.ceph.mgr.y.trial121.stderr: "peering_crush_bucket_barrier": 0, 2026-02-13T02:32:00.366 INFO:tasks.ceph.mgr.y.trial121.stderr: "peering_crush_bucket_count": 0, 2026-02-13T02:32:00.366 INFO:tasks.ceph.mgr.y.trial121.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-13T02:32:00.366 INFO:tasks.ceph.mgr.y.trial121.stderr: "peering_crush_bucket_target": 0, 2026-02-13T02:32:00.366 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_autoscale_mode": "off", 2026-02-13T02:32:00.366 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_num": 64, 2026-02-13T02:32:00.366 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_num_pending": 64, 2026-02-13T02:32:00.367 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_num_target": 64, 2026-02-13T02:32:00.367 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_placement_num": 64, 2026-02-13T02:32:00.367 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_placement_num_target": 64, 2026-02-13T02:32:00.367 INFO:tasks.ceph.mgr.y.trial121.stderr: "pool": 3, 2026-02-13T02:32:00.367 INFO:tasks.ceph.mgr.y.trial121.stderr: "pool_name": "cephfs_data", 2026-02-13T02:32:00.367 INFO:tasks.ceph.mgr.y.trial121.stderr: "pool_snaps": [], 2026-02-13T02:32:00.367 INFO:tasks.ceph.mgr.y.trial121.stderr: "quota_max_bytes": 0, 2026-02-13T02:32:00.367 INFO:tasks.ceph.mgr.y.trial121.stderr: "quota_max_objects": 0, 2026-02-13T02:32:00.367 INFO:tasks.ceph.mgr.y.trial121.stderr: "read_balance": { 2026-02-13T02:32:00.367 INFO:tasks.ceph.mgr.y.trial121.stderr: "average_primary_affinity": 1.0, 2026-02-13T02:32:00.367 INFO:tasks.ceph.mgr.y.trial121.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-13T02:32:00.367 INFO:tasks.ceph.mgr.y.trial121.stderr: "optimal_score": 1.0, 2026-02-13T02:32:00.367 INFO:tasks.ceph.mgr.y.trial121.stderr: "primary_affinity_weighted": 1.0, 2026-02-13T02:32:00.368 INFO:tasks.ceph.mgr.y.trial121.stderr: "raw_score_acting": 1.5, 2026-02-13T02:32:00.368 INFO:tasks.ceph.mgr.y.trial121.stderr: "raw_score_stable": 1.5, 2026-02-13T02:32:00.368 INFO:tasks.ceph.mgr.y.trial121.stderr: "score_acting": 1.5, 2026-02-13T02:32:00.368 INFO:tasks.ceph.mgr.y.trial121.stderr: "score_stable": 1.5, 2026-02-13T02:32:00.368 INFO:tasks.ceph.mgr.y.trial121.stderr: "score_type": "Fair distribution" 2026-02-13T02:32:00.368 INFO:tasks.ceph.mgr.y.trial121.stderr: }, 2026-02-13T02:32:00.368 INFO:tasks.ceph.mgr.y.trial121.stderr: "read_tier": -1, 2026-02-13T02:32:00.368 INFO:tasks.ceph.mgr.y.trial121.stderr: "removed_snaps": "[]", 2026-02-13T02:32:00.368 INFO:tasks.ceph.mgr.y.trial121.stderr: "size": 2, 2026-02-13T02:32:00.368 INFO:tasks.ceph.mgr.y.trial121.stderr: "snap_epoch": 0, 2026-02-13T02:32:00.369 INFO:tasks.ceph.mgr.y.trial121.stderr: "snap_mode": "selfmanaged", 2026-02-13T02:32:00.369 INFO:tasks.ceph.mgr.y.trial121.stderr: "snap_seq": 0, 2026-02-13T02:32:00.369 INFO:tasks.ceph.mgr.y.trial121.stderr: "stripe_width": 0, 2026-02-13T02:32:00.369 INFO:tasks.ceph.mgr.y.trial121.stderr: "target_max_bytes": 0, 2026-02-13T02:32:00.369 INFO:tasks.ceph.mgr.y.trial121.stderr: "target_max_objects": 0, 2026-02-13T02:32:00.369 INFO:tasks.ceph.mgr.y.trial121.stderr: "tier_of": -1, 2026-02-13T02:32:00.369 INFO:tasks.ceph.mgr.y.trial121.stderr: "tiers": [], 2026-02-13T02:32:00.369 INFO:tasks.ceph.mgr.y.trial121.stderr: "type": 1, 2026-02-13T02:32:00.369 INFO:tasks.ceph.mgr.y.trial121.stderr: "use_gmt_hitset": true, 2026-02-13T02:32:00.369 INFO:tasks.ceph.mgr.y.trial121.stderr: "write_tier": -1 2026-02-13T02:32:00.369 INFO:tasks.ceph.mgr.y.trial121.stderr: }, 2026-02-13T02:32:00.369 INFO:tasks.ceph.mgr.y.trial121.stderr: "cephfs_data_ec": { 2026-02-13T02:32:00.369 INFO:tasks.ceph.mgr.y.trial121.stderr: "application_metadata": { 2026-02-13T02:32:00.370 INFO:tasks.ceph.mgr.y.trial121.stderr: "cephfs": { 2026-02-13T02:32:00.370 INFO:tasks.ceph.mgr.y.trial121.stderr: "data": "cephfs" 2026-02-13T02:32:00.370 INFO:tasks.ceph.mgr.y.trial121.stderr: } 2026-02-13T02:32:00.370 INFO:tasks.ceph.mgr.y.trial121.stderr: }, 2026-02-13T02:32:00.370 INFO:tasks.ceph.mgr.y.trial121.stderr: "auid": 0, 2026-02-13T02:32:00.370 INFO:tasks.ceph.mgr.y.trial121.stderr: "cache_min_evict_age": 0, 2026-02-13T02:32:00.370 INFO:tasks.ceph.mgr.y.trial121.stderr: "cache_min_flush_age": 0, 2026-02-13T02:32:00.370 INFO:tasks.ceph.mgr.y.trial121.stderr: "cache_mode": "none", 2026-02-13T02:32:00.370 INFO:tasks.ceph.mgr.y.trial121.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-13T02:32:00.370 INFO:tasks.ceph.mgr.y.trial121.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-13T02:32:00.370 INFO:tasks.ceph.mgr.y.trial121.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-13T02:32:00.370 INFO:tasks.ceph.mgr.y.trial121.stderr: "create_time": "2026-02-13T02:31:17.275198+0000", 2026-02-13T02:32:00.370 INFO:tasks.ceph.mgr.y.trial121.stderr: "crush_rule": 1, 2026-02-13T02:32:00.371 INFO:tasks.ceph.mgr.y.trial121.stderr: "erasure_code_profile": "cephfs_data_ec", 2026-02-13T02:32:00.371 INFO:tasks.ceph.mgr.y.trial121.stderr: "expected_num_objects": 0, 2026-02-13T02:32:00.371 INFO:tasks.ceph.mgr.y.trial121.stderr: "fast_read": false, 2026-02-13T02:32:00.371 INFO:tasks.ceph.mgr.y.trial121.stderr: "flags": 5, 2026-02-13T02:32:00.371 INFO:tasks.ceph.mgr.y.trial121.stderr: "flags_names": "hashpspool,ec_overwrites", 2026-02-13T02:32:00.371 INFO:tasks.ceph.mgr.y.trial121.stderr: "grade_table": [], 2026-02-13T02:32:00.371 INFO:tasks.ceph.mgr.y.trial121.stderr: "hit_set_count": 0, 2026-02-13T02:32:00.371 INFO:tasks.ceph.mgr.y.trial121.stderr: "hit_set_grade_decay_rate": 0, 2026-02-13T02:32:00.371 INFO:tasks.ceph.mgr.y.trial121.stderr: "hit_set_params": { 2026-02-13T02:32:00.371 INFO:tasks.ceph.mgr.y.trial121.stderr: "type": "none" 2026-02-13T02:32:00.371 INFO:tasks.ceph.mgr.y.trial121.stderr: }, 2026-02-13T02:32:00.371 INFO:tasks.ceph.mgr.y.trial121.stderr: "hit_set_period": 0, 2026-02-13T02:32:00.371 INFO:tasks.ceph.mgr.y.trial121.stderr: "hit_set_search_last_n": 0, 2026-02-13T02:32:00.372 INFO:tasks.ceph.mgr.y.trial121.stderr: "is_stretch_pool": false, 2026-02-13T02:32:00.372 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_change": "24", 2026-02-13T02:32:00.372 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_force_op_resend": "0", 2026-02-13T02:32:00.372 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_force_op_resend_preluminous": "0", 2026-02-13T02:32:00.372 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-13T02:32:00.372 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_pg_merge_meta": { 2026-02-13T02:32:00.372 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_epoch_clean": 0, 2026-02-13T02:32:00.372 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_epoch_started": 0, 2026-02-13T02:32:00.372 INFO:tasks.ceph.mgr.y.trial121.stderr: "ready_epoch": 0, 2026-02-13T02:32:00.372 INFO:tasks.ceph.mgr.y.trial121.stderr: "source_pgid": "0.0", 2026-02-13T02:32:00.372 INFO:tasks.ceph.mgr.y.trial121.stderr: "source_version": "0'0", 2026-02-13T02:32:00.372 INFO:tasks.ceph.mgr.y.trial121.stderr: "target_version": "0'0" 2026-02-13T02:32:00.373 INFO:tasks.ceph.mgr.y.trial121.stderr: }, 2026-02-13T02:32:00.373 INFO:tasks.ceph.mgr.y.trial121.stderr: "min_read_recency_for_promote": 0, 2026-02-13T02:32:00.373 INFO:tasks.ceph.mgr.y.trial121.stderr: "min_size": 3, 2026-02-13T02:32:00.373 INFO:tasks.ceph.mgr.y.trial121.stderr: "min_write_recency_for_promote": 0, 2026-02-13T02:32:00.373 INFO:tasks.ceph.mgr.y.trial121.stderr: "nonprimary_shards": "{}", 2026-02-13T02:32:00.373 INFO:tasks.ceph.mgr.y.trial121.stderr: "object_hash": 2, 2026-02-13T02:32:00.373 INFO:tasks.ceph.mgr.y.trial121.stderr: "options": { 2026-02-13T02:32:00.373 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_num_min": 64, 2026-02-13T02:32:00.373 INFO:tasks.ceph.mgr.y.trial121.stderr: "target_size_ratio": 0.8999999761581421 2026-02-13T02:32:00.373 INFO:tasks.ceph.mgr.y.trial121.stderr: }, 2026-02-13T02:32:00.373 INFO:tasks.ceph.mgr.y.trial121.stderr: "peering_crush_bucket_barrier": 0, 2026-02-13T02:32:00.374 INFO:tasks.ceph.mgr.y.trial121.stderr: "peering_crush_bucket_count": 0, 2026-02-13T02:32:00.374 INFO:tasks.ceph.mgr.y.trial121.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-13T02:32:00.374 INFO:tasks.ceph.mgr.y.trial121.stderr: "peering_crush_bucket_target": 0, 2026-02-13T02:32:00.374 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_autoscale_mode": "off", 2026-02-13T02:32:00.374 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_num": 32, 2026-02-13T02:32:00.374 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_num_pending": 32, 2026-02-13T02:32:00.374 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_num_target": 32, 2026-02-13T02:32:00.374 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_placement_num": 32, 2026-02-13T02:32:00.374 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_placement_num_target": 32, 2026-02-13T02:32:00.374 INFO:tasks.ceph.mgr.y.trial121.stderr: "pool": 4, 2026-02-13T02:32:00.374 INFO:tasks.ceph.mgr.y.trial121.stderr: "pool_name": "cephfs_data_ec", 2026-02-13T02:32:00.374 INFO:tasks.ceph.mgr.y.trial121.stderr: "pool_snaps": [], 2026-02-13T02:32:00.374 INFO:tasks.ceph.mgr.y.trial121.stderr: "quota_max_bytes": 0, 2026-02-13T02:32:00.375 INFO:tasks.ceph.mgr.y.trial121.stderr: "quota_max_objects": 0, 2026-02-13T02:32:00.375 INFO:tasks.ceph.mgr.y.trial121.stderr: "read_tier": -1, 2026-02-13T02:32:00.375 INFO:tasks.ceph.mgr.y.trial121.stderr: "removed_snaps": "[]", 2026-02-13T02:32:00.375 INFO:tasks.ceph.mgr.y.trial121.stderr: "size": 4, 2026-02-13T02:32:00.375 INFO:tasks.ceph.mgr.y.trial121.stderr: "snap_epoch": 0, 2026-02-13T02:32:00.375 INFO:tasks.ceph.mgr.y.trial121.stderr: "snap_mode": "selfmanaged", 2026-02-13T02:32:00.375 INFO:tasks.ceph.mgr.y.trial121.stderr: "snap_seq": 0, 2026-02-13T02:32:00.375 INFO:tasks.ceph.mgr.y.trial121.stderr: "stripe_width": 8192, 2026-02-13T02:32:00.375 INFO:tasks.ceph.mgr.y.trial121.stderr: "target_max_bytes": 0, 2026-02-13T02:32:00.375 INFO:tasks.ceph.mgr.y.trial121.stderr: "target_max_objects": 0, 2026-02-13T02:32:00.375 INFO:tasks.ceph.mgr.y.trial121.stderr: "tier_of": -1, 2026-02-13T02:32:00.375 INFO:tasks.ceph.mgr.y.trial121.stderr: "tiers": [], 2026-02-13T02:32:00.376 INFO:tasks.ceph.mgr.y.trial121.stderr: "type": 3, 2026-02-13T02:32:00.376 INFO:tasks.ceph.mgr.y.trial121.stderr: "use_gmt_hitset": true, 2026-02-13T02:32:00.376 INFO:tasks.ceph.mgr.y.trial121.stderr: "write_tier": -1 2026-02-13T02:32:00.376 INFO:tasks.ceph.mgr.y.trial121.stderr: }, 2026-02-13T02:32:00.376 INFO:tasks.ceph.mgr.y.trial121.stderr: "cephfs_metadata": { 2026-02-13T02:32:00.376 INFO:tasks.ceph.mgr.y.trial121.stderr: "application_metadata": { 2026-02-13T02:32:00.376 INFO:tasks.ceph.mgr.y.trial121.stderr: "cephfs": { 2026-02-13T02:32:00.376 INFO:tasks.ceph.mgr.y.trial121.stderr: "metadata": "cephfs" 2026-02-13T02:32:00.376 INFO:tasks.ceph.mgr.y.trial121.stderr: } 2026-02-13T02:32:00.376 INFO:tasks.ceph.mgr.y.trial121.stderr: }, 2026-02-13T02:32:00.376 INFO:tasks.ceph.mgr.y.trial121.stderr: "auid": 0, 2026-02-13T02:32:00.376 INFO:tasks.ceph.mgr.y.trial121.stderr: "cache_min_evict_age": 0, 2026-02-13T02:32:00.376 INFO:tasks.ceph.mgr.y.trial121.stderr: "cache_min_flush_age": 0, 2026-02-13T02:32:00.377 INFO:tasks.ceph.mgr.y.trial121.stderr: "cache_mode": "none", 2026-02-13T02:32:00.377 INFO:tasks.ceph.mgr.y.trial121.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-13T02:32:00.377 INFO:tasks.ceph.mgr.y.trial121.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-13T02:32:00.377 INFO:tasks.ceph.mgr.y.trial121.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-13T02:32:00.377 INFO:tasks.ceph.mgr.y.trial121.stderr: "create_time": "2026-02-13T02:31:12.964909+0000", 2026-02-13T02:32:00.377 INFO:tasks.ceph.mgr.y.trial121.stderr: "crush_rule": 0, 2026-02-13T02:32:00.377 INFO:tasks.ceph.mgr.y.trial121.stderr: "erasure_code_profile": "", 2026-02-13T02:32:00.377 INFO:tasks.ceph.mgr.y.trial121.stderr: "expected_num_objects": 0, 2026-02-13T02:32:00.377 INFO:tasks.ceph.mgr.y.trial121.stderr: "fast_read": false, 2026-02-13T02:32:00.377 INFO:tasks.ceph.mgr.y.trial121.stderr: "flags": 1, 2026-02-13T02:32:00.377 INFO:tasks.ceph.mgr.y.trial121.stderr: "flags_names": "hashpspool", 2026-02-13T02:32:00.377 INFO:tasks.ceph.mgr.y.trial121.stderr: "grade_table": [], 2026-02-13T02:32:00.377 INFO:tasks.ceph.mgr.y.trial121.stderr: "hit_set_count": 0, 2026-02-13T02:32:00.378 INFO:tasks.ceph.mgr.y.trial121.stderr: "hit_set_grade_decay_rate": 0, 2026-02-13T02:32:00.378 INFO:tasks.ceph.mgr.y.trial121.stderr: "hit_set_params": { 2026-02-13T02:32:00.378 INFO:tasks.ceph.mgr.y.trial121.stderr: "type": "none" 2026-02-13T02:32:00.378 INFO:tasks.ceph.mgr.y.trial121.stderr: }, 2026-02-13T02:32:00.378 INFO:tasks.ceph.mgr.y.trial121.stderr: "hit_set_period": 0, 2026-02-13T02:32:00.378 INFO:tasks.ceph.mgr.y.trial121.stderr: "hit_set_search_last_n": 0, 2026-02-13T02:32:00.378 INFO:tasks.ceph.mgr.y.trial121.stderr: "is_stretch_pool": false, 2026-02-13T02:32:00.378 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_change": "19", 2026-02-13T02:32:00.378 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_force_op_resend": "0", 2026-02-13T02:32:00.378 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_force_op_resend_preluminous": "0", 2026-02-13T02:32:00.378 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-13T02:32:00.378 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_pg_merge_meta": { 2026-02-13T02:32:00.379 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_epoch_clean": 0, 2026-02-13T02:32:00.379 INFO:tasks.ceph.mgr.y.trial121.stderr: "last_epoch_started": 0, 2026-02-13T02:32:00.379 INFO:tasks.ceph.mgr.y.trial121.stderr: "ready_epoch": 0, 2026-02-13T02:32:00.379 INFO:tasks.ceph.mgr.y.trial121.stderr: "source_pgid": "0.0", 2026-02-13T02:32:00.379 INFO:tasks.ceph.mgr.y.trial121.stderr: "source_version": "0'0", 2026-02-13T02:32:00.379 INFO:tasks.ceph.mgr.y.trial121.stderr: "target_version": "0'0" 2026-02-13T02:32:00.379 INFO:tasks.ceph.mgr.y.trial121.stderr: }, 2026-02-13T02:32:00.379 INFO:tasks.ceph.mgr.y.trial121.stderr: "min_read_recency_for_promote": 0, 2026-02-13T02:32:00.379 INFO:tasks.ceph.mgr.y.trial121.stderr: "min_size": 1, 2026-02-13T02:32:00.379 INFO:tasks.ceph.mgr.y.trial121.stderr: "min_write_recency_for_promote": 0, 2026-02-13T02:32:00.379 INFO:tasks.ceph.mgr.y.trial121.stderr: "nonprimary_shards": "{}", 2026-02-13T02:32:00.379 INFO:tasks.ceph.mgr.y.trial121.stderr: "object_hash": 2, 2026-02-13T02:32:00.379 INFO:tasks.ceph.mgr.y.trial121.stderr: "options": { 2026-02-13T02:32:00.380 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_autoscale_bias": 4.0, 2026-02-13T02:32:00.380 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_num_min": 16, 2026-02-13T02:32:00.380 INFO:tasks.ceph.mgr.y.trial121.stderr: "recovery_priority": 5 2026-02-13T02:32:00.380 INFO:tasks.ceph.mgr.y.trial121.stderr: }, 2026-02-13T02:32:00.380 INFO:tasks.ceph.mgr.y.trial121.stderr: "peering_crush_bucket_barrier": 0, 2026-02-13T02:32:00.380 INFO:tasks.ceph.mgr.y.trial121.stderr: "peering_crush_bucket_count": 0, 2026-02-13T02:32:00.380 INFO:tasks.ceph.mgr.y.trial121.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-13T02:32:00.380 INFO:tasks.ceph.mgr.y.trial121.stderr: "peering_crush_bucket_target": 0, 2026-02-13T02:32:00.380 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_autoscale_mode": "off", 2026-02-13T02:32:00.380 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_num": 32, 2026-02-13T02:32:00.380 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_num_pending": 32, 2026-02-13T02:32:00.380 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_num_target": 32, 2026-02-13T02:32:00.380 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_placement_num": 32, 2026-02-13T02:32:00.381 INFO:tasks.ceph.mgr.y.trial121.stderr: "pg_placement_num_target": 32, 2026-02-13T02:32:00.381 INFO:tasks.ceph.mgr.y.trial121.stderr: "pool": 2, 2026-02-13T02:32:00.381 INFO:tasks.ceph.mgr.y.trial121.stderr: "pool_name": "cephfs_metadata", 2026-02-13T02:32:00.381 INFO:tasks.ceph.mgr.y.trial121.stderr: "pool_snaps": [], 2026-02-13T02:32:00.381 INFO:tasks.ceph.mgr.y.trial121.stderr: "quota_max_bytes": 0, 2026-02-13T02:32:00.381 INFO:tasks.ceph.mgr.y.trial121.stderr: "quota_max_objects": 0, 2026-02-13T02:32:00.381 INFO:tasks.ceph.mgr.y.trial121.stderr: "read_balance": { 2026-02-13T02:32:00.381 INFO:tasks.ceph.mgr.y.trial121.stderr: "average_primary_affinity": 1.0, 2026-02-13T02:32:00.381 INFO:tasks.ceph.mgr.y.trial121.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-13T02:32:00.381 INFO:tasks.ceph.mgr.y.trial121.stderr: "optimal_score": 1.0, 2026-02-13T02:32:00.381 INFO:tasks.ceph.mgr.y.trial121.stderr: "primary_affinity_weighted": 1.0, 2026-02-13T02:32:00.381 INFO:tasks.ceph.mgr.y.trial121.stderr: "raw_score_acting": 1.5, 2026-02-13T02:32:00.381 INFO:tasks.ceph.mgr.y.trial121.stderr: "raw_score_stable": 1.5, 2026-02-13T02:32:00.382 INFO:tasks.ceph.mgr.y.trial121.stderr: "score_acting": 1.5, 2026-02-13T02:32:00.382 INFO:tasks.ceph.mgr.y.trial121.stderr: "score_stable": 1.5, 2026-02-13T02:32:00.382 INFO:tasks.ceph.mgr.y.trial121.stderr: "score_type": "Fair distribution" 2026-02-13T02:32:00.382 INFO:tasks.ceph.mgr.y.trial121.stderr: }, 2026-02-13T02:32:00.382 INFO:tasks.ceph.mgr.y.trial121.stderr: "read_tier": -1, 2026-02-13T02:32:00.382 INFO:tasks.ceph.mgr.y.trial121.stderr: "removed_snaps": "[]", 2026-02-13T02:32:00.382 INFO:tasks.ceph.mgr.y.trial121.stderr: "size": 2, 2026-02-13T02:32:00.382 INFO:tasks.ceph.mgr.y.trial121.stderr: "snap_epoch": 0, 2026-02-13T02:32:00.382 INFO:tasks.ceph.mgr.y.trial121.stderr: "snap_mode": "selfmanaged", 2026-02-13T02:32:00.382 INFO:tasks.ceph.mgr.y.trial121.stderr: "snap_seq": 0, 2026-02-13T02:32:00.382 INFO:tasks.ceph.mgr.y.trial121.stderr: "stripe_width": 0, 2026-02-13T02:32:00.382 INFO:tasks.ceph.mgr.y.trial121.stderr: "target_max_bytes": 0, 2026-02-13T02:32:00.382 INFO:tasks.ceph.mgr.y.trial121.stderr: "target_max_objects": 0, 2026-02-13T02:32:00.383 INFO:tasks.ceph.mgr.y.trial121.stderr: "tier_of": -1, 2026-02-13T02:32:00.383 INFO:tasks.ceph.mgr.y.trial121.stderr: "tiers": [], 2026-02-13T02:32:00.383 INFO:tasks.ceph.mgr.y.trial121.stderr: "type": 1, 2026-02-13T02:32:00.383 INFO:tasks.ceph.mgr.y.trial121.stderr: "use_gmt_hitset": true, 2026-02-13T02:32:00.383 INFO:tasks.ceph.mgr.y.trial121.stderr: "write_tier": -1 2026-02-13T02:32:00.383 INFO:tasks.ceph.mgr.y.trial121.stderr: } 2026-02-13T02:32:00.383 INFO:tasks.ceph.mgr.y.trial121.stderr:} 2026-02-13T02:32:00.386 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:ceph osd pg-upmap-items 3.17 mappings [{'from': 0, 'to': 2}] 2026-02-13T02:32:00.387 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:root_ids [-1, -1, -1, -1] pools [1, 2, 3, 4] with 8 osds, pg_target 800 2026-02-13T02:32:00.387 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:effective_target_ratio 0.0 0.9499999769032001 0 773094113280 2026-02-13T02:32:00.387 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:Pool '.mgr' root_id -1 using 1.5364752875434028e-06 of space, bias 1.0, pg target 0.0006145901150173611 quantized to 1 (current 1) 2026-02-13T02:32:00.387 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:effective_target_ratio 0.0 0.9499999769032001 0 773094113280 2026-02-13T02:32:00.387 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:Pool 'cephfs_metadata' root_id -1 using 1.2576088516248598e-07 of space, bias 4.0, pg target 0.00020121741625997756 quantized to 16 (current 32) 2026-02-13T02:32:00.387 INFO:tasks.ceph.mgr.y.trial121.stderr:WARNING:root:pool cephfs_metadata won't scale because recommended PG_NUM target value varies from current PG_NUM value by more than '3.000000' scaling threshold 2026-02-13T02:32:00.387 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:effective_target_ratio 0.05000000074505806 0.9499999769032001 0 773094113280 2026-02-13T02:32:00.387 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:Pool 'cephfs_data' root_id -1 using 0.05263158101124121 of space, bias 1.0, pg target 21.052632404496485 quantized to 64 (current 64) 2026-02-13T02:32:00.387 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:effective_target_ratio 0.8999999761581421 0.9499999769032001 0 773094113280 2026-02-13T02:32:00.387 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:Pool 'cephfs_data_ec' root_id -1 using 0.9473684189887588 of space, bias 1.0, pg target 179.5263153983698 quantized to 128 (current 32) 2026-02-13T02:32:00.387 INFO:tasks.ceph.mgr.y.trial121.stderr:WARNING:root:pool cephfs_data_ec won't scale because recommended PG_NUM target value varies from current PG_NUM value by more than '3.000000' scaling threshold 2026-02-13T02:32:00.387 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: refresh_images 2026-02-13T02:32:00.387 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:MirrorSnapshotScheduleHandler: load_schedules 2026-02-13T02:32:00.388 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: no schedules 2026-02-13T02:32:00.388 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-13T02:32:00.388 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-13T02:32:00.388 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:TrashPurgeScheduleHandler: refresh_pools 2026-02-13T02:32:00.388 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:TrashPurgeScheduleHandler: load_schedules 2026-02-13T02:32:00.388 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:TrashPurgeScheduleHandler: no schedules 2026-02-13T02:32:00.388 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:ceph osd pg-upmap-items 3.1d mappings [{'from': 5, 'to': 1}] 2026-02-13T02:32:00.388 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:ceph osd pg-upmap-items 3.2d mappings [{'from': 7, 'to': 1}] 2026-02-13T02:32:00.388 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:ceph osd pg-upmap-items 3.36 mappings [{'from': 5, 'to': 2}] 2026-02-13T02:32:00.388 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-13T02:32:00.388 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-13T02:32:00.388 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:ceph osd pg-upmap-items 4.a mappings [{'from': 1, 'to': 2}] 2026-02-13T02:32:00.388 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:ceph osd pg-upmap-items 4.f mappings [{'from': 1, 'to': 2}] 2026-02-13T02:32:00.388 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:root:ceph osd pg-upmap-items 4.1b mappings [{'from': 1, 'to': 2}] 2026-02-13T02:32:00.389 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:commands [, , , , , , , ] 2026-02-13T02:32:00.389 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:PerfHandler: tick 2026-02-13T02:32:00.389 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:TaskHandler: tick 2026-02-13T02:32:00.389 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-13T02:32:00.389 INFO:tasks.ceph.mgr.y.trial121.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-13T02:32:00.411 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:done 2026-02-13T02:32:00.411 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:Sleeping for 60 2026-02-13T02:32:00.472 WARNING:tasks.cephfs.fuse_mount:Trying to clean up after failed mount 2026-02-13T02:32:00.472 DEBUG:teuthology.orchestra.run.trial121:> set -ex 2026-02-13T02:32:00.472 DEBUG:teuthology.orchestra.run.trial121:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-13T02:32:00.478 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=65421852k,nr_inodes=16355463,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=13096172k,mode=755,inode64 0 0 /dev/nvme0n1p2 / ext4 rw,relatime 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 efivarfs /sys/firmware/efi/efivars efivarfs rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=22093 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/loop0 /snap/core20/2686 squashfs ro,nodev,relatime,errors=continue 0 0 /dev/loop1 /snap/lxd/36918 squashfs ro,nodev,relatime,errors=continue 0 0 /dev/loop2 /snap/snapd/25935 squashfs ro,nodev,relatime,errors=continue 0 0 /dev/nvme0n1p1 /boot/efi vfat rw,relatime,fmask=0022,dmask=0022,codepage=437,iocharset=iso8859-1,shortname=mixed,errors=remount-ro 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/snapd/ns tmpfs rw,nosuid,nodev,noexec,relatime,size=13096172k,mode=755,inode64 0 0 nsfs /run/snapd/ns/lxd.mnt nsfs rw 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=13096168k,nr_inodes=3274042,mode=700,uid=1000,gid=1002,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=13096172k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin nsfs rw 0 0 2026-02-13T02:32:00.478 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.admin is not mounted at ubuntu@trial121.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.admin 2026-02-13T02:32:00.479 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@trial121.front.sepia.ceph.com 2026-02-13T02:32:00.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-13T02:32:00.479 DEBUG:teuthology.orchestra.run.trial121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2026-02-13T02:32:00.524 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/contextutil.py", line 30, in nested vars.append(enter()) ^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/ceph.py", line 518, in cephfs_setup fs = Filesystem(ctx, fs_config=temp, name=name, create=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephfs/filesystem.py", line 574, in __init__ self.create(**kwargs) File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephfs/filesystem.py", line 795, in create self.run_client_payload(f"setfattr -n ceph.dir.layout.pool -v {ec_data_pool_name} . && getfattr -n ceph.dir.layout .") File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephfs/filesystem.py", line 881, in run_client_payload m.mount_wait() File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephfs/mount.py", line 527, in mount_wait self.mount(**kwargs) File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephfs/fuse_mount.py", line 52, in mount return self._mount(mntopts, mntargs, check_status) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephfs/fuse_mount.py", line 68, in _mount retval = self._run_mount_cmd(mntopts, mntargs, check_status) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephfs/fuse_mount.py", line 94, in _run_mount_cmd return self._wait_and_record_our_fuse_conn( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephfs/fuse_mount.py", line 189, in _wait_and_record_our_fuse_conn raise RuntimeError( RuntimeError: Fuse mount failed to populate/sys/ after 31 seconds 2026-02-13T02:32:00.527 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-13T02:32:00.527 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2026-02-13T02:32:00.527 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T02:32:00.577 INFO:tasks.ceph.mds.a:Stopped 2026-02-13T02:32:00.577 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2026-02-13T02:32:00.577 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T02:32:00.629 INFO:tasks.ceph.mds.c:Stopped 2026-02-13T02:32:00.629 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2026-02-13T02:32:00.629 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T02:32:00.641 INFO:tasks.ceph.mds.b:Stopped 2026-02-13T02:32:00.642 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2026-02-13T02:32:00.642 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T02:32:00.692 INFO:tasks.ceph.mds.d:Stopped 2026-02-13T02:32:00.692 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-13T02:32:00.692 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-13T02:32:00.692 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T02:32:00.772 INFO:tasks.ceph.osd.0:Stopped 2026-02-13T02:32:00.772 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-13T02:32:00.772 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T02:32:00.864 INFO:tasks.ceph.osd.1:Stopped 2026-02-13T02:32:00.864 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-13T02:32:00.864 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T02:32:00.952 INFO:tasks.ceph.osd.2:Stopped 2026-02-13T02:32:00.952 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-13T02:32:00.952 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T02:32:01.035 INFO:tasks.ceph.osd.3:Stopped 2026-02-13T02:32:01.036 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-13T02:32:01.036 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T02:32:01.095 INFO:tasks.ceph.osd.4:Stopped 2026-02-13T02:32:01.095 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-13T02:32:01.095 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T02:32:04.266 DEBUG:teuthology.orchestra.run.trial121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-13T02:32:04.268 DEBUG:teuthology.orchestra.run.trial178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-13T02:32:05.360 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:PerfHandler: tick 2026-02-13T02:32:05.360 INFO:tasks.ceph.mgr.y.trial121.stderr:DEBUG:root:TaskHandler: tick 2026-02-13T02:32:07.197 INFO:tasks.ceph.osd.5:Stopped 2026-02-13T02:32:07.197 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2026-02-13T02:32:07.197 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T02:32:07.265 INFO:tasks.ceph.osd.6:Stopped 2026-02-13T02:32:07.265 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2026-02-13T02:32:07.265 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T02:32:07.331 INFO:tasks.ceph.osd.7:Stopped 2026-02-13T02:32:07.332 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-13T02:32:07.332 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-13T02:32:07.333 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T02:32:07.356 INFO:tasks.ceph.mgr.y:Stopped 2026-02-13T02:32:07.356 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-13T02:32:07.356 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T02:32:07.370 INFO:tasks.ceph.mgr.x:Stopped 2026-02-13T02:32:07.371 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-13T02:32:07.371 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-13T02:32:07.371 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T02:32:07.416 INFO:tasks.ceph.mon.a:Stopped 2026-02-13T02:32:07.416 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-13T02:32:07.416 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T02:32:07.429 INFO:tasks.ceph.mon.b:Stopped 2026-02-13T02:32:07.430 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-13T02:32:07.430 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T02:32:07.482 INFO:tasks.ceph.mon.c:Stopped 2026-02-13T02:32:07.482 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-13T02:32:07.483 DEBUG:teuthology.orchestra.run.trial121:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'inode wrongly marked free' | grep -E -v 'bad backtrace on inode' | grep -E -v 'inode table repaired for inode' | grep -E -v 'Scrub error on inode' | grep -E -v 'Scrub error on dir' | grep -E -v 'Metadata damage detected' | grep -E -v 'object missing on disk' | grep -E -v 'Invalid tag char' | head -n 1 2026-02-13T02:32:07.493 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial121.front.sepia.ceph.com 2026-02-13T02:32:07.494 DEBUG:teuthology.orchestra.run.trial121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-13T02:32:07.547 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial121.front.sepia.ceph.com 2026-02-13T02:32:07.547 DEBUG:teuthology.orchestra.run.trial121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-13T02:32:07.606 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial121.front.sepia.ceph.com 2026-02-13T02:32:07.606 DEBUG:teuthology.orchestra.run.trial121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-13T02:32:07.661 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial121.front.sepia.ceph.com 2026-02-13T02:32:07.662 DEBUG:teuthology.orchestra.run.trial121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-13T02:32:07.713 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial178.front.sepia.ceph.com 2026-02-13T02:32:07.713 DEBUG:teuthology.orchestra.run.trial178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-13T02:32:07.732 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial178.front.sepia.ceph.com 2026-02-13T02:32:07.732 DEBUG:teuthology.orchestra.run.trial178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-13T02:32:07.785 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@trial178.front.sepia.ceph.com 2026-02-13T02:32:07.785 DEBUG:teuthology.orchestra.run.trial178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2026-02-13T02:32:07.836 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@trial178.front.sepia.ceph.com 2026-02-13T02:32:07.836 DEBUG:teuthology.orchestra.run.trial178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2026-02-13T02:32:07.892 INFO:tasks.ceph:Archiving mon data... 2026-02-13T02:32:07.895 DEBUG:teuthology.misc:Transferring archived files from trial121:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48001/data/mon.a.tgz 2026-02-13T02:32:07.895 DEBUG:teuthology.orchestra.run.trial121:> mktemp 2026-02-13T02:32:07.900 INFO:teuthology.orchestra.run.trial121.stdout:/tmp/tmp.Ye8UyZnSIf 2026-02-13T02:32:07.900 DEBUG:teuthology.orchestra.run.trial121:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Ye8UyZnSIf 2026-02-13T02:32:07.981 DEBUG:teuthology.orchestra.run.trial121:> sudo chmod 0666 /tmp/tmp.Ye8UyZnSIf 2026-02-13T02:32:08.076 DEBUG:teuthology.orchestra.remote:trial121:/tmp/tmp.Ye8UyZnSIf is 257KB 2026-02-13T02:32:08.132 DEBUG:teuthology.orchestra.run.trial121:> rm -fr /tmp/tmp.Ye8UyZnSIf 2026-02-13T02:32:08.137 DEBUG:teuthology.misc:Transferring archived files from trial178:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48001/data/mon.b.tgz 2026-02-13T02:32:08.137 DEBUG:teuthology.orchestra.run.trial178:> mktemp 2026-02-13T02:32:08.142 INFO:teuthology.orchestra.run.trial178.stdout:/tmp/tmp.UWEz7GHMEq 2026-02-13T02:32:08.142 DEBUG:teuthology.orchestra.run.trial178:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.UWEz7GHMEq 2026-02-13T02:32:08.233 DEBUG:teuthology.orchestra.run.trial178:> sudo chmod 0666 /tmp/tmp.UWEz7GHMEq 2026-02-13T02:32:08.291 DEBUG:teuthology.orchestra.remote:trial178:/tmp/tmp.UWEz7GHMEq is 358KB 2026-02-13T02:32:08.347 DEBUG:teuthology.orchestra.run.trial178:> rm -fr /tmp/tmp.UWEz7GHMEq 2026-02-13T02:32:08.351 DEBUG:teuthology.misc:Transferring archived files from trial178:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48001/data/mon.c.tgz 2026-02-13T02:32:08.352 DEBUG:teuthology.orchestra.run.trial178:> mktemp 2026-02-13T02:32:08.397 INFO:teuthology.orchestra.run.trial178.stdout:/tmp/tmp.CLABDYazhp 2026-02-13T02:32:08.398 DEBUG:teuthology.orchestra.run.trial178:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.CLABDYazhp 2026-02-13T02:32:08.494 DEBUG:teuthology.orchestra.run.trial178:> sudo chmod 0666 /tmp/tmp.CLABDYazhp 2026-02-13T02:32:08.551 DEBUG:teuthology.orchestra.remote:trial178:/tmp/tmp.CLABDYazhp is 358KB 2026-02-13T02:32:08.607 DEBUG:teuthology.orchestra.run.trial178:> rm -fr /tmp/tmp.CLABDYazhp 2026-02-13T02:32:08.612 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-13T02:32:08.612 DEBUG:teuthology.orchestra.run.trial121:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-13T02:32:08.614 DEBUG:teuthology.orchestra.run.trial178:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-13T02:32:08.671 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-13T02:32:08.705 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-13T02:32:08.705 INFO:tasks.ceph:Archiving crash dumps... 2026-02-13T02:32:08.707 DEBUG:teuthology.misc:Transferring archived files from trial121:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48001/remote/trial121/crash 2026-02-13T02:32:08.708 DEBUG:teuthology.orchestra.run.trial121:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-13T02:32:08.720 DEBUG:teuthology.misc:Transferring archived files from trial178:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48001/remote/trial178/crash 2026-02-13T02:32:08.721 DEBUG:teuthology.orchestra.run.trial178:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-13T02:32:08.753 INFO:tasks.ceph:Shutting down logrotate 2026-02-13T02:32:08.754 DEBUG:teuthology.orchestra.run.trial121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-13T02:32:08.764 DEBUG:teuthology.orchestra.run.trial178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-13T02:32:08.807 DEBUG:teuthology.orchestra.run.trial121:> sudo rm /etc/logrotate.d/ceph-test.conf 2026-02-13T02:32:08.822 DEBUG:teuthology.orchestra.run.trial178:> sudo rm /etc/logrotate.d/ceph-test.conf 2026-02-13T02:32:08.857 INFO:tasks.ceph:Compressing logs... 2026-02-13T02:32:08.858 DEBUG:teuthology.orchestra.run.trial121:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T02:32:08.864 DEBUG:teuthology.orchestra.run.trial178:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T02:32:08.871 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14872.log 2026-02-13T02:32:08.873 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19269.log 2026-02-13T02:32:08.874 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.14872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19217.log 2026-02-13T02:32:08.874 INFO:teuthology.orchestra.run.trial121.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14872.log.gz 2026-02-13T02:32:08.874 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19055.log 2026-02-13T02:32:08.874 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.19269.log: /var/log/ceph/ceph-client.admin.19217.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.19217.log.gz 2026-02-13T02:32:08.874 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14992.log 2026-02-13T02:32:08.874 INFO:teuthology.orchestra.run.trial121.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.19269.log.gz 2026-02-13T02:32:08.874 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.19055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14932.log 2026-02-13T02:32:08.874 INFO:teuthology.orchestra.run.trial121.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.19055.log.gz 2026-02-13T02:32:08.874 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.14992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19321.log 2026-02-13T02:32:08.874 INFO:teuthology.orchestra.run.trial121.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14992.log.gz 2026-02-13T02:32:08.880 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.14932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19373.log 2026-02-13T02:32:08.880 INFO:teuthology.orchestra.run.trial121.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14932.log.gz 2026-02-13T02:32:08.881 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.19321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19347.log 2026-02-13T02:32:08.881 INFO:teuthology.orchestra.run.trial121.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.19321.log.gz 2026-02-13T02:32:08.881 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.19373.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-13T02:32:08.881 INFO:teuthology.orchestra.run.trial121.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.19373.log.gz 2026-02-13T02:32:08.881 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.19347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14885.log 2026-02-13T02:32:08.881 INFO:teuthology.orchestra.run.trial121.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.19347.log.gz 2026-02-13T02:32:08.881 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14860.log 2026-02-13T02:32:08.881 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.14885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14885.log.gz 2026-02-13T02:32:08.881 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14908.log 2026-02-13T02:32:08.881 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.14860.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2026-02-13T02:32:08.881 INFO:teuthology.orchestra.run.trial121.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.14860.log.gz 2026-02-13T02:32:08.882 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.14908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14908.log.gz 2026-02-13T02:32:08.882 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14944.log 2026-02-13T02:32:08.882 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14968.log 2026-02-13T02:32:08.882 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19163.log 2026-02-13T02:32:08.882 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.14944.log: 91.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2026-02-13T02:32:08.882 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.14968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14968.log.gz 2026-02-13T02:32:08.882 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15519.log 2026-02-13T02:32:08.882 INFO:teuthology.orchestra.run.trial121.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.14944.log.gz 2026-02-13T02:32:08.882 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.19163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15028.log 2026-02-13T02:32:08.882 INFO:teuthology.orchestra.run.trial121.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.19163.log.gz 2026-02-13T02:32:08.882 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.15519.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.15519.log.gz 2026-02-13T02:32:08.882 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14801.log 2026-02-13T02:32:08.882 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-13T02:32:08.883 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.15028.log: /var/log/ceph/ceph-client.admin.14801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15028.log.gz 2026-02-13T02:32:08.883 INFO:teuthology.orchestra.run.trial121.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14801.log.gz 2026-02-13T02:32:08.883 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15368.log 2026-02-13T02:32:08.883 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2026-02-13T02:32:08.883 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.15368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14896.log 2026-02-13T02:32:08.883 INFO:teuthology.orchestra.run.trial121.stderr: 87.2%/var/log/ceph/ceph-mds.a.log: -- replaced with /var/log/ceph/ceph-client.admin.15368.log.gz 2026-02-13T02:32:08.883 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19109.log 2026-02-13T02:32:08.883 INFO:teuthology.orchestra.run.trial121.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2026-02-13T02:32:08.883 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15470.log 2026-02-13T02:32:08.883 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.14896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14896.log.gz 2026-02-13T02:32:08.883 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.19109.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.19109.log.gz 2026-02-13T02:32:08.883 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18924.log 2026-02-13T02:32:08.884 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19081.log 2026-02-13T02:32:08.884 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.15470.log: /var/log/ceph/ceph-client.admin.18924.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.18924.log.gz 2026-02-13T02:32:08.884 INFO:teuthology.orchestra.run.trial121.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.15470.log.gz 2026-02-13T02:32:08.884 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19243.log 2026-02-13T02:32:08.891 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.19081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15016.log 2026-02-13T02:32:08.892 INFO:teuthology.orchestra.run.trial121.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.19081.log.gz 2026-02-13T02:32:08.892 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.19243.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-13T02:32:08.892 INFO:teuthology.orchestra.run.trial121.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.19243.log.gz 2026-02-13T02:32:08.892 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.15016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19029.log 2026-02-13T02:32:08.892 INFO:teuthology.orchestra.run.trial121.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15016.log.gz 2026-02-13T02:32:08.892 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-13T02:32:08.892 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.19029.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-13T02:32:08.892 INFO:teuthology.orchestra.run.trial121.stderr: 88.3% 89.8% -- replaced with /var/log/ceph/ceph-client.admin.19029.log.gz -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-13T02:32:08.892 INFO:teuthology.orchestra.run.trial121.stderr: 2026-02-13T02:32:08.892 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19002.log 2026-02-13T02:32:08.893 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14789.log 2026-02-13T02:32:08.893 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.19002.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.9919.log 2026-02-13T02:32:08.893 INFO:teuthology.orchestra.run.trial121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.19002.log.gz 2026-02-13T02:32:08.893 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.14789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14789.log.gz 2026-02-13T02:32:08.893 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19626.log 2026-02-13T02:32:08.893 INFO:teuthology.orchestra.run.trial121.stderr: 84.8% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-13T02:32:08.893 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph.tmp-client.admin.9919.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.9919.log.gz 2026-02-13T02:32:08.893 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19137.log 2026-02-13T02:32:08.893 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.19626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19449.log 2026-02-13T02:32:08.893 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.19137.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.19626.log.gz 2026-02-13T02:32:08.893 INFO:teuthology.orchestra.run.trial121.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.19137.log.gz 2026-02-13T02:32:08.893 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15004.log 2026-02-13T02:32:08.894 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15040.log 2026-02-13T02:32:08.894 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.19449.log: /var/log/ceph/ceph-client.admin.15004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15004.log.gz 2026-02-13T02:32:08.894 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19295.log 2026-02-13T02:32:08.894 INFO:teuthology.orchestra.run.trial121.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.19449.log.gz 2026-02-13T02:32:08.894 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14812.log 2026-02-13T02:32:08.894 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.15040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15040.log.gz 2026-02-13T02:32:08.894 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.19295.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-13T02:32:08.894 INFO:teuthology.orchestra.run.trial121.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.19295.log.gz 2026-02-13T02:32:08.894 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.14812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14956.log 2026-02-13T02:32:08.894 INFO:teuthology.orchestra.run.trial121.stderr: 74.6% -- replaced with /var/log/ceph/ceph-client.admin.14812.log.gz 2026-02-13T02:32:08.894 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14836.log 2026-02-13T02:32:08.894 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14921.log 2026-02-13T02:32:08.895 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.14956.log: /var/log/ceph/ceph-client.admin.14836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14836.log.gz 2026-02-13T02:32:08.895 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19399.log 2026-02-13T02:32:08.895 INFO:teuthology.orchestra.run.trial121.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.14956.log.gz 2026-02-13T02:32:08.895 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.14921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15738.log 2026-02-13T02:32:08.895 INFO:teuthology.orchestra.run.trial121.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14921.log.gz 2026-02-13T02:32:08.895 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.19399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19189.log 2026-02-13T02:32:08.895 INFO:teuthology.orchestra.run.trial121.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.19399.log.gz 2026-02-13T02:32:08.895 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14825.log 2026-02-13T02:32:08.895 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.15738.log: /var/log/ceph/ceph-client.admin.19189.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-13T02:32:08.895 INFO:teuthology.orchestra.run.trial121.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.15738.log.gz 2026-02-13T02:32:08.895 INFO:teuthology.orchestra.run.trial121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.19189.log.gz 2026-02-13T02:32:08.895 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-client.admin.14825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14981.log 2026-02-13T02:32:08.895 INFO:teuthology.orchestra.run.trial121.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.14825.log.gz 2026-02-13T02:32:08.896 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2026-02-13T02:32:08.896 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.14981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14981.log.gz 2026-02-13T02:32:08.896 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14848.log 2026-02-13T02:32:08.896 INFO:teuthology.orchestra.run.trial121.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.14848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14848.log.gz 2026-02-13T02:32:08.904 INFO:teuthology.orchestra.run.trial121.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2026-02-13T02:32:08.906 INFO:teuthology.orchestra.run.trial178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2026-02-13T02:32:08.907 INFO:teuthology.orchestra.run.trial178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-13T02:32:08.907 INFO:teuthology.orchestra.run.trial178.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2026-02-13T02:32:08.907 INFO:teuthology.orchestra.run.trial178.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-13T02:32:08.908 INFO:teuthology.orchestra.run.trial178.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-13T02:32:08.908 INFO:teuthology.orchestra.run.trial178.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2026-02-13T02:32:08.908 INFO:teuthology.orchestra.run.trial178.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2026-02-13T02:32:08.908 INFO:teuthology.orchestra.run.trial178.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2026-02-13T02:32:08.909 INFO:teuthology.orchestra.run.trial178.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-13T02:32:08.913 INFO:teuthology.orchestra.run.trial178.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14954.log 2026-02-13T02:32:08.913 INFO:teuthology.orchestra.run.trial178.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2026-02-13T02:32:08.913 INFO:teuthology.orchestra.run.trial178.stderr:gzip -5 --verbose/var/log/ceph/ceph.audit.log: -- /var/log/ceph/ceph-mon.c.log 2026-02-13T02:32:08.913 INFO:teuthology.orchestra.run.trial178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-13T02:32:08.913 INFO:teuthology.orchestra.run.trial178.stderr:/var/log/ceph/ceph-client.admin.14954.log: /var/log/ceph/ceph-mon.c.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.14954.log.gz 2026-02-13T02:32:08.913 INFO:teuthology.orchestra.run.trial178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-13T02:32:08.913 INFO:teuthology.orchestra.run.trial178.stderr:/var/log/ceph/ceph.log: 94.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-13T02:32:08.913 INFO:teuthology.orchestra.run.trial178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15050.log 2026-02-13T02:32:08.913 INFO:teuthology.orchestra.run.trial178.stderr: 91.6% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-13T02:32:08.913 INFO:teuthology.orchestra.run.trial178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15074.log 2026-02-13T02:32:08.914 INFO:teuthology.orchestra.run.trial178.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.15050.log: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-13T02:32:08.914 INFO:teuthology.orchestra.run.trial178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14978.log 2026-02-13T02:32:08.914 INFO:teuthology.orchestra.run.trial178.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.15050.log.gz 2026-02-13T02:32:08.914 INFO:teuthology.orchestra.run.trial178.stderr:/var/log/ceph/ceph-client.admin.15074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15098.log 2026-02-13T02:32:08.914 INFO:teuthology.orchestra.run.trial178.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.15074.log.gz 2026-02-13T02:32:08.914 INFO:teuthology.orchestra.run.trial178.stderr:/var/log/ceph/ceph-client.admin.14978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15026.log 2026-02-13T02:32:08.914 INFO:teuthology.orchestra.run.trial178.stderr:/var/log/ceph/ceph-client.admin.15098.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.14978.log.gz 2026-02-13T02:32:08.914 INFO:teuthology.orchestra.run.trial178.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.15098.log.gz 2026-02-13T02:32:08.914 INFO:teuthology.orchestra.run.trial178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15122.log 2026-02-13T02:32:08.914 INFO:teuthology.orchestra.run.trial178.stderr:/var/log/ceph/ceph-client.admin.15026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15002.log 2026-02-13T02:32:08.914 INFO:teuthology.orchestra.run.trial178.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.15026.log.gz 2026-02-13T02:32:08.914 INFO:teuthology.orchestra.run.trial178.stderr:/var/log/ceph/ceph-client.admin.15122.log: /var/log/ceph/ceph-client.admin.15002.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.15002.log.gz 2026-02-13T02:32:08.915 INFO:teuthology.orchestra.run.trial178.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.15122.log.gz 2026-02-13T02:32:08.926 INFO:teuthology.orchestra.run.trial121.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-13T02:32:08.928 INFO:teuthology.orchestra.run.trial178.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-13T02:32:08.934 INFO:teuthology.orchestra.run.trial121.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-13T02:32:08.934 INFO:teuthology.orchestra.run.trial178.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-13T02:32:08.943 INFO:teuthology.orchestra.run.trial121.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-13T02:32:08.951 INFO:teuthology.orchestra.run.trial121.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-13T02:32:08.955 INFO:teuthology.orchestra.run.trial121.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-13T02:32:08.956 INFO:teuthology.orchestra.run.trial121.stderr: 2026-02-13T02:32:08.956 INFO:teuthology.orchestra.run.trial121.stderr:real 0m0.091s 2026-02-13T02:32:08.956 INFO:teuthology.orchestra.run.trial121.stderr:user 0m0.333s 2026-02-13T02:32:08.956 INFO:teuthology.orchestra.run.trial121.stderr:sys 0m0.041s 2026-02-13T02:32:08.965 INFO:teuthology.orchestra.run.trial178.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-13T02:32:08.971 INFO:teuthology.orchestra.run.trial178.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-13T02:32:08.978 INFO:teuthology.orchestra.run.trial178.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2026-02-13T02:32:09.010 INFO:teuthology.orchestra.run.trial178.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2026-02-13T02:32:09.011 INFO:teuthology.orchestra.run.trial178.stderr: 2026-02-13T02:32:09.011 INFO:teuthology.orchestra.run.trial178.stderr:real 0m0.111s 2026-02-13T02:32:09.011 INFO:teuthology.orchestra.run.trial178.stderr:user 0m0.326s 2026-02-13T02:32:09.011 INFO:teuthology.orchestra.run.trial178.stderr:sys 0m0.045s 2026-02-13T02:32:09.012 INFO:tasks.ceph:Archiving logs... 2026-02-13T02:32:09.013 DEBUG:teuthology.misc:Transferring archived files from trial121:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48001/remote/trial121/log 2026-02-13T02:32:09.014 DEBUG:teuthology.orchestra.run.trial121:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T02:32:09.138 DEBUG:teuthology.misc:Transferring archived files from trial178:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48001/remote/trial178/log 2026-02-13T02:32:09.139 DEBUG:teuthology.orchestra.run.trial178:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T02:32:09.225 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/ceph.py", line 1995, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/contextutil.py", line 30, in nested vars.append(enter()) ^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/ceph.py", line 518, in cephfs_setup fs = Filesystem(ctx, fs_config=temp, name=name, create=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephfs/filesystem.py", line 574, in __init__ self.create(**kwargs) File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephfs/filesystem.py", line 795, in create self.run_client_payload(f"setfattr -n ceph.dir.layout.pool -v {ec_data_pool_name} . && getfattr -n ceph.dir.layout .") File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephfs/filesystem.py", line 881, in run_client_payload m.mount_wait() File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephfs/mount.py", line 527, in mount_wait self.mount(**kwargs) File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephfs/fuse_mount.py", line 52, in mount return self._mount(mntopts, mntargs, check_status) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephfs/fuse_mount.py", line 68, in _mount retval = self._run_mount_cmd(mntopts, mntargs, check_status) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephfs/fuse_mount.py", line 94, in _run_mount_cmd return self._wait_and_record_our_fuse_conn( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephfs/fuse_mount.py", line 189, in _wait_and_record_our_fuse_conn raise RuntimeError( RuntimeError: Fuse mount failed to populate/sys/ after 31 seconds 2026-02-13T02:32:09.227 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-13T02:32:09.239 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-13T02:32:09.253 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-13T02:32:09.253 DEBUG:teuthology.orchestra.run.trial121:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T02:32:09.255 DEBUG:teuthology.orchestra.run.trial178:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T02:32:09.395 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-13T02:32:09.406 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-13T02:32:09.406 DEBUG:teuthology.orchestra.run.trial121:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T02:32:09.407 DEBUG:teuthology.orchestra.run.trial178:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T02:32:09.414 INFO:teuthology.orchestra.run.trial121.stdout: remote refid st t when poll reach delay offset jitter 2026-02-13T02:32:09.414 INFO:teuthology.orchestra.run.trial121.stdout:============================================================================== 2026-02-13T02:32:09.414 INFO:teuthology.orchestra.run.trial121.stdout: 172-234-44-141. 81.104.22.229 2 u 22 64 7 8.685 -10.291 1.101 2026-02-13T02:32:09.414 INFO:teuthology.orchestra.run.trial121.stdout: time4.lshiy.com 141.32.131.246 2 u 24 64 7 213.752 -5.552 8.411 2026-02-13T02:32:09.414 INFO:teuthology.orchestra.run.trial121.stdout: nyc2.us.ntp.li 17.253.2.35 2 u 23 64 7 3.334 +4.019 1.222 2026-02-13T02:32:09.414 INFO:teuthology.orchestra.run.trial121.stdout: time.ecansol.ne .PPS. 1 u 24 64 7 30.749 +0.324 1.290 2026-02-13T02:32:09.438 INFO:teuthology.orchestra.run.trial178.stdout: remote refid st t when poll reach delay offset jitter 2026-02-13T02:32:09.438 INFO:teuthology.orchestra.run.trial178.stdout:============================================================================== 2026-02-13T02:32:09.438 INFO:teuthology.orchestra.run.trial178.stdout: 170-187-147-56. 80.192.165.246 2 u 20 64 7 23.268 +9.513 2.011 2026-02-13T02:32:09.438 INFO:teuthology.orchestra.run.trial178.stdout: 155.248.196.28 132.163.97.6 2 u 21 64 7 68.001 +1.409 1.450 2026-02-13T02:32:09.438 INFO:teuthology.orchestra.run.trial178.stdout: 23.186.168.133 132.163.97.4 2 u 153 64 4 69.747 +7.930 0.000 2026-02-13T02:32:09.438 INFO:teuthology.orchestra.run.trial178.stdout: 172-104-209-204 168.61.215.74 4 u 21 64 7 3.396 -0.079 0.826 2026-02-13T02:32:09.439 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-13T02:32:09.450 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-13T02:32:09.450 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-13T02:32:09.463 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-13T02:32:09.477 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-13T02:32:09.490 INFO:teuthology.task.internal:Duration was 224.216111 seconds 2026-02-13T02:32:09.490 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-13T02:32:09.505 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-13T02:32:09.505 DEBUG:teuthology.orchestra.run.trial121:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T02:32:09.507 DEBUG:teuthology.orchestra.run.trial178:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T02:32:09.532 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-13T02:32:09.532 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial121.front.sepia.ceph.com 2026-02-13T02:32:09.532 DEBUG:teuthology.orchestra.run.trial121:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T02:32:09.577 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial178.front.sepia.ceph.com 2026-02-13T02:32:09.578 DEBUG:teuthology.orchestra.run.trial178:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T02:32:09.584 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-13T02:32:09.584 DEBUG:teuthology.orchestra.run.trial121:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T02:32:09.620 DEBUG:teuthology.orchestra.run.trial178:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T02:32:09.769 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-13T02:32:09.769 DEBUG:teuthology.orchestra.run.trial121:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T02:32:09.771 DEBUG:teuthology.orchestra.run.trial178:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T02:32:09.778 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T02:32:09.779 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T02:32:09.780 INFO:teuthology.orchestra.run.trial121.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T02:32:09.780 INFO:teuthology.orchestra.run.trial121.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T02:32:09.780 INFO:teuthology.orchestra.run.trial121.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T02:32:09.781 INFO:teuthology.orchestra.run.trial178.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T02:32:09.781 INFO:teuthology.orchestra.run.trial178.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T02:32:09.782 INFO:teuthology.orchestra.run.trial178.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 0.0% 2026-02-13T02:32:09.782 INFO:teuthology.orchestra.run.trial178.stderr: -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T02:32:09.782 INFO:teuthology.orchestra.run.trial178.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T02:32:09.819 INFO:teuthology.orchestra.run.trial121.stderr: 82.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T02:32:09.824 INFO:teuthology.orchestra.run.trial178.stderr: 82.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T02:32:09.826 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-13T02:32:09.843 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-13T02:32:09.844 DEBUG:teuthology.orchestra.run.trial121:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T02:32:09.871 DEBUG:teuthology.orchestra.run.trial178:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T02:32:09.880 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-13T02:32:09.895 DEBUG:teuthology.orchestra.run.trial121:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T02:32:09.916 DEBUG:teuthology.orchestra.run.trial178:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T02:32:09.923 INFO:teuthology.orchestra.run.trial121.stdout:kernel.core_pattern = core 2026-02-13T02:32:09.929 INFO:teuthology.orchestra.run.trial178.stdout:kernel.core_pattern = core 2026-02-13T02:32:09.938 DEBUG:teuthology.orchestra.run.trial121:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T02:32:09.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:32:09.974 DEBUG:teuthology.orchestra.run.trial178:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T02:32:09.981 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:32:09.981 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-13T02:32:09.996 INFO:teuthology.task.internal:Transferring archived files... 2026-02-13T02:32:09.997 DEBUG:teuthology.misc:Transferring archived files from trial121:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48001/remote/trial121 2026-02-13T02:32:09.998 DEBUG:teuthology.orchestra.run.trial121:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T02:32:10.040 DEBUG:teuthology.misc:Transferring archived files from trial178:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48001/remote/trial178 2026-02-13T02:32:10.041 DEBUG:teuthology.orchestra.run.trial178:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T02:32:10.065 INFO:teuthology.task.internal:Removing archive directory... 2026-02-13T02:32:10.065 DEBUG:teuthology.orchestra.run.trial121:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T02:32:10.072 DEBUG:teuthology.orchestra.run.trial178:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T02:32:10.101 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-13T02:32:10.117 INFO:teuthology.task.internal:Not uploading archives. 2026-02-13T02:32:10.118 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-13T02:32:10.133 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-13T02:32:10.133 DEBUG:teuthology.orchestra.run.trial121:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T02:32:10.135 DEBUG:teuthology.orchestra.run.trial178:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T02:32:10.138 INFO:teuthology.orchestra.run.trial121.stdout: 1180220 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 02:32 /home/ubuntu/cephtest 2026-02-13T02:32:10.146 INFO:teuthology.orchestra.run.trial178.stdout: 1180220 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 02:32 /home/ubuntu/cephtest 2026-02-13T02:32:10.147 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-13T02:32:10.164 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-13T02:32:10.201 INFO:teuthology.run:Summary data: description: fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/forward-scrub} duration: 224.21611070632935 failure_reason: Fuse mount failed to populate/sys/ after 31 seconds flavor: default owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-13T02:32:10.201 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T02:32:10.328 INFO:teuthology.run:FAIL